00010000:00010000:0.0:1746147123.301533:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250525c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301541:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250525c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301546:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01be00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147123.301550:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250525c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301555:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250525c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301562:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147123.301564:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147123.301566:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250525c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301570:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250525c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301578:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301582:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301586:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301590:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01ae00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147123.301592:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301596:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301606:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800958e2400) 00010000:00010000:0.0:1746147123.301607:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147123.301609:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301613:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250525cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.301637:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x31399394250525be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c20 expref: 21 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.301647:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x31399394250525d3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c20 expref: 20 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.301653:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.301656:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147123.301657:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01b000, rc 0) 00000100:00100000:0.0:1746147123.301693:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:31593:x1830967307376896:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 5127us (5300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.301698:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14914 00000100:00100000:0.0:1746147123.303715:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12949 00000100:00100000:0.0:1746147123.303721:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307378176:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147123.303729:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.303737:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098887800/0x31399394250525e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75c35 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147123.303758:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310435328:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147123.303779:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147123.304638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.307452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.310757:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307379200 00000100:00100000:0.0:1746147123.310763:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307379200 00010000:00010000:0.0:1746147123.310790:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x31399394250525d3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c20 expref: 22 pid: 6215 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.310811:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5592 00000100:00100000:0.0:1746147123.310817:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2001:x1830967307379200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.310827:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.310832:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x31399394250525d3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c20 expref: 22 pid: 6215 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.310842:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x31399394250525d3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c20 expref: 22 pid: 6215 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.310858:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x31399394250525d3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c20 expref: 22 pid: 6215 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.310880:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.310884:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x313993942505260b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.310891:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x313993942505260b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.310896:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x313993942505260b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.310913:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.310950:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2001:x1830967307379200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.310956:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5592 00000100:00100000:0.0:1746147123.312490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.315533:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.315569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.315611:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.315811:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12954 00000100:00100000:0.0:1746147123.315819:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307379840:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147123.315836:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098886400/0x313993942505263c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.315846:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425052317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a0c expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.315852:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250523c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a98 expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.315859:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094009c00/0x3139939425052325 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a13 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.315864:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.315866:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.315868:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098886400/0x313993942505263c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.315900:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094009c00/0x3139939425052325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a13 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.315908:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094009c00/0x3139939425052325 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a13 expref: 42 pid: 9586 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.315916:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310435968:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147123.315945:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250523c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a98 expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.315958:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250523c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a98 expref: 17 pid: 17600 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.315965:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310436096:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147123.315989:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425052317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a0c expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.315997:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425052317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a0c expref: 27 pid: 1136 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.316004:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310436224:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147123.316030:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147123.316057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.316114:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.316156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.322613:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310435968:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147123.322647:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310436096:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147123.322715:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.322745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.322766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.322780:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.322801:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.322814:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307380864 00000100:00100000:0.0:1746147123.322816:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307380864 00010000:00010000:0.0:1746147123.322837:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x31399394250525f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c43 expref: 19 pid: 9585 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.322853:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307380480 00000100:00100000:0.0:1746147123.322855:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307380480 00010000:00010000:0.0:1746147123.322865:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250523c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75a98 expref: 19 pid: 17600 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.322881:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5593 00000100:00100000:0.0:1746147123.322887:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307380864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.322898:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.322916:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x31399394250525f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c43 expref: 19 pid: 9585 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.322925:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x31399394250525f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c43 expref: 19 pid: 9585 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.323001:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x31399394250525f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c43 expref: 19 pid: 9585 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.323016:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.323035:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307380864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 149us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.323041:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5593 00000100:00100000:0.0:1746147123.323070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.323137:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.323228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.323239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.323253:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307381376 00000100:00100000:0.0:1746147123.323256:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307381376 00010000:00010000:0.0:1746147123.323268:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5797800/0x3139939425052578 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75bd3 expref: 42 pid: 9585 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.323281:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5598 00000100:00100000:0.0:1746147123.323286:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307381376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.323293:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.323316:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5797800/0x3139939425052578 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75bd3 expref: 42 pid: 9585 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.323325:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5797800/0x3139939425052578 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75bd3 expref: 42 pid: 9585 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.323340:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.323353:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307381376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.323358:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5598 00000100:00100000:0.0:1746147123.323398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.330533:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.331137:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.331197:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.331216:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307381888 00000100:00100000:0.0:1746147123.331219:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307381888 00010000:00010000:0.0:1746147123.331234:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098887e00/0x313993942505257f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75be1 expref: 26 pid: 1853 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.331577:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5601 00000100:00100000:0.0:1746147123.331708:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307381760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.331717:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.331728:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e04600/0x313993942505259b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75bfd expref: 28 pid: 9586 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.331736:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e04600/0x313993942505259b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75bfd expref: 28 pid: 9586 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.331748:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04600/0x313993942505259b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75bfd expref: 28 pid: 9586 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.331759:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.331761:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.331763:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x313993942505262e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.331769:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x313993942505262e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.331780:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.332012:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967307381760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 428us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.332018:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5601 00000100:00100000:0.0:1746147123.333322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.335206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.335229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.335263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.335340:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307382912 00000100:00100000:0.0:1746147123.335345:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307382912 00010000:00010000:0.0:1746147123.335368:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425051be6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e754fd expref: 31 pid: 7237 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.335390:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5604 00000100:00100000:0.0:1746147123.335397:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967307382912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.335406:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.335410:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425051be6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e754fd expref: 31 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.335419:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425051be6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e754fd expref: 31 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.335438:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.335442:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425052658 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147123.335449:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.335475:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967307382912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.335480:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5604 00000100:00100000:0.0:1746147123.335527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.335539:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307383040 00000100:00100000:0.0:1746147123.335541:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307383040 00010000:00010000:0.0:1746147123.335551:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425051bdf lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e754f6 expref: 53 pid: 7237 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.335564:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5605 00000100:00100000:0.0:1746147123.335569:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967307383040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.335575:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.335578:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425051bdf lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e754f6 expref: 53 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.335584:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425051bdf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e754f6 expref: 53 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.335595:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.335597:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425052658 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147123.335602:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.335618:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967307383040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.335623:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5605 00000100:00100000:0.0:1746147123.335658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.335668:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307383168 00000100:00100000:0.0:1746147123.335670:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307383168 00010000:00010000:0.0:1746147123.335679:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425052062 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75822 expref: 52 pid: 7237 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.335694:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5606 00000100:00100000:0.0:1746147123.335698:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967307383168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.335703:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.335706:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425052062 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75822 expref: 52 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.335714:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425052062 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75822 expref: 52 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.336469:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425052062 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75822 expref: 53 pid: 7237 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.336477:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.336481:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425052658 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147123.336486:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.336500:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967307383168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 802us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.336505:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5606 00000100:00100000:0.0:1746147123.337403:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.338476:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307383680 00000100:00100000:0.0:1746147123.338480:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307383680 00010000:00010000:0.0:1746147123.338494:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x313993942505223e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75956 expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.338508:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5610 00000100:00100000:0.0:1746147123.338512:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967307383680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.338518:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.338522:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x313993942505223e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75956 expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.338536:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x313993942505223e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75956 expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.338547:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x313993942505223e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75956 expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.338556:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.338559:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425052658 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147123.338564:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425052658 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147123.338570:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425052658 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147123.338584:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.338601:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967307383680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.338610:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5610 00000100:00100000:0.0:1746147123.342068:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147123.342213:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310438912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147123.342526:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147123.342541:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310439424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.342557:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147123.342565:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310439936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.342576:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147123.342595:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577480/2, rc 0, transno 21474841126 00000100:00100000:0.0:1746147123.342599:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310438400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147123.342612:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310438912 00000100:00100000:0.0:1746147123.342614:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310438912 00000100:00100000:0.0:1746147123.343146:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12973 00000100:00100000:0.0:1746147123.343152:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310438912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147123.343215:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310438912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (688us total) trans 21474841132 rc 0/0 00000100:00100000:0.0:1746147123.343220:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12973 00000004:00080000:0.0:1746147123.343241:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576300/2, rc 0, transno 21474841132 00000100:00100000:0.0:1746147123.343244:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310438912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147123.343250:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094537480/2, rc 0, transno 17179873844 00000100:00100000:0.0:1746147123.343253:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310439424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147123.343259:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094534a80/2, rc 0, transno 17179873846 00000100:00100000:0.0:1746147123.343261:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310439936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.343472:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440064 00000100:00100000:0.0:1746147123.343476:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440064 00000100:00100000:0.0:1746147123.343504:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12974 00000100:00100000:0.0:1746147123.343508:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967310440064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.343910:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310440064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 401us (486us total) trans 17179873851 rc 0/0 00000100:00100000:0.0:1746147123.343916:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12974 00000100:00100000:0.0:1746147123.346593:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.348808:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.350934:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.350979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.351187:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12975 00000100:00100000:0.0:1746147123.351200:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307384064:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147123.351217:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.351239:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64be00/0x313993942505267b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75c6d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147123.351258:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x68141733, atime: 0x68141731, ctime: 0x68141733, blocks: 0x7c8 00010000:00010000:0.0:1746147123.351272:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.351274:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.351281:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64be00/0x313993942505267b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c6d expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.351294:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64be00/0x313993942505267b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c6d expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.351316:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64be00, rc 0) 00000100:00100000:0.0:1746147123.351348:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307384064:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 152us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.351361:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12975 00000100:00100000:0.0:1746147123.353418:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12978 00000100:00100000:0.0:1746147123.353430:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307384192:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147123.353445:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.353467:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425052682 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75c74 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147123.353485:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141733, atime: 0x68141733, ctime: 0x68141733, blocks: 0x808 00010000:00010000:0.0:1746147123.353500:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.353502:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.353508:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425052682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c74 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.353520:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425052682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c74 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.353528:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79bc00, rc 0) 00000100:00100000:0.0:1746147123.353560:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307384192:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.353566:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12978 00000100:00100000:0.0:1746147123.353583:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12980 00000100:00100000:0.0:1746147123.353588:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307384704:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147123.353594:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.353603:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425052697 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75c90 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147123.353614:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141733, atime: 0x68141733, ctime: 0x68141733, blocks: 0x1008 00010000:00010000:0.0:1746147123.353621:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.353623:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.353626:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425052697 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c90 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.353635:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425052697 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c90 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.353642:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:0.0:1746147123.353658:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307384704:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.353664:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12980 00000100:00100000:0.0:1746147123.467393:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.473785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.478793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.480224:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.480307:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.480873:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.480902:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.480970:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12985 00000100:00100000:0.0:1746147123.480977:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967307385856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147123.480984:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.480991:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009372dc00/0x31399394250526eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75cc8 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.481007:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.481008:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.481012:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009372dc00/0x31399394250526eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cc8 expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.481021:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009372dc00/0x31399394250526eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cc8 expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.481027:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372dc00, rc 0) 00000100:00100000:0.0:1746147123.481045:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967307385856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.481050:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12985 00000100:00100000:0.0:1746147123.481118:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.492682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.495464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.495483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.495568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.496556:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2811 00000100:00100000:0.0:1746147123.496563:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967307386368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147123.528346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.528927:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.530692:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.531850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.531872:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.537275:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.543690:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307388160 00000100:00100000:0.0:1746147123.543699:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307388160 00000100:00100000:0.0:1746147123.543718:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307388288 00000100:00100000:0.0:1746147123.543720:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307388288 00000100:00100000:0.0:1746147123.543766:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307388544 00000100:00100000:0.0:1746147123.543769:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307388544 00000100:00100000:0.0:1746147123.543786:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12988 00000100:00100000:0.0:1746147123.543793:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307388288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147123.543810:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.543823:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425052777 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75cf9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.543842:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.543843:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.543848:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425052777 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf9 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.543858:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425052777 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf9 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.543865:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b800, rc 0) 00000100:00100000:0.0:1746147123.543897:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967307388288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 106us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.543901:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12988 00000100:00100000:0.0:1746147123.543911:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12989 00000100:00100000:0.0:1746147123.543914:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967307388544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147123.543919:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.543925:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75d00 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.543932:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.543933:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.543935:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d00 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.543941:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d00 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.543945:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ac00, rc 0) 00000100:00100000:0.0:1746147123.543953:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307388544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 39us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.543957:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12989 00000100:00100000:0.0:1746147123.543962:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12991 00000100:00100000:0.0:1746147123.543965:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967307388800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147123.543968:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.543971:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75d0e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.543977:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.543978:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.543980:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.543986:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.543992:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400bc00, rc 0) 00000100:00100000:0.0:1746147123.543998:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967307388800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.544001:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12991 00000100:00100000:0.0:1746147123.544020:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12992 00000100:00100000:0.0:1746147123.544023:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967307388160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147123.544026:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.544029:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425052793 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75cf2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.544034:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.544035:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.544037:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425052793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf2 expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.544042:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425052793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf2 expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.544045:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ae00, rc 0) 00000100:00100000:0.0:1746147123.544053:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967307388160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 30us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.544055:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12992 00000100:00100000:0.0:1746147123.544227:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307388928 00000100:00100000:0.0:1746147123.544231:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307388928 00002000:00100000:0.0:1746147123.544252:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88011e501180 x1830967307388928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:499/0 lens 488/0 e 0 to 0 dl 1746147134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.544260:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501180 with x1830967307388928 ext(2097152->4194303) 00002000:00010000:0.0:1746147123.544263:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e501180 00000100:00100000:0.0:1746147123.544279:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2812 00000100:00100000:0.0:1746147123.544284:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967307388928:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147123.592647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.606836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.606889:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.614885:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5613 00000100:00100000:0.0:1746147123.614893:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307391488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.614905:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.614911:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x31399394250526c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c9e expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.614920:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x31399394250526c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c9e expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.614937:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x31399394250526c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c9e expref: 30 pid: 16099 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.614951:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.614954:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x31399394250527a1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.614962:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x31399394250527a1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.614970:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.615006:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307391488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.615012:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5613 00000100:00100000:0.0:1746147123.615150:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.615159:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307391872 00000100:00100000:0.0:1746147123.615161:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307391872 00010000:00010000:0.0:1746147123.615169:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x313993942505266d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c66 expref: 9 pid: 6215 timeout: 761 lvb_type: 0 00000100:00100000:0.0:1746147123.615182:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5614 00000100:00100000:0.0:1746147123.615185:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307391872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.615190:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.615193:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x313993942505266d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c66 expref: 9 pid: 6215 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.615199:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x313993942505266d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c66 expref: 9 pid: 6215 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.615209:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147123.615211:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x31399394250527a1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.615216:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x31399394250527a1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147123.615219:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.615234:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307391872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.615239:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5614 00000100:00100000:0.0:1746147123.615281:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2820 00000100:00100000:0.0:1746147123.615285:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967307391744:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147123.628389:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440960 00000100:00100000:0.0:1746147123.628396:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440960 00000100:00100000:0.0:1746147123.628423:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440832 00000100:00100000:0.0:1746147123.628425:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440832 00000100:00100000:0.0:1746147123.628437:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12993 00000100:00100000:0.0:1746147123.628444:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967310440960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147123.628536:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147123.628539:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147123 -> 1746147123 00002000:00010000:0.0:1746147123.628541:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147122 -> 1746147122 00002000:00010000:0.0:1746147123.628543:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147123 -> 1746147123 00002000:00010000:0.0:1746147123.628544:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147123.628567:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3766:x1830967310440960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (214us total) trans 17179873852 rc 0/0 00000100:00100000:0.0:1746147123.628774:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12993 00000100:00100000:0.0:1746147123.628784:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441216 00000100:00100000:0.0:1746147123.628786:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441216 00000100:00100000:0.0:1746147123.628792:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441728 00000100:00100000:0.0:1746147123.628794:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441728 00000100:00100000:0.0:1746147123.628799:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442240 00000100:00100000:0.0:1746147123.628800:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442240 00000100:00100000:0.0:1746147123.628806:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441088 00000100:00100000:0.0:1746147123.628807:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441088 00000100:00100000:0.0:1746147123.628813:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441600 00000100:00100000:0.0:1746147123.628814:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441600 00000100:00100000:0.0:1746147123.628820:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442112 00000100:00100000:0.0:1746147123.628822:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442112 00000100:00100000:0.0:1746147123.628827:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442624 00000100:00100000:0.0:1746147123.628828:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442624 00000100:00100000:0.0:1746147123.628835:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12997 00000100:00100000:0.0:1746147123.628839:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967310442368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147123.628877:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147123.628879:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147123.628881:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147123.628882:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147123.628884:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147123.628898:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3765:x1830967310442368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (441us total) trans 21474841136 rc 0/0 00000100:00100000:0.0:1746147123.628902:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12997 00000100:00100000:0.0:1746147123.628910:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13000 00000100:00100000:0.0:1746147123.628914:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967310442240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147123.628947:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147123.628949:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147123.628951:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147123.628952:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147123.628953:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147123.628969:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3764:x1830967310442240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (309us total) trans 17179873854 rc 0/0 00000100:00100000:0.0:1746147123.628974:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13000 00000100:00100000:0.0:1746147123.628983:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13002 00000100:00100000:0.0:1746147123.628987:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3767:x1830967310441600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147123.629019:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147123.629022:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147123 -> 1746147123 00002000:00010000:0.0:1746147123.629023:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147123 -> 1746147123 00002000:00010000:0.0:1746147123.629025:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147123 -> 1746147123 00002000:00010000:0.0:1746147123.629027:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147123.629043:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967310441600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (347us total) trans 21474841137 rc 0/0 00000100:00100000:0.0:1746147123.629048:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13002 00000100:00100000:0.0:1746147123.629075:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147123.629104:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310441984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.629123:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147123.629143:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310442496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147123.629160:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147123.629178:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db15880/2, rc 0, transno 17179873852 00000100:00100000:0.0:1746147123.629183:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310440960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147123.629189:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134869180/2, rc 0, transno 17179873857 00000100:00100000:0.0:1746147123.629191:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310441472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.630627:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147123.630635:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310442752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.630657:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147123.631000:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a3100/2, rc 0, transno 17179873860 00000100:00100000:0.0:1746147123.631005:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310442752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147123.644044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.661735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.661826:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.665854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.677944:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.679487:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967307392384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17241us (17660us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147123.679494:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2822 00002000:00100000:0.0:1746147123.679502:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880096897100 x1830967307392384/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:499/0 lens 488/440 e 0 to 0 dl 1746147134 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.679510:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096897100 with x1830967307392384 ext(2097152->4194303) 00002000:00010000:0.0:1746147123.679514:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096897100 00000100:00100000:0.0:1746147123.682681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.683027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.683140:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307393536 00000100:00100000:0.0:1746147123.683146:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307393536 00000100:00100000:0.0:1746147123.683185:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13012 00000100:00100000:0.0:1746147123.683193:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:31600:x1830967307393536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147123.683207:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147123.683222:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75d31 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.683244:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425052697 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c90 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.683251:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.683257:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372dc00/0x31399394250526eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cc8 expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.683267:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.683269:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.683271:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3534848->4120575] (req 3534848->4120575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 31 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.683308:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009372dc00/0x31399394250526eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cc8 expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.683318:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009372dc00/0x31399394250526eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cc8 expref: 43 pid: 1853 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.683328:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310443520:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147123.683640:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.683648:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.683656:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310443648:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147123.683685:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425052697 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c90 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.683693:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425052697 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c90 expref: 16 pid: 12225 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.683705:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310443776:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147123.683723:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147123.683755:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307393408 00000100:00100000:0.0:1746147123.683758:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307393408 00002000:00100000:0.0:1746147123.683786:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2220032->2224127) req@ffff88011e503800 x1830967307393408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:499/0 lens 488/0 e 0 to 0 dl 1746147134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.683794:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503800 with x1830967307393408 ext(2220032->2224127) 00010000:00010000:0.0:1746147123.683799:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093731800/0x31399394250527af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d23 expref: 47 pid: 1853 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.683808:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093731800/0x31399394250527af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d23 expref: 47 pid: 1853 timeout: 761 lvb_type: 0 00002000:00010000:0.0:1746147123.683813:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e503800 00000100:00100000:0.0:1746147123.683825:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 909 00000100:00100000:0.0:1746147123.683830:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967307393408:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147123.683942:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967307393408:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (285us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147123.683948:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 909 00002000:00100000:0.0:1746147123.683953:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2220032->2224127) req@ffff88011e503800 x1830967307393408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746147134 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.683959:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503800 with x1830967307393408 ext(2220032->2224127) 00010000:00010000:0.0:1746147123.683964:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093731800/0x31399394250527af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d23 expref: 47 pid: 1853 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.683971:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093731800/0x31399394250527af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d23 expref: 47 pid: 1853 timeout: 761 lvb_type: 0 00002000:00010000:0.0:1746147123.683976:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e503800 00000100:00100000:0.0:1746147123.685354:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310443520:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147123.685370:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310443648:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147123.685380:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310443776:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147123.685410:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3534848->4120575] (req 3534848->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 31 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.685424:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21200, rc 0) 00000100:00100000:0.0:1746147123.685464:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:31600:x1830967307393536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2271us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.685471:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13012 00000100:00100000:0.0:1746147123.687362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.687415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.687847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.687869:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307393920 00000100:00100000:0.0:1746147123.687876:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307393920 00010000:00010000:0.0:1746147123.687891:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.688121:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5620 00000100:00100000:0.0:1746147123.688129:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967307393920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.688140:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.688147:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.688155:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.688168:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x313993942505278c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d0e expref: 31 pid: 1853 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.688190:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.688192:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147123.688199:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.688206:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147123.688234:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147123.688245:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310443904:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147123.688303:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147123.691141:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.691738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.695006:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.697200:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307395200 00000100:00100000:0.0:1746147123.697205:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307395200 00002000:00100000:0.0:1746147123.697225:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (4116480->4120575) req@ffff88011e500a80 x1830967307395200/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:499/0 lens 488/0 e 0 to 0 dl 1746147134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.697234:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500a80 with x1830967307395200 ext(4116480->4120575) 00002000:00010000:0.0:1746147123.697238:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e500a80 00000100:00100000:0.0:1746147123.697262:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 911 00000100:00100000:0.0:1746147123.697268:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967307394944:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147123.707021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.712897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.712944:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.727875:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307396352 00000100:00100000:0.0:1746147123.727884:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307396352 00002000:00100000:0.0:1746147123.727927:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094535880 x1830967307396352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:499/0 lens 488/0 e 0 to 0 dl 1746147134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.727936:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535880 with x1830967307396352 ext(4194304->4919295) 00002000:00010000:0.0:1746147123.727941:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535880 00000100:00100000:0.0:1746147123.727969:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2827 00000100:00100000:0.0:1746147123.727977:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967307396352:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147123.741408:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.820546:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.828389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.837468:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.837515:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.837546:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307397760 00000100:00100000:0.0:1746147123.837553:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307397760 00002000:00100000:0.0:1746147123.837583:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (3534848->4120575) req@ffff880094571500 x1830967307397760/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:499/0 lens 488/0 e 0 to 0 dl 1746147134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.837591:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094571500 with x1830967307397760 ext(3534848->4120575) 00010000:00010000:0.0:1746147123.837599:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 30 pid: 10340 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.837610:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 30 pid: 10340 timeout: 761 lvb_type: 0 00002000:00010000:0.0:1746147123.837616:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094571500 00000100:00100000:0.0:1746147123.837630:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 912 00000100:00100000:0.0:1746147123.837636:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967307397760:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147123.843904:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967307397760:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6260us (6381us total) trans 21474841141 rc 0/0 00000100:00100000:0.0:1746147123.843915:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 912 00002000:00100000:0.0:1746147123.843924:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (3534848->4120575) req@ffff880094571500 x1830967307397760/t21474841141(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:499/0 lens 488/448 e 0 to 0 dl 1746147134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.843932:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094571500 with x1830967307397760 ext(3534848->4120575) 00010000:00010000:0.0:1746147123.843941:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 34 pid: 10340 timeout: 761 lvb_type: 0 00010000:00010000:0.0:1746147123.843952:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a21200/0x31399394250527bd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3534848->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d31 expref: 34 pid: 10340 timeout: 761 lvb_type: 0 00002000:00010000:0.0:1746147123.843957:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094571500 00000100:00100000:0.0:1746147123.844665:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.844707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.844730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.844754:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307398272 00000100:00100000:0.0:1746147123.844759:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307398272 00010000:00010000:0.0:1746147123.844778:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x3139939425052674 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c7b expref: 16 pid: 1398 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.844793:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307398400 00000100:00100000:0.0:1746147123.844794:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307398400 00010000:00010000:0.0:1746147123.844801:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f972e00/0x31399394250526dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cb3 expref: 46 pid: 1854 timeout: 761 lvb_type: 1 00000100:00100000:0.0:1746147123.844813:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5622 00000100:00100000:0.0:1746147123.844819:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307398272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147123.844829:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147123.844841:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x3139939425052674 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c7b expref: 16 pid: 1398 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.844859:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x3139939425052674 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c7b expref: 16 pid: 1398 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.844878:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x3139939425052674 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c7b expref: 16 pid: 1398 timeout: 761 lvb_type: 1 00010000:00010000:0.0:1746147123.844888:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147123.844898:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307398272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.844906:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5622 00000100:00100000:0.0:1746147123.846655:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.847390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.849300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.852864:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2832 00000100:00100000:0.0:1746147123.852871:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307399936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147123.863525:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.864262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.864287:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.865985:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445440 00000100:00100000:0.0:1746147123.865989:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445440 00000100:00100000:0.0:1746147123.866028:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1746147123.866033:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310445440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746147123.866045:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 90112 granted 1184576576 pending 9080832 free 3909718016 avail 3678195712 00000100:00100000:0.0:1746147123.866079:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310445440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147123.866085:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1746147123.870834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.873260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.883715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.889586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.896414:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.896459:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.919525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.919577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.955855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.963468:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.967872:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.967911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.967952:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.971493:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:0.0:1746147123.971689:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147122 -> 1746147123 00000100:00100000:0.0:1746147123.971708:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310445824:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147123.971736:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425052896 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d93 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.971751:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425052896 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d93 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147123.971763:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d800, rc 0) 00000100:00100000:0.0:1746147123.971994:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967307403392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3665us (4081us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147123.972001:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13019 00000100:00100000:0.0:1746147123.987071:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147123.988270:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307404672 00000100:00100000:0.0:1746147123.988273:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307404672 00002000:00100000:0.0:1746147123.990082:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094534e00 x1830967307404672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:499/0 lens 488/0 e 0 to 0 dl 1746147134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147123.990103:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534e00 with x1830967307404672 ext(1048576->2097151) 00002000:00010000:0.0:1746147123.990107:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094534e00 00000100:00100000:0.0:1746147123.990207:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2840 00000100:00100000:0.0:1746147123.990333:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967307404672:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147124.003702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.027675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.027733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.040767:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.043765:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.045742:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.045814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.058204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.066348:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.081789:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.084829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.100168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.102640:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.102755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.103013:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13027 00000100:00100000:0.0:1746147124.103022:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967307407616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147124.103039:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147124.103056:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75dd9 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.103075:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.103077:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.103084:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd9 expref: 53 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.103124:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd9 expref: 53 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.103134:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99600, rc 0) 00000100:00100000:0.0:1746147124.103166:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2001:x1830967307407616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 146us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147124.103173:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13027 00000100:00100000:0.0:1746147124.117444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.117496:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.122329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.141907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.143534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.143615:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.143649:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307408896 00000100:00100000:0.0:1746147124.143653:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307408896 00010000:00010000:0.0:1746147124.143672:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31400/0x31399394250528e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dbd expref: 36 pid: 1853 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746147124.143708:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5631 00000100:00100000:0.0:1746147124.143713:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2002:x1830967307408896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147124.143722:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147124.143739:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a31400/0x31399394250528e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dbd expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.143751:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a31400/0x31399394250528e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dbd expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.143766:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31400/0x31399394250528e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dbd expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.143781:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.143783:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.143788:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.143794:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147124.146790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.149624:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094573800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310447104:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147124.149644:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147124.149681:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2002:x1830967307408896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5967us (6064us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147124.149690:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5631 00000100:00100000:0.0:1746147124.149722:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307409408 00000100:00100000:0.0:1746147124.149726:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307409408 00002000:00100000:0.0:1746147124.149750:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3014656->3018751) req@ffff8800a5575500 x1830967307409408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:500/0 lens 488/0 e 0 to 0 dl 1746147135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.149759:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575500 with x1830967307409408 ext(3014656->3018751) 00010000:00010000:0.0:1746147124.149767:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.149780:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00002000:00010000:0.0:1746147124.149786:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5575500 00000100:00100000:0.0:1746147124.149806:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 918 00000100:00100000:0.0:1746147124.149812:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967307409408:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147124.149898:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967307409408:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 86us (331us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147124.149904:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 918 00002000:00100000:0.0:1746147124.149909:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3014656->3018751) req@ffff8800a5575500 x1830967307409408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746147135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.149916:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575500 with x1830967307409408 ext(3014656->3018751) 00010000:00010000:0.0:1746147124.149920:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.149929:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00002000:00010000:0.0:1746147124.149935:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5575500 00000100:00100000:0.0:1746147124.158319:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.158367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.162693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.162743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.162762:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307410048 00000100:00100000:0.0:1746147124.162765:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307410048 00010000:00010000:0.0:1746147124.162787:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd9 expref: 53 pid: 10340 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.162819:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5632 00000100:00100000:0.0:1746147124.162824:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2001:x1830967307410048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147124.162837:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147124.162860:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd9 expref: 53 pid: 10340 timeout: 762 lvb_type: 1 00010000:00010000:0.0:1746147124.162870:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd9 expref: 53 pid: 10340 timeout: 762 lvb_type: 1 00010000:00010000:0.0:1746147124.162886:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425052937 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd9 expref: 53 pid: 10340 timeout: 762 lvb_type: 1 00010000:00010000:0.0:1746147124.162900:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147124.163251:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967307410048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 426us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147124.163257:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5632 00000100:00100000:0.0:1746147124.165859:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.167184:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.170030:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307410432 00000100:00100000:0.0:1746147124.170036:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307410432 00010000:00010000:0.0:1746147124.170219:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746147124.170249:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5634 00000100:00100000:0.0:1746147124.170255:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+37:2000:x1830967307410432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147124.170267:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147124.170281:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147123 -> 1746147124 00002000:00010000:0.0:1746147124.170296:0:7226:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147123 -> 1746147124 00010000:00010000:0.0:1746147124.170301:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.170317:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.170340:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x3139939425052930 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75dd2 expref: 37 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.170352:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.170353:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.170360:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c11800/0x3139939425052945 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75de7 expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.170366:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c11800/0x3139939425052945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75de7 expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.170390:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091c11800/0x3139939425052945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75de7 expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147124.170399:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310447744:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147124.170449:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147124.174844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.178195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.178626:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.193147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.194838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.201874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.201907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.205008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.205028:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307412480 00000100:00100000:0.0:1746147124.205031:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307412480 00002000:00100000:0.0:1746147124.205047:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880094572a00 x1830967307412480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:500/0 lens 488/0 e 0 to 0 dl 1746147135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.205053:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094572a00 with x1830967307412480 ext(3145728->4194303) 00002000:00010000:0.0:1746147124.205055:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094572a00 00000100:00100000:0.0:1746147124.205072:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2850 00000100:00100000:0.0:1746147124.205077:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967307412480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147124.218894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.222617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.223164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.232921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.272715:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.357453:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147124.357793:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147124.365566:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.404454:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.409834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.410455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.410486:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.412600:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307415040 00000100:00100000:0.0:1746147124.412604:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307415040 00000100:00100000:0.0:1746147124.412662:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13037 00000100:00100000:0.0:1746147124.412668:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+36:31639:x1830967307415040:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147124.412682:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147124.412945:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250529c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75e2d expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.412966:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425052682 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c74 expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.412973:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425052793 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf2 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.412979:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7e00/0x31399394250526d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cac expref: 46 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.412985:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.412986:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.412988:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250529c3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1253376->1376255] (req 1253376->1376255) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e2d expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.413006:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d7e00/0x31399394250526d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cac expref: 46 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.413016:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7e00/0x31399394250526d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cac expref: 46 pid: 12201 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.413023:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310448512:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147124.413350:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425052793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf2 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.413358:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425052793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cf2 expref: 37 pid: 1853 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.413367:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310448640:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147124.413398:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425052682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c74 expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.413405:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425052682 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c74 expref: 14 pid: 12225 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.413411:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310448768:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147124.413425:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147124.413992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.417044:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310448512:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147124.417055:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310448640:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147124.417062:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310448768:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147124.417114:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250529c3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1253376->1376255] (req 1253376->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e2d expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.417133:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00000100:00100000:0.0:1746147124.417181:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+37:31639:x1830967307415040:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4512us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147124.417189:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13037 00000100:00100000:0.0:1746147124.417798:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.417833:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.417860:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147124.419364:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147124.425441:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.426861:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307416064 00000100:00100000:0.0:1746147124.426865:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307416064 00000100:00100000:0.0:1746147124.426892:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13038 00000100:00100000:0.0:1746147124.426897:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:31636:x1830967307416064:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147124.426909:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147124.426926:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250529ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75e34 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.426951:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936b6e00/0x3139939425052690 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c82 expref: 16 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.426959:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d00 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.426965:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7c00/0x31399394250526e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cba expref: 54 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.426972:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.426974:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147124.426977:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250529ca lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e34 expref: 54 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.427005:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7c00/0x31399394250526e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cba expref: 54 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.427021:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7c00/0x31399394250526e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75cba expref: 54 pid: 12201 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.427032:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310449024:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147124.428193:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d00 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.428203:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d00 expref: 29 pid: 1853 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.428213:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310449152:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147124.428759:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936b6e00/0x3139939425052690 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c82 expref: 16 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147124.428768:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936b6e00/0x3139939425052690 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75c82 expref: 16 pid: 10340 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.428780:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310449280:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147124.428805:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147124.431453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.433313:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147124.434374:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147124.434403:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.435344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.435358:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307416704 00000100:00100000:0.0:1746147124.435361:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307416704 00010000:00010000:0.0:1746147124.435373:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942505277e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75d00 expref: 30 pid: 1853 timeout: 762 lvb_type: 1 00000100:00100000:0.0:1746147124.436566:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.441074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.445939:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.461247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.465940:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.465979:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.478429:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307418880 00000100:00100000:0.0:1746147124.478438:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307418880 00000100:00100000:0.0:1746147124.478482:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13042 00000100:00100000:0.0:1746147124.478490:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:31647:x1830967307418880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147124.478581:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147124.478601:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x3139939425052a1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75e5e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.478633:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250529c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e2d expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.478641:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147124.478643:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147124.478647:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x3139939425052a1e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e5e expref: 46 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.478676:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250529c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1376255) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e2d expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.478692:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250529c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1376255) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e2d expref: 37 pid: 10340 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746147124.478704:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310449920:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147124.478802:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147124.484243:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.493768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147124.498119:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841145 is committed 00000001:00080000:0.0:1746147124.498136:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841143 is committed 00000001:00080000:0.0:1746147124.498146:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841140 is committed 00000001:00080000:0.0:1746147124.498205:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841111 is committed 00000100:00100000:0.0:1746147124.511402:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.511917:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.518500:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.524402:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.535483:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.535520:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307420800 00000100:00100000:0.0:1746147124.535524:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307420800 00000100:00100000:0.0:1746147124.535555:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13045 00000100:00100000:0.0:1746147124.535561:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+29:31644:x1830967307420800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147124.535572:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147124.535589:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425052a33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75e73 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.535614:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250529ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e34 expref: 54 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.535622:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147124.535624:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147124.535627:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425052a33 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e73 expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.535655:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250529ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e34 expref: 54 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.535667:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250529ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e34 expref: 54 pid: 10340 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746147124.535680:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310450432:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147124.536394:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147124.540779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147124.548319:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873865 is committed 00000001:00080000:0.0:1746147124.548329:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873864 is committed 00000001:00080000:0.0:1746147124.548344:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873860 is committed 00000001:00080000:0.0:1746147124.548429:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873825 is committed 00000100:00100000:0.0:1746147124.550890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.558366:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.558436:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.561883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.573171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.576697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.577758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.577863:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307421696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18870us (19424us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147124.577873:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2862 00002000:00100000:0.0:1746147124.577881:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011e501880 x1830967307421696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:500/0 lens 488/440 e 0 to 0 dl 1746147135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.577891:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501880 with x1830967307421696 ext(1048576->2097151) 00002000:00010000:0.0:1746147124.577895:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e501880 00000100:00100000:0.0:1746147124.577961:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310450944:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147124.577985:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425052a48 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147124.578820:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425052a48 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147124.578825:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425052a48 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147124.578836:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147124.578888:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425052a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e81 expref: 23 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.578911:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425052a48 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e81 expref: 22 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.578920:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147124.578922:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147124.578924:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:0.0:1746147124.578943:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:31649:x1830967307421952:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 16787us (17066us total) trans 8589935541 rc 0/0 00000100:00100000:0.0:1746147124.579169:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14941 00000100:00100000:0.0:1746147124.596991:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.597050:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.597287:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2863 00000100:00100000:0.0:1746147124.597296:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307422848:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147124.607329:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.611909:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307423360 00000100:00100000:0.0:1746147124.611918:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307423360 00002000:00100000:0.0:1746147124.611960:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880095236680 x1830967307423360/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:500/0 lens 488/0 e 0 to 0 dl 1746147135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.611969:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095236680 with x1830967307423360 ext(2097152->3145727) 00002000:00010000:0.0:1746147124.611974:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095236680 00000100:00100000:0.0:1746147124.611993:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2865 00000100:00100000:0.0:1746147124.611999:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307423360:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147124.619625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.624595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.625212:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.628322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.633745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.640435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.640482:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.641442:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 927 00000100:00100000:0.0:1746147124.641450:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307424896:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147124.647011:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.650010:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307424896:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8551us (9516us total) trans 21474841147 rc 0/0 00000100:00100000:0.0:1746147124.650023:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 927 00002000:00100000:0.0:1746147124.650034:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (3416064->3665919) req@ffff880091c3fb80 x1830967307424896/t21474841147(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:500/0 lens 488/448 e 0 to 0 dl 1746147135 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.650042:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3fb80 with x1830967307424896 ext(3416064->3665919) 00010000:00010000:0.0:1746147124.650050:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee600/0x3139939425052a6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e8f expref: 10 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.650062:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee600/0x3139939425052a6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e8f expref: 10 pid: 1853 timeout: 762 lvb_type: 0 00002000:00010000:0.0:1746147124.650069:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c3fb80 00000100:00100000:0.0:1746147124.656671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.657226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.659603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.665300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.675320:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.683645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.700719:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307427072 00000100:00100000:0.0:1746147124.700729:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307427072 00002000:00100000:0.0:1746147124.700776:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012e322d80 x1830967307427072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:500/0 lens 504/0 e 0 to 0 dl 1746147135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.700786:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e322d80 with x1830967307427072 ext(3145728->4194303) 00010000:00010000:0.0:1746147124.700796:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0600/0x3139939425052a79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4083711) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e9d expref: 27 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746147124.700817:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0600/0x3139939425052a79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4083711) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e9d expref: 27 pid: 1853 timeout: 762 lvb_type: 0 00002000:00010000:0.0:1746147124.700824:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e322d80 00000100:00100000:0.0:1746147124.701041:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307426944 00000100:00100000:0.0:1746147124.701045:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307426944 00002000:00100000:0.0:1746147124.701059:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880096895c00 x1830967307426944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:500/0 lens 488/0 e 0 to 0 dl 1746147135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147124.701065:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096895c00 with x1830967307426944 ext(2097152->4194303) 00002000:00010000:0.0:1746147124.701068:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096895c00 00000100:00100000:0.0:1746147124.701109:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2867 00000100:00100000:0.0:1746147124.701115:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307426944:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147124.728502:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.729574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.735082:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.738659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.766479:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.768011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.779152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.784271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.784447:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.789767:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.795800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.798947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.799205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.803002:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.810806:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.819997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.823884:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.829941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.921309:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.924077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.928910:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307431680 00000100:00100000:0.0:1746147124.928914:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307431680 00000100:00100000:0.0:1746147124.928948:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14945 00000100:00100000:0.0:1746147124.928954:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+25:31664:x1830967307431680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147124.928965:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147124.928975:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425052af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75edc expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.929026:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929035:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929044:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929053:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929058:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929063:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929155:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425052b0c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929163:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425052b0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929371:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425052b0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147124.929379:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147124.929431:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929437:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929442:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929446:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256fe00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147124.929449:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929454:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929461:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147124.929463:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147124.929466:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.929470:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x3139939425052afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930615:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930623:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930627:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930632:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256f600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147124.930634:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930638:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930646:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012dc2bd00) 00010000:00010000:0.0:1746147124.930648:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147124.930650:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930654:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425052b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147124.930692:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425052af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75edc expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.930702:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425052b0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75edc expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147124.930707:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147124.930710:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147124.930712:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ea00, rc 0) 00000100:00100000:0.0:1746147124.930758:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+27:31664:x1830967307431680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1804us (2143us total) trans 8589935547 rc 0/0 00000100:00100000:0.0:1746147124.930764:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14945 00000100:00100000:0.0:1746147124.932221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.937477:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.942018:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.949085:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.956393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.960446:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2876 00000100:00100000:0.0:1746147124.960461:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307433472:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147124.963451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.969763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.988213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147124.994383:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.010881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.022953:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310453760:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147125.022974:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.023021:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307434368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8659us (12146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.023030:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5661 00000100:00100000:0.0:1746147125.026754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.032897:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.032929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.032961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.032999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.033030:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307435264 00000100:00100000:0.0:1746147125.033036:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307435264 00000100:00100000:0.0:1746147125.033068:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307435392 00000100:00100000:0.0:1746147125.033069:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307435392 00000100:00100000:0.0:1746147125.033083:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13059 00000100:00100000:0.0:1746147125.033112:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307435264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147125.033127:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.033142:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425052b6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75f06 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.033184:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310453888:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147125.033243:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.033259:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13060 00000100:00100000:0.0:1746147125.033264:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307435392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147125.033281:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.033287:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425052b75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75f0d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.033300:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.033301:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.033307:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425052b75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f0d expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.033319:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425052b75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f0d expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.033327:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ee200, rc 0) 00000100:00100000:0.0:1746147125.033344:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307435392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.033349:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13060 00000100:00100000:0.0:1746147125.033456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.033471:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307435520 00000100:00100000:0.0:1746147125.033474:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307435520 00000100:00100000:0.0:1746147125.033493:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 738 00000100:00100000:0.0:1746147125.033498:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967307435520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.033505:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.033520:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fc00/0x3139939425052b60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75eff expref: 47 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.033535:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.033538:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.033552:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967307435520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.033556:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 738 00000100:00100000:0.0:1746147125.033648:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307435136 00000100:00100000:0.0:1746147125.033650:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307435136 00002000:00100000:0.0:1746147125.033664:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8800930e8000 x1830967307435136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:501/0 lens 488/0 e 0 to 0 dl 1746147136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.033671:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8000 with x1830967307435136 ext(2097152->3145727) 00002000:00010000:0.0:1746147125.033674:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e8000 00000100:00100000:0.0:1746147125.033684:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2879 00000100:00100000:0.0:1746147125.033688:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307435136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147125.038393:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310453888:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147125.038418:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425052b6e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f06 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.038431:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425052b6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f06 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.038440:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:0.0:1746147125.040926:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307435264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7827us (7954us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147125.040935:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13059 00000100:00100000:0.0:1746147125.058927:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.060057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.067571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.069976:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.079309:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.079402:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.089498:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.122370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.142205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.147735:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.147790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.155237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.157705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.163720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.172467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.172612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.172637:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307438208 00000100:00100000:0.0:1746147125.172644:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307438208 00000100:00100000:0.0:1746147125.172703:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14948 00000100:00100000:0.0:1746147125.172710:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:31674:x1830967307438208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147125.172737:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.172754:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x3139939425052ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75f3e expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.172815:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172827:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172836:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172845:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172850:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172855:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172933:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425052bbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172942:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425052bbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.172948:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425052bbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147125.172958:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147125.173019:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173025:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173029:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173034:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173039:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984efc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.173042:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173047:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173056:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147125.173059:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147125.173062:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173066:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425052bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173081:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173085:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173123:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173127:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ef400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.173129:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173133:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173139:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a600) 00010000:00010000:0.0:1746147125.173141:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147125.173143:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173148:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x3139939425052bb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.173179:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x3139939425052ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f3e expref: 49 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.173189:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425052bbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f3e expref: 48 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.173195:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.173197:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147125.173199:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:0.0:1746147125.173237:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:31674:x1830967307438208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 527us (625us total) trans 8589935552 rc 0/0 00000100:00100000:0.0:1746147125.173244:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14948 00000100:00100000:0.0:1746147125.173397:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310455040:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147125.173419:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0a00/0x3139939425052b9f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f37 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.173430:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0a00, rc 0) 00000100:00100000:0.0:1746147125.173450:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:31666:x1830967307437824:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9586us (9732us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.173456:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13066 00000100:00100000:0.0:1746147125.181721:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.183586:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307438464 00000100:00100000:0.0:1746147125.183591:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307438464 00000100:00100000:0.0:1746147125.183619:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13067 00000100:00100000:0.0:1746147125.183626:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:31670:x1830967307438464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147125.183677:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.183690:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x3139939425052bc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75f45 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.184214:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.184216:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.184226:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x3139939425052bc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2433024->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f45 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.184239:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x3139939425052bc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2433024->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f45 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.184248:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.184249:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.184253:0:10340:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0a00/0x3139939425052b9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f37 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.184259:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0a00/0x3139939425052b9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f37 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.184293:0:10340:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e0a00/0x3139939425052b9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f37 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.184303:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310455168:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147125.184341:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.190322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.194420:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.205758:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307439488 00000100:00100000:0.0:1746147125.205763:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307439488 00000100:00100000:0.0:1746147125.205998:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13069 00000100:00100000:0.0:1746147125.206004:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307439488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147125.206012:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.206020:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984eee00/0x3139939425052bd7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75f4c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.206056:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310455296:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147125.206128:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.206568:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.212431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.212480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.213424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.213451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.213471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.216805:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310455808:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147125.216822:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425052bec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f61 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.216831:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425052bec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f61 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.216849:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21400, rc 0) 00000100:00100000:0.0:1746147125.216867:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307440128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3186us (3416us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147125.216874:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13072 00000100:00100000:0.0:1746147125.223185:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.226896:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.245054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.245153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.245184:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.245200:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307441664 00000100:00100000:0.0:1746147125.245203:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307441664 00000100:00100000:0.0:1746147125.245223:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 829 00000100:00100000:0.0:1746147125.245227:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967307441664:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147125.245965:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967307441664:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 735us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.245971:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 829 00000100:00100000:0.0:1746147125.246336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.246409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147125.247971:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746147125.250340:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.250868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.253392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.253443:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.256209:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.257079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.257157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.257703:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307443072 00000100:00100000:0.0:1746147125.257707:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307443072 00000100:00100000:0.0:1746147125.257739:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13077 00000100:00100000:0.0:1746147125.257745:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307443072:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147125.257752:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.257760:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c2b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75f92 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.257778:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c2b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f92 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.257786:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f92 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.257798:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984efc00, rc 0) 00000100:00100000:0.0:1746147125.257816:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307443072:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 72us (266us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147125.257821:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13077 00000100:00100000:0.0:1746147125.258495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.262552:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.266249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.269650:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307443712 00000100:00100000:0.0:1746147125.269658:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307443712 00000100:00100000:0.0:1746147125.269713:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14951 00000100:00100000:0.0:1746147125.269720:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31679:x1830967307443712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147125.269742:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.269760:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x3139939425052c4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e75fa7 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.269845:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee000/0x3139939425052c55 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.269860:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425052c40 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fa0 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.269866:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee000/0x3139939425052c55 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.269898:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425052c40 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fa0 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.269910:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425052c40 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fa0 expref: 11 pid: 6215 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.269922:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c309c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310456704:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147125.270012:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.271355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.273553:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.273585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.273619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.276033:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310456832:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147125.276051:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425052c63 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fbc expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.276061:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425052c63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fbc expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147125.276074:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20e00, rc 0) 00000100:00100000:0.0:1746147125.276203:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307444224:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2441us (2582us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147125.276209:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13081 00000100:00100000:0.0:1746147125.277794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.280425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.280463:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.280499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.280527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.280546:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.280565:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307444736 00000100:00100000:0.0:1746147125.280571:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307444736 00000100:00100000:0.0:1746147125.280599:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307445248 00000100:00100000:0.0:1746147125.280601:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307445248 00000100:00100000:0.0:1746147125.280612:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307444864 00000100:00100000:0.0:1746147125.280614:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307444864 00000100:00100000:0.0:1746147125.280629:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13083 00000100:00100000:0.0:1746147125.280634:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307444992:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147125.280663:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.280678:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425052b91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f29 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.280684:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147125.280686:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147125.280689:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.280715:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425052b91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f29 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.280726:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425052b91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f29 expref: 11 pid: 1853 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.280739:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310457216:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147125.280854:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.280892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.283761:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310457216:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147125.283775:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.284838:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287679:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.287705:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307445632 00000100:00100000:0.0:1746147125.287710:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307445632 00010000:00010000:0.0:1746147125.287740:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425052ab8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ec0 expref: 9 pid: 1853 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746147125.287764:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307446016 00000100:00100000:0.0:1746147125.287766:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307446016 00010000:00010000:0.0:1746147125.287776:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093709a00/0x3139939425052c1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f84 expref: 12 pid: 12225 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746147125.287787:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307446400 00000100:00100000:0.0:1746147125.287789:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307446400 00010000:00010000:0.0:1746147125.287796:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425052a25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e65 expref: 10 pid: 1853 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.287805:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307445888 00000100:00100000:0.0:1746147125.287807:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307445888 00010000:00010000:0.0:1746147125.287816:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091cc7000/0x31399394250526cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ca5 expref: 28 pid: 1854 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746147125.287826:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5674 00000100:00100000:0.0:1746147125.287831:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307445632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.287841:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.287856:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425052ab8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ec0 expref: 10 pid: 1853 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.287868:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425052ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ec0 expref: 10 pid: 1853 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.287887:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425052ab8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ec0 expref: 10 pid: 1853 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.287904:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.287933:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307445632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.287938:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5674 00000100:00100000:0.0:1746147125.287951:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5675 00000100:00100000:0.0:1746147125.287955:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307446016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.287961:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.287968:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093709a00/0x3139939425052c1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f84 expref: 12 pid: 12225 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.287976:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093709a00/0x3139939425052c1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f84 expref: 12 pid: 12225 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.287986:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093709a00/0x3139939425052c1d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f84 expref: 12 pid: 12225 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.287995:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.288007:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307446016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.288015:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5675 00000100:00100000:0.0:1746147125.288047:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5677 00000100:00100000:0.0:1746147125.288051:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307445888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.288057:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.288068:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091cc7000/0x31399394250526cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ca5 expref: 28 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288075:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091cc7000/0x31399394250526cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ca5 expref: 28 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288104:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cc7000/0x31399394250526cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ca5 expref: 28 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288118:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.288130:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307445888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 80us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.288135:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5677 00000100:00100000:0.0:1746147125.288158:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.288196:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.288451:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5679 00000100:00100000:0.0:1746147125.288456:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307446528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.288463:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.288468:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425052770 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ceb expref: 12 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288480:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425052770 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ceb expref: 12 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288490:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425052770 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75ceb expref: 12 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288497:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.288498:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.288501:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098227000/0x3139939425052c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.288506:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098227000/0x3139939425052c9b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.288520:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.288532:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307446528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.288536:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5679 00000100:00100000:0.0:1746147125.288566:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.288575:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307446272 00000100:00100000:0.0:1746147125.288576:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307446272 00010000:00010000:0.0:1746147125.288583:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093708400/0x3139939425052c16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f7d expref: 11 pid: 10340 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746147125.288607:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5680 00000100:00100000:0.0:1746147125.288612:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307446272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.288620:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.288626:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093708400/0x3139939425052c16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f7d expref: 11 pid: 10340 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288633:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093708400/0x3139939425052c16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f7d expref: 11 pid: 10340 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288641:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093708400/0x3139939425052c16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f7d expref: 11 pid: 10340 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.288649:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.288661:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307446272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.288665:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5680 00000100:00100000:0.0:1746147125.288693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.288702:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307446912 00000100:00100000:0.0:1746147125.288704:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307446912 00010000:00010000:0.0:1746147125.288712:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x3139939425052a1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e5e expref: 27 pid: 1853 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.288724:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5681 00000100:00100000:0.0:1746147125.288728:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307446912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.288733:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.288739:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x3139939425052a1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e5e expref: 27 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.288749:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x3139939425052a1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e5e expref: 27 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.288758:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x3139939425052a1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75e5e expref: 27 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.288764:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.288765:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.288767:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a20000/0x3139939425052c86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.288772:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20000/0x3139939425052c86 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.288783:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.288795:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307446912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.288800:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5681 00000100:00100000:0.0:1746147125.288838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.294325:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967307446656:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5700us (6649us total) trans 17179873870 rc 0/0 00000100:00100000:0.0:1746147125.294337:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 937 00002000:00100000:0.0:1746147125.294348:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2433023) req@ffff8801312eb100 x1830967307446656/t17179873870(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:501/0 lens 488/448 e 0 to 0 dl 1746147136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.294356:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb100 with x1830967307446656 ext(2097152->2433023) 00010000:00010000:0.0:1746147125.294364:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0a00/0x3139939425052b9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f37 expref: 17 pid: 10340 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.294375:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0a00/0x3139939425052b9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f37 expref: 17 pid: 10340 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746147125.294381:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eb100 00000100:00100000:0.0:1746147125.294869:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307445376:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6145us (7187us total) trans 17179873871 rc 0/0 00000100:00100000:0.0:1746147125.294876:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 938 00002000:00100000:0.0:1746147125.294881:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1499136->2097151) req@ffff8801312e9c00 x1830967307445376/t17179873871(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:501/0 lens 488/448 e 0 to 0 dl 1746147136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.294887:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9c00 with x1830967307445376 ext(1499136->2097151) 00010000:00010000:0.0:1746147125.294893:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425052b91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f29 expref: 15 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.294901:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425052b91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75f29 expref: 15 pid: 1853 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746147125.294906:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312e9c00 00000100:00100000:0.0:1746147125.296993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.297033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.297129:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147125.297368:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297378:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297392:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297399:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297405:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297410:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984efc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147125.297414:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297421:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297430:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.297435:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x3139939425052c8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.297566:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307444992:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 16931us (17102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.297573:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13083 00000100:00100000:0.0:1746147125.299419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.302528:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.303297:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.303326:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.303355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.303388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.305381:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147125.310321:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935560 is committed 00000004:00080000:0.0:1746147125.310333:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 294 committed 00000004:00080000:0.0:1746147125.310354:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 326 committed 00000004:00080000:0.0:1746147125.310366:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 325 committed 00000004:00080000:0.0:1746147125.310368:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 324 committed 00000004:00080000:0.0:1746147125.310369:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 323 committed 00000004:00080000:0.0:1746147125.310371:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 293 committed 00000004:00080000:0.0:1746147125.310372:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 322 committed 00000004:00080000:0.0:1746147125.310373:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 292 committed 00000004:00080000:0.0:1746147125.310375:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 321 committed 00000004:00080000:0.0:1746147125.310376:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 291 committed 00000004:00080000:0.0:1746147125.310377:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 290 committed 00000004:00080000:0.0:1746147125.310379:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 289 committed 00000004:00080000:0.0:1746147125.310380:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 320 committed 00000004:00080000:0.0:1746147125.310381:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 319 committed 00000004:00080000:0.0:1746147125.310382:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 288 committed 00000004:00080000:0.0:1746147125.310384:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 287 committed 00000004:00080000:0.0:1746147125.310385:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 318 committed 00000001:00080000:0.0:1746147125.310389:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935559 is committed 00000001:00080000:0.0:1746147125.310398:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935555 is committed 00000100:00080000:0.0:1746147125.312261:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147125.312272:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147125.312767:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.312779:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.312785:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.312789:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.312793:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.312798:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.312807:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.312809:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147125.312811:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147125.312815:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425052cb0 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147125.312844:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.312867:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841140 gen 2 00000004:00080000:0.0:1746147125.312871:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94700, transno 21474841079 00000004:00080000:0.0:1746147125.312876:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97800, transno 21474841080 00000004:00080000:0.0:1746147125.312878:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94e00, transno 21474841081 00000004:00080000:0.0:1746147125.312880:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97480, transno 21474841082 00000004:00080000:0.0:1746147125.312882:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97100, transno 21474841083 00000004:00080000:0.0:1746147125.312884:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94000, transno 21474841084 00000004:00080000:0.0:1746147125.312886:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97b80, transno 21474841085 00000004:00080000:0.0:1746147125.312889:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73b80, transno 21474841086 00000004:00080000:0.0:1746147125.312892:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9c00, transno 21474841088 00000004:00080000:0.0:1746147125.312894:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9880, transno 21474841089 00000004:00080000:0.0:1746147125.312896:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8a80, transno 21474841090 00000004:00080000:0.0:1746147125.312898:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8380, transno 21474841091 00000004:00080000:0.0:1746147125.312900:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ead80, transno 21474841092 00000004:00080000:0.0:1746147125.312902:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9f80, transno 21474841093 00000004:00080000:0.0:1746147125.312904:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930eb100, transno 21474841094 00000004:00080000:0.0:1746147125.312906:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ebb80, transno 21474841095 00000004:00080000:0.0:1746147125.312908:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72680, transno 21474841096 00000004:00080000:0.0:1746147125.312910:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72d80, transno 21474841097 00000004:00080000:0.0:1746147125.312912:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70e00, transno 21474841098 00000004:00080000:0.0:1746147125.312914:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70380, transno 21474841099 00000004:00080000:0.0:1746147125.312916:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c71f80, transno 21474841100 00000004:00080000:0.0:1746147125.312918:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73480, transno 21474841101 00000004:00080000:0.0:1746147125.312920:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73800, transno 21474841102 00000004:00080000:0.0:1746147125.312921:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72a00, transno 21474841103 00000004:00080000:0.0:1746147125.312924:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5574e00, transno 21474841125 00000004:00080000:0.0:1746147125.312926:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5577480, transno 21474841126 00000004:00080000:0.0:1746147125.312928:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5574380, transno 21474841127 00000004:00080000:0.0:1746147125.312930:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576d80, transno 21474841128 00000004:00080000:0.0:1746147125.312932:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575180, transno 21474841129 00000004:00080000:0.0:1746147125.312934:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576a00, transno 21474841130 00000004:00080000:0.0:1746147125.312936:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575880, transno 21474841131 00000004:00080000:0.0:1746147125.312938:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576300, transno 21474841132 00000004:00080000:0.0:1746147125.312939:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062680, transno 21474841133 00000004:00080000:0.0:1746147125.312941:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062300, transno 21474841134 00000004:00080000:0.0:1746147125.312943:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063b80, transno 21474841135 00000004:00080000:0.0:1746147125.312945:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76a00, transno 21474841136 00000004:00080000:0.0:1746147125.312947:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095060e00, transno 21474841137 00000004:00080000:0.0:1746147125.312949:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77100, transno 21474841138 00000004:00080000:0.0:1746147125.312952:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76680, transno 21474841139 00000004:00080000:0.0:1746147125.312955:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75180, transno 21474841140 00000100:00100000:0.0:1746147125.312959:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012ca0fb80 x1830967310460800/t21474841154(21474841154) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147141 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147125.312966:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0fb80/2, rc 0, transno 21474841154 00000100:00100000:0.0:1746147125.312970:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310460800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.312979:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5880/2, rc 0, transno 21474841151 00000100:00100000:0.0:1746147125.312981:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310461312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.312988:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0c700/2, rc 0, transno 21474841152 00000100:00100000:0.0:1746147125.312990:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310460672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.312995:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0f100/2, rc 0, transno 21474841156 00000100:00100000:0.0:1746147125.312997:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310461184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.313010:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0ca80/2, rc 0, transno 21474841153 00000100:00100000:0.0:1746147125.313013:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310460416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.313018:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0dc00/2, rc 0, transno 21474841155 00000100:00100000:0.0:1746147125.313020:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310460928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.313025:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0ce00/2, rc 0, transno 21474841150 00000100:00100000:0.0:1746147125.313027:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310460544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.313031:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0d180/2, rc 0, transno 21474841149 00000100:00100000:0.0:1746147125.313033:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310461056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.314496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.316573:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.319175:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.319208:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.319234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.319256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.319283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.319349:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147125.321659:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147125.323225:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.323259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.323296:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.323326:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.323340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.323381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.323554:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13114 00000100:00100000:0.0:1746147125.323561:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307449728:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147125.323870:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307449728:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 309us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.323875:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13114 00000100:00100000:0.0:1746147125.327600:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13119 00000100:00100000:0.0:1746147125.327608:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307451008:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147125.327737:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307451008:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.327743:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13119 00000100:00100000:0.0:1746147125.330213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.332314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.340286:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.340328:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.340350:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.340395:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.340428:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307451520 00000100:00100000:0.0:1746147125.340437:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307451520 00000100:00100000:0.0:1746147125.340491:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307451776 00000100:00100000:0.0:1746147125.340493:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307451776 00000100:00100000:0.0:1746147125.340508:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307452032 00000100:00100000:0.0:1746147125.340510:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307452032 00000100:00100000:0.0:1746147125.340522:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307452288 00000100:00100000:0.0:1746147125.340523:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307452288 00000100:00100000:0.0:1746147125.340539:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2888 00000100:00100000:0.0:1746147125.340547:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307451520:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147125.340582:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.340597:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.340598:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.340604:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.340617:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.341445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.348413:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147125.348903:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.348911:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.348921:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.348928:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147125.348931:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.348938:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.348952:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.348958:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425052cf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.349217:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307451520:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 8670us (8955us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746147125.349225:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2888 00000100:00100000:0.0:1746147125.381699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.384861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.384900:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.384926:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.384942:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.385124:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.385157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.385194:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307453824 00000100:00100000:0.0:1746147125.385198:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307453824 00000100:00100000:0.0:1746147125.388699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.391505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147125.396615:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.396631:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.396637:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.396642:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098447400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.396646:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.396651:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.396668:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.396670:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147125.396673:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147125.396677:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447400/0x3139939425052d2e lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147125.396713:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310461824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.396761:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396786:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310462336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.396797:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396810:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310462848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.396821:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396832:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310463360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.396842:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396860:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.396873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396879:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.396889:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396894:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.396904:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396909:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.396918:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.396925:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746147125.396929:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.396950:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.397142:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.397164:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.397172:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.397183:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.397192:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.397208:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147125.397225:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147125.397231:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147125.397235:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147125.397239:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0d600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.397241:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147125.397245:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147125.397251:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.397253:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147125.397254:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147125.397258:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x3139939425052d35 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000004:00080000:0.0:1746147125.397307:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c72680/2, rc 0, transno 21474841164 00000100:00100000:0.0:1746147125.397312:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310461824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.397322:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c71f80/2, rc 0, transno 21474841163 00000100:00100000:0.0:1746147125.397325:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310462336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.397336:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098820700/2, rc 0, transno 17179873887 00000100:00100000:0.0:1746147125.397343:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310462848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.397352:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098822a00/2, rc 0, transno 17179873888 00000100:00100000:0.0:1746147125.397355:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310463360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.397381:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70380/2, rc 0, transno 21474841165 00000100:00100000:0.0:1746147125.397383:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.397430:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310463872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.397447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147125.397468:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c72a00/2, rc 0, transno 21474841166 00000100:00100000:0.0:1746147125.397471:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.397478:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098823480/2, rc 0, transno 17179873889 00000100:00100000:0.0:1746147125.397481:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.397488:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009885a680/2, rc 0, transno 17179873890 00000100:00100000:0.0:1746147125.397491:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.397498:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70e00/2, rc 0, transno 21474841167 00000100:00100000:0.0:1746147125.397500:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.397506:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c73800/2, rc 0, transno 21474841168 00000100:00100000:0.0:1746147125.397509:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310462592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.397552:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098821c00/2, rc 0, transno 17179873891 00000100:00100000:0.0:1746147125.397555:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.397564:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e321500/2, rc 0, transno 17179873892 00000100:00100000:0.0:1746147125.397567:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310463616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.397579:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094537b80/2, rc 0, transno 17179873893 00000100:00100000:0.0:1746147125.397581:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310463872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.398564:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c73480/2, rc 0, transno 21474841162 00000100:00100000:0.0:1746147125.398571:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310462464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.399040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.401831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.423414:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.423475:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.430957:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14961 00000100:00100000:0.0:1746147125.430971:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:31688:x1830967307456384:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147125.430991:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.431005:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425052d90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7602c expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.431079:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425052d9e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.431118:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425052d9e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.431756:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425052d9e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147125.433694:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307456640 00000100:00100000:0.0:1746147125.433697:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307456640 00010000:00010000:0.0:1746147125.433707:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094008800/0x3139939425052d74 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76010 expref: 11 pid: 16099 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.433720:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5693 00000100:00100000:0.0:1746147125.433724:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307456640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.433733:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.433737:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094008800/0x3139939425052d74 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76010 expref: 11 pid: 16099 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.433745:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094008800/0x3139939425052d74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76010 expref: 11 pid: 16099 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.433956:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094008800/0x3139939425052d74 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76010 expref: 11 pid: 16099 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.433977:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.433980:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094009000/0x3139939425052d97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147125.433986:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094009000/0x3139939425052d97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147125.433991:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094009000/0x3139939425052d97 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147125.433997:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425052d9e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.434001:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425052d9e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.434005:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425052d9e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.434031:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.434049:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307456640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 324us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.434054:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5693 00000100:00100000:0.0:1746147125.434851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.441463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.441554:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.450680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.450710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.450731:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307458048 00000100:00100000:0.0:1746147125.450738:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307458048 00010000:00010000:0.0:1746147125.450768:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x3139939425052d3c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76002 expref: 8 pid: 7237 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.450810:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5694 00000100:00100000:0.0:1746147125.450818:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307458048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.450832:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.450837:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x3139939425052d3c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76002 expref: 8 pid: 7237 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.450847:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x3139939425052d3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76002 expref: 8 pid: 7237 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.450866:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.450870:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425052dd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.450877:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425052dd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.450882:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.450926:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307458048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.450932:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5694 00000100:00100000:0.0:1746147125.451025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.451132:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307457664:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 6901us (7006us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147125.451139:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2897 00002000:00100000:0.0:1746147125.451148:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880091d97100 x1830967307457664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:501/0 lens 488/440 e 0 to 0 dl 1746147136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.451156:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97100 with x1830967307457664 ext(0->1048575) 00002000:00010000:0.0:1746147125.451160:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d97100 00000100:00100000:0.0:1746147125.453438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147125.458014:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935568 is committed 00000004:00080000:0.0:1746147125.458021:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 310 committed 00000004:00080000:0.0:1746147125.458041:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 344 committed 00000004:00080000:0.0:1746147125.458056:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 343 committed 00000004:00080000:0.0:1746147125.458058:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 342 committed 00000004:00080000:0.0:1746147125.458060:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 341 committed 00000004:00080000:0.0:1746147125.458061:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 309 committed 00000004:00080000:0.0:1746147125.458063:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 340 committed 00000004:00080000:0.0:1746147125.458065:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 308 committed 00000004:00080000:0.0:1746147125.458066:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 339 committed 00000004:00080000:0.0:1746147125.458068:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 307 committed 00000004:00080000:0.0:1746147125.458069:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 306 committed 00000004:00080000:0.0:1746147125.458071:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 305 committed 00000004:00080000:0.0:1746147125.458072:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 338 committed 00000004:00080000:0.0:1746147125.458074:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 337 committed 00000004:00080000:0.0:1746147125.458075:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 304 committed 00000004:00080000:0.0:1746147125.458077:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 303 committed 00000004:00080000:0.0:1746147125.458078:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 336 committed 00000001:00080000:0.0:1746147125.458086:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935566 is committed 00000001:00080000:0.0:1746147125.458118:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935563 is committed 00000100:00100000:0.0:1746147125.459700:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310464512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.459722:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.459747:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310464896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.459761:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.459778:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310465408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.459791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.459800:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310465920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.459810:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.459817:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310466432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.459830:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310464768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.459841:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.459849:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.459857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.460453:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.460470:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.460481:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310466304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.460495:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.460509:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746147125.460514:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147125.460527:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.460534:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.460546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.460552:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310466176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.460752:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.460775:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466176 00000100:00100000:0.0:1746147125.460778:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466176 00000100:00100000:0.0:1746147125.461456:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147125.461482:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312eb480/2, rc 0, transno 17179873895 00000100:00100000:0.0:1746147125.461485:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310464896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.461492:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e486300/2, rc 0, transno 21474841171 00000100:00100000:0.0:1746147125.461494:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310465408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.461499:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5500/2, rc 0, transno 17179873896 00000100:00100000:0.0:1746147125.461501:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310465920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.461504:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147125.461508:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310466688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.461523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147125.461541:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485500/2, rc 0, transno 21474841176 00000100:00100000:0.0:1746147125.461544:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.461549:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0ed80/2, rc 0, transno 17179873899 00000100:00100000:0.0:1746147125.461551:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.461556:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6300/2, rc 0, transno 17179873900 00000100:00100000:0.0:1746147125.461558:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310466176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.461563:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8e00/2, rc 0, transno 17179873897 00000100:00100000:0.0:1746147125.461565:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310464768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.461570:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485c00/2, rc 0, transno 21474841174 00000100:00100000:0.0:1746147125.461572:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.461577:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487480/2, rc 0, transno 21474841175 00000100:00100000:0.0:1746147125.461579:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310465792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147125.461584:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6680/2, rc 0, transno 17179873898 00000100:00100000:0.0:1746147125.461587:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310466304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.461597:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4380/2, rc 0, transno 17179873901 00000100:00100000:0.0:1746147125.461600:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310466432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.462043:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150a80/2, rc 0, transno 17179873902 00000100:00100000:0.0:1746147125.462047:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310466688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.465585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.477152:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.477201:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.477239:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.477252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.477272:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147125.477276:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.477286:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.477294:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.477304:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.477319:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467584 00000100:00100000:0.0:1746147125.477322:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467584 00000100:00100000:0.0:1746147125.477339:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467200 00000100:00100000:0.0:1746147125.477340:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467200 00000100:00100000:0.0:1746147125.477349:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467712 00000100:00100000:0.0:1746147125.477350:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467712 00000100:00100000:0.0:1746147125.477358:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13170 00000100:00100000:0.0:1746147125.477363:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310467584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147125.477426:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147125.477429:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147125.477430:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147125.477432:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147125.477434:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147125.477455:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967310467584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (201us total) trans 17179873903 rc 0/0 00000100:00100000:0.0:1746147125.477460:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13170 00000100:00100000:0.0:1746147125.477470:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13171 00000100:00100000:0.0:1746147125.477474:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310467200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.478767:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967310467200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1292us (1479us total) trans 17179873906 rc 0/0 00000100:00100000:0.0:1746147125.478773:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13171 00000004:00080000:0.0:1746147125.478792:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155f80/2, rc 0, transno 17179873906 00000100:00100000:0.0:1746147125.478794:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.478801:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156300/2, rc 0, transno 17179873903 00000100:00100000:0.0:1746147125.478803:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.479395:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099888380/2, rc 0, transno 17179873907 00000100:00100000:0.0:1746147125.479399:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147125.479405:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099157480/2, rc 0, transno 17179873908 00000100:00100000:0.0:1746147125.479408:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310467072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147125.481936:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.481984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.483385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.487431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.488427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.489189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.489221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.493081:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.493125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.493142:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307460096 00000100:00100000:0.0:1746147125.493149:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307460096 00010000:00010000:0.0:1746147125.493177:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425052cef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fe6 expref: 14 pid: 1854 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746147125.493628:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5696 00000100:00100000:0.0:1746147125.493636:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307460096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.493648:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.493662:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425052cef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fe6 expref: 14 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.493671:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425052cef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fe6 expref: 14 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.493688:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425052cef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75fe6 expref: 14 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746147125.493864:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.493866:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147125.493873:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425052e0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76072 expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.493880:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425052e0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76072 expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.493904:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425052e0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76072 expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147125.493915:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310469504:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147125.493954:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.495610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.500607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.501480:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310469632:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147125.501495:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.501527:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307460224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5810us (5923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.501534:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5697 00000100:00100000:0.0:1746147125.506302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.506343:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.506379:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.506849:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2904 00000100:00100000:0.0:1746147125.506853:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307461504:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147125.508235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.512302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.515615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.518485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.521851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.522636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.530623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.537696:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.539278:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.539305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.543780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.545603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.550426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.561407:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307463936 00000100:00100000:0.0:1746147125.561416:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307463936 00000100:00100000:0.0:1746147125.561518:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13194 00000100:00100000:0.0:1746147125.561526:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:31689:x1830967307463936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147125.561540:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.561556:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e760aa expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.561579:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425052e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2121728->2236415) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76079 expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.561585:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147125.561587:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147125.561590:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.561614:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425052e15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2121728->2236415) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76079 expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.561624:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425052e15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2121728->2236415) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76079 expref: 25 pid: 12201 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.561633:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310470144:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147125.561993:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147125.564895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.565646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.568693:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307464064:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 3512us (3797us total) trans 21474841186 rc 0/0 00000100:00100000:0.0:1746147125.568705:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 940 00002000:00100000:0.0:1746147125.568713:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2121728->2236415) req@ffff8800a897e680 x1830967307464064/t21474841186(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:501/0 lens 488/448 e 0 to 0 dl 1746147136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.568721:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897e680 with x1830967307464064 ext(2121728->2236415) 00010000:00010000:0.0:1746147125.568728:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425052e15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2121728->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76079 expref: 28 pid: 12201 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.568741:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425052e15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2121728->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76079 expref: 28 pid: 12201 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746147125.568747:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a897e680 00000100:00100000:0.0:1746147125.570149:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.570188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.580287:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.580355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.583692:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147125.589248:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147125.599471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.599515:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.612652:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.628841:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.631405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.635320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.639730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.643508:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.647189:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.647327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.647346:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307467520 00000100:00100000:0.0:1746147125.647349:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307467520 00010000:00010000:0.0:1746147125.647361:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425052e23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76087 expref: 18 pid: 12201 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746147125.647377:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5701 00000100:00100000:0.0:1746147125.647381:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307467520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147125.647387:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147125.647397:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425052e23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76087 expref: 18 pid: 12201 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.647416:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425052e23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76087 expref: 18 pid: 12201 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.647629:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425052e23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76087 expref: 17 pid: 12201 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.647706:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147125.649228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.651869:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.736764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.744595:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.744703:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307468800 00000100:00100000:0.0:1746147125.744713:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307468800 00000100:00100000:0.0:1746147125.744774:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5275 00000100:00100000:0.0:1746147125.744783:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:31700:x1830967307468800:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147125.745001:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:31700:x1830967307468800:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 219us (416us total) trans 8589935575 rc 0/0 00000100:00100000:0.0:1746147125.745007:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5275 00000100:00100000:0.0:1746147125.764522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.764567:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.767747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.768208:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.768232:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.783714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.783893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.783923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.784227:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.785025:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307470720 00000100:00100000:0.0:1746147125.785028:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307470720 00002000:00100000:0.0:1746147125.785046:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880093145500 x1830967307470720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:501/0 lens 504/0 e 0 to 0 dl 1746147136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.785052:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145500 with x1830967307470720 ext(1048576->2097151) 00002000:00010000:0.0:1746147125.785056:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145500 00000100:00100000:0.0:1746147125.785069:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2922 00000100:00100000:0.0:1746147125.785074:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307470720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147125.812727:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.817680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.821466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.821492:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.821529:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.821558:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.821587:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307471360 00000100:00100000:0.0:1746147125.821590:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307471360 00002000:00100000:0.0:1746147125.821620:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1806336->2031615) req@ffff880097d76680 x1830967307471360/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:501/0 lens 488/0 e 0 to 0 dl 1746147136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.821629:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76680 with x1830967307471360 ext(1806336->2031615) 00010000:00010000:0.0:1746147125.821637:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371de00/0x3139939425052e7e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760c6 expref: 17 pid: 9584 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.821647:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371de00/0x3139939425052e7e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760c6 expref: 17 pid: 9584 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746147125.821653:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d76680 00000100:00100000:0.0:1746147125.821665:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 941 00000100:00100000:0.0:1746147125.821671:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307471360:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147125.826107:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.829771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.833788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.833889:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.844635:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.874786:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.875455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.877464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.882668:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307473536 00000100:00100000:0.0:1746147125.882676:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307473536 00002000:00100000:0.0:1746147125.882708:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2367488->2961407) req@ffff8800a5575880 x1830967307473536/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:501/0 lens 488/0 e 0 to 0 dl 1746147136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.882723:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575880 with x1830967307473536 ext(2367488->2961407) 00010000:00010000:0.0:1746147125.882730:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425052ef5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760e9 expref: 31 pid: 9584 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.882742:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425052ef5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760e9 expref: 31 pid: 9584 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746147125.882748:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5575880 00000100:00100000:0.0:1746147125.882768:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 943 00000100:00100000:0.0:1746147125.882774:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307473536:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147125.891782:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307473536:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9000us (9540us total) trans 17179873913 rc 0/0 00000100:00100000:0.0:1746147125.891793:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 943 00002000:00100000:0.0:1746147125.891801:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2367488->2961407) req@ffff8800a5575880 x1830967307473536/t17179873913(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:501/0 lens 488/448 e 0 to 0 dl 1746147136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147125.891809:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575880 with x1830967307473536 ext(2367488->2961407) 00010000:00010000:0.0:1746147125.891817:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425052ef5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760e9 expref: 31 pid: 9584 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746147125.891832:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425052ef5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2367488->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760e9 expref: 31 pid: 9584 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746147125.891838:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5575880 00000100:00100000:0.0:1746147125.892217:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.892452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.897830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.897956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.914199:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472320 00000100:00100000:0.0:1746147125.914203:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472320 00000100:00100000:0.0:1746147125.914226:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1746147125.914231:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310472320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147125.914276:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310472320:12345-0@lo:400:kworker.0 Request processed in 44us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.914281:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00080000:0.0:1746147125.914294:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746147125.914297:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147125.914305:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472576 00000100:00100000:0.0:1746147125.914317:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472576 00000100:00100000:0.0:1746147125.914346:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1746147125.914350:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310472576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147125.914374:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310472576:12345-0@lo:400:kworker.0 Request processed in 23us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.914378:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00080000:0.0:1746147125.914387:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147125.915180:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472704 00000100:00100000:0.0:1746147125.915184:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472704 00000100:00100000:0.0:1746147125.915208:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1746147125.915213:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967310472704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147125.915246:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967310472704:12345-0@lo:400:kworker.0 Request processed in 33us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.915261:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1746147125.915273:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473216 00000100:00100000:0.0:1746147125.915276:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473216 00000100:00100000:0.0:1746147125.915290:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1746147125.915294:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310473216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147125.915316:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310473216:12345-0@lo:400:kworker.0 Request processed in 22us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.915321:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1746147125.915346:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472192 00000100:00100000:0.0:1746147125.915348:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472192 00000100:00100000:0.0:1746147125.915364:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1746147125.915368:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967310472192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147125.915390:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967310472192:12345-0@lo:400:kworker.0 Request processed in 21us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147125.915395:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1746147125.927792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.927844:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.929807:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147125.929818:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310473472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746147125.930973:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147125.931123:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310473472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746147125.968525:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.979984:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.980040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.980078:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307475456 00000100:00100000:0.0:1746147125.980086:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307475456 00000100:00100000:0.0:1746147125.980157:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14974 00000100:00100000:0.0:1746147125.980164:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:31712:x1830967307475456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147125.980187:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147125.980203:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x3139939425052f3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76113 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.980272:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980282:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980291:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980300:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980305:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980309:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980383:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425052f50 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980392:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425052f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.980397:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425052f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147125.980404:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147125.981505:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981618:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981625:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981631:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981636:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.981639:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981645:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981655:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147125.981657:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147125.981661:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981665:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425052f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981688:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981693:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981696:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981700:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147125.981702:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981706:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981711:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800958e2d00) 00010000:00010000:0.0:1746147125.981713:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147125.981715:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981719:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x3139939425052f49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147125.981751:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x3139939425052f3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76113 expref: 36 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.981767:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425052f50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76113 expref: 35 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147125.981772:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147125.981775:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147125.981777:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6a00, rc 0) 00000100:00100000:0.0:1746147125.982437:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:31712:x1830967307475456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2272us (2394us total) trans 8589935580 rc 0/0 00000100:00100000:0.0:1746147125.982443:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14974 00000100:00100000:0.0:1746147125.990489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.991216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147125.993693:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473728 00000100:00100000:0.0:1746147125.993698:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473728 00000100:00100000:0.0:1746147125.993734:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473856 00000100:00100000:0.0:1746147125.993737:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473856 00000100:00100000:0.0:1746147126.005976:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.026055:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147126.030562:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147126.036695:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.037819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147126.038400:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147126.042480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.047247:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.063707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.067418:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.067574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.071699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.082357:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147126.083278:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147126.088712:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.088955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147126.089224:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147126.134418:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.139397:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.141184:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.141265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.153675:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.170490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.175832:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.183485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.192788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.193854:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.197990:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.204468:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.220932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147126.223287:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147126.232800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.232861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.232936:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307481344 00000100:00100000:0.0:1746147126.232944:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307481344 00000100:00100000:0.0:1746147126.233012:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14978 00000100:00100000:0.0:1746147126.233020:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:31725:x1830967307481344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147126.233044:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.233063:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0200/0x3139939425052fea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76160 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.233159:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425052ff1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233172:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425052ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233182:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425052ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233198:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0000/0x3139939425052ff8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233204:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0000/0x3139939425052ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233209:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0000/0x3139939425052ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233315:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1e00/0x3139939425052fff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233326:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1e00/0x3139939425052fff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.233332:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1e00/0x3139939425052fff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147126.233341:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:0.0:1746147126.234691:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.235312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.243163:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.248296:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.248320:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.248334:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.248367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.248407:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307482496 00000100:00100000:0.0:1746147126.248415:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307482496 00000100:00100000:0.0:1746147126.248464:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 747 00000100:00100000:0.0:1746147126.248471:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307482496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.248486:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.248511:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1e00/0x3139939425052fff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76160 expref: 20 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.248532:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147126.248537:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.248583:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967307482496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 111us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.248589:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 747 00000100:00100000:0.0:1746147126.248667:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307482112 00000100:00100000:0.0:1746147126.248670:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307482112 00000100:00100000:0.0:1746147126.248687:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307482240 00000100:00100000:0.0:1746147126.248688:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307482240 00000100:00100000:0.0:1746147126.248697:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307482368 00000100:00100000:0.0:1746147126.248698:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307482368 00000100:00100000:0.0:1746147126.248711:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13211 00000100:00100000:0.0:1746147126.248716:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307482112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147126.248733:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.248748:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1c00/0x3139939425053014 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76167 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.248794:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310476160:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147126.248850:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.248870:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13212 00000100:00100000:0.0:1746147126.248875:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307482240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147126.248881:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.248888:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505301b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7616e expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.248899:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.248901:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.248908:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505301b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7616e expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.248921:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505301b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7616e expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.248931:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1800, rc 0) 00000100:00100000:0.0:1746147126.248947:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307482240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 72us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.248952:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13212 00000100:00100000:0.0:1746147126.248962:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13213 00000100:00100000:0.0:1746147126.248967:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307482368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147126.248973:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.248982:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425053022 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76175 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.249003:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310476288:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147126.249021:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.252848:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.260452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.260507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.260532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.260556:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307482880 00000100:00100000:0.0:1746147126.260564:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307482880 00000100:00100000:0.0:1746147126.260613:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307482752 00000100:00100000:0.0:1746147126.260615:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307482752 00000100:00100000:0.0:1746147126.260628:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307483008 00000100:00100000:0.0:1746147126.260630:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307483008 00000100:00100000:0.0:1746147126.260644:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13215 00000100:00100000:0.0:1746147126.260652:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307482880:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.260672:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.260692:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x3139939425053030 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7618a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.260745:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310476544:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147126.260826:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.260844:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13216 00000100:00100000:0.0:1746147126.260850:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307482752:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.260858:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.260870:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x3139939425053037 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76183 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.260884:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.260885:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.260894:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x3139939425053037 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76183 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.260909:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x3139939425053037 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76183 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.260919:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:0.0:1746147126.260940:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307482752:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.260946:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13216 00000100:00100000:0.0:1746147126.260960:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13217 00000100:00100000:0.0:1746147126.260965:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307483008:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.260970:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.260976:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0200/0x313993942505303e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76191 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.260985:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.260987:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.260991:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0200/0x313993942505303e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76191 expref: 16 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.261000:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0200/0x313993942505303e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76191 expref: 16 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.261007:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0200, rc 0) 00000100:00100000:0.0:1746147126.261020:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307483008:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 54us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.261025:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13217 00000100:00100000:0.0:1746147126.261074:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.261113:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307483136 00000100:00100000:0.0:1746147126.261116:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307483136 00000100:00100000:0.0:1746147126.261131:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13218 00000100:00100000:0.0:1746147126.261136:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307483136:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.261142:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.261150:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76198 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.261160:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.261162:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.261167:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.261176:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.261188:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31c00, rc 0) 00000100:00100000:0.0:1746147126.261202:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307483136:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.261207:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13218 00000100:00080000:0.0:1746147126.261345:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147126.263075:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.268958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.287746:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.287784:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.299926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.308964:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.314046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.314142:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.327459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.327503:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.345399:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.345435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.347148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.352070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.358151:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.362188:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.362282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.367310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.369032:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.372642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.392350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.395323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.397544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.402164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.410513:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.577327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.581456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.587077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.589641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.600021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.602124:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.607362:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.607414:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.611859:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.611904:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.630070:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.658942:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.658995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.683895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.692198:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.698029:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.702370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.706486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.768211:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.771685:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.771735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.771762:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307494528 00000100:00100000:0.0:1746147126.771767:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307494528 00010000:00010000:0.0:1746147126.771794:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x3139939425053037 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76183 expref: 13 pid: 10340 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746147126.771829:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307494656 00000100:00100000:0.0:1746147126.771831:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307494656 00010000:00010000:0.0:1746147126.771841:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425052fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76144 expref: 33 pid: 12201 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.773143:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.777230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.788760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.792322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.792373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.796320:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307495552 00000100:00100000:0.0:1746147126.796327:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307495552 00010000:00010000:0.0:1746147126.796357:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091e31800/0x3139939425053006 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76159 expref: 31 pid: 12201 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.796392:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5736 00000100:00100000:0.0:1746147126.796398:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307495552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.796410:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.796426:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091e31800/0x3139939425053006 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76159 expref: 31 pid: 12201 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.796438:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091e31800/0x3139939425053006 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76159 expref: 31 pid: 12201 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.796456:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e31800/0x3139939425053006 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76159 expref: 31 pid: 12201 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.796483:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.796485:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.796491:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.796498:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.796527:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.796538:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310480128:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147126.796601:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.800651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.835057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.838553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.844853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.844895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.844922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.844948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.844983:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307496448 00000100:00100000:0.0:1746147126.844991:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307496448 00000100:00100000:0.0:1746147126.845039:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307496576 00000100:00100000:0.0:1746147126.845041:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307496576 00000100:00100000:0.0:1746147126.845053:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307496704 00000100:00100000:0.0:1746147126.845055:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307496704 00000100:00100000:0.0:1746147126.845063:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307496832 00000100:00100000:0.0:1746147126.845066:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307496832 00000100:00100000:0.0:1746147126.845079:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13235 00000100:00100000:0.0:1746147126.845086:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307496448:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.845126:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.845149:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7800/0x31399394250531aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7624e expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.845207:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310480384:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147126.845299:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.845319:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13236 00000100:00100000:0.0:1746147126.845324:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307496576:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.845333:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.845343:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76255 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.845962:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.845963:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.845973:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76255 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.845988:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76255 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.845998:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6600, rc 0) 00000100:00100000:0.0:1746147126.846034:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307496576:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 709us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.846044:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13236 00000100:00100000:0.0:1746147126.850927:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307497088 00000100:00100000:0.0:1746147126.850936:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307497088 00000100:00100000:0.0:1746147126.850992:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14988 00000100:00100000:0.0:1746147126.850999:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:31750:x1830967307497088:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.851017:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.851037:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250531c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7626a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.851278:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250531cd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147126.851293:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966200/0x31399394250531a3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76247 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.851301:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250531cd lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147126.851332:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966200/0x31399394250531a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76247 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.851343:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966200/0x31399394250531a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76247 expref: 10 pid: 16099 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.851354:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e12300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310480768:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147126.851738:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.853374:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.861005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.864078:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.864148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.864328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.867046:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310481152:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147126.867060:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cc4200/0x31399394250531f0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76286 expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.867068:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cc4200/0x31399394250531f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76286 expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.867112:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cc4200, rc 0) 00000100:00100000:0.0:1746147126.867132:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307497856:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2296us (2983us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147126.867137:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13240 00000100:00100000:0.0:1746147126.875844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.883231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.883259:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.883625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.883729:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.884534:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307498752 00000100:00100000:0.0:1746147126.884538:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307498752 00000100:00100000:0.0:1746147126.884561:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307498880 00000100:00100000:0.0:1746147126.884563:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307498880 00000100:00100000:0.0:1746147126.884679:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13247 00000100:00100000:0.0:1746147126.884684:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307498880:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147126.884698:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.884708:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.884716:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.884723:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425052e54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760b8 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.884728:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.884729:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.884731:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.884743:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425052e54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760b8 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.884750:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425052e54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760b8 expref: 31 pid: 12201 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.884757:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310482560:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147126.884780:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.884787:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746147126.884793:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310482688:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147126.884813:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.884819:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.884826:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310482816:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147126.884839:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147126.888745:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310482560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147126.888778:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310482688:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147126.888800:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310482816:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147126.888819:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.888875:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310481920:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147126.888887:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009822aa00/0x3139939425053221 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.888908:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310481536:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147126.888914:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310481664:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147126.888920:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310481792:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147126.888934:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x313993942505321a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.889958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.889987:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.890012:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894504:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894554:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894566:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894590:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.894658:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307500032 00000100:00100000:0.0:1746147126.894666:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307500032 00010000:00010000:0.0:1746147126.894700:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425052f0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760fe expref: 19 pid: 9584 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.894783:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307500160 00000100:00100000:0.0:1746147126.894785:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307500160 00010000:00010000:0.0:1746147126.894797:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76255 expref: 16 pid: 12201 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746147126.894805:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307499904 00000100:00100000:0.0:1746147126.894807:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307499904 00010000:00010000:0.0:1746147126.894815:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 17 pid: 1854 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746147126.894822:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307499136 00000100:00100000:0.0:1746147126.894825:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307499136 00010000:00010000:0.0:1746147126.894832:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425053110 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7620f expref: 32 pid: 9585 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.894839:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307499776 00000100:00100000:0.0:1746147126.894841:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307499776 00010000:00010000:0.0:1746147126.894848:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425052f34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7610c expref: 32 pid: 9584 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.894856:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307500288 00000100:00100000:0.0:1746147126.894857:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307500288 00010000:00010000:0.0:1746147126.894865:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425052e54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760b8 expref: 34 pid: 12201 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.894876:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5742 00000100:00100000:0.0:1746147126.894882:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307500032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.894894:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.894913:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425052f0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760fe expref: 20 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.894921:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425052f0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760fe expref: 20 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.894940:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425052f0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760fe expref: 20 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.894959:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.894991:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307500032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.894998:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5742 00000100:00100000:0.0:1746147126.895035:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5743 00000100:00100000:0.0:1746147126.895039:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307500160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.895045:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.895052:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76255 expref: 17 pid: 12201 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746147126.895059:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76255 expref: 17 pid: 12201 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746147126.895069:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x31399394250531b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76255 expref: 17 pid: 12201 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746147126.895076:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.895112:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307500160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.895118:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5743 00000100:00100000:0.0:1746147126.895127:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5744 00000100:00100000:0.0:1746147126.895131:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307499904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.895137:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.895144:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746147126.895152:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746147126.895166:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x3139939425053045 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76198 expref: 15 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746147126.895173:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.895184:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307499904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.895188:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5744 00000100:00100000:0.0:1746147126.895196:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5746 00000100:00100000:0.0:1746147126.895200:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307499776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.895206:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.895211:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425052f34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7610c expref: 32 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.895218:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425052f34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7610c expref: 32 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.895226:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425052f34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7610c expref: 32 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.895244:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.895246:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.895248:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505322f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895254:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505322f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895269:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.895279:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307499776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.895284:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5746 00000100:00100000:0.0:1746147126.895315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.895327:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307500416 00000100:00100000:0.0:1746147126.895329:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307500416 00010000:00010000:0.0:1746147126.895339:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.895351:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5748 00000100:00100000:0.0:1746147126.895354:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307500416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.895360:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.895365:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.895372:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.895382:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425052e46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e760aa expref: 14 pid: 9584 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.895388:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.895389:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.895391:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895401:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895411:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.895420:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307500416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.895423:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5748 00010000:00010000:0.0:1746147126.895437:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895443:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895454:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895459:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895463:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895468:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e7c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147126.895470:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895480:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895488:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.895494:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x3139939425053236 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.895518:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307498880:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 10833us (10963us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.895523:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13247 00000100:00100000:0.0:1746147126.904543:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307500544 00000100:00100000:0.0:1746147126.904551:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307500544 00010000:00010000:0.0:1746147126.904583:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 31 pid: 1398 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746147126.904606:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5749 00000100:00100000:0.0:1746147126.904883:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307500544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147126.904957:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147126.904975:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 31 pid: 1398 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.904985:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 31 pid: 1398 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.905011:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbee600/0x3139939425053187 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76240 expref: 31 pid: 1398 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746147126.905024:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.905026:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.905030:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425053228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.905037:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425053228 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.905068:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147126.905119:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307500544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 506us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.905126:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5749 00000100:00100000:0.0:1746147126.905857:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.907740:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.910069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.913345:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.913361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.914241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.914262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.916620:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147126.919942:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935606 is committed 00000004:00080000:0.0:1746147126.919952:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 326 committed 00000004:00080000:0.0:1746147126.919968:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 362 committed 00000004:00080000:0.0:1746147126.919985:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 361 committed 00000004:00080000:0.0:1746147126.919988:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 360 committed 00000004:00080000:0.0:1746147126.919990:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 359 committed 00000004:00080000:0.0:1746147126.919991:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 325 committed 00000004:00080000:0.0:1746147126.919993:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 358 committed 00000004:00080000:0.0:1746147126.919994:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 324 committed 00000004:00080000:0.0:1746147126.919996:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 357 committed 00000004:00080000:0.0:1746147126.919997:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 323 committed 00000004:00080000:0.0:1746147126.919998:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 322 committed 00000004:00080000:0.0:1746147126.920000:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 321 committed 00000004:00080000:0.0:1746147126.920002:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 356 committed 00000004:00080000:0.0:1746147126.920003:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 355 committed 00000004:00080000:0.0:1746147126.920005:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 320 committed 00000004:00080000:0.0:1746147126.920006:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 319 committed 00000004:00080000:0.0:1746147126.920008:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 354 committed 00000001:00080000:0.0:1746147126.920015:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935603 is committed 00000001:00080000:0.0:1746147126.920018:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935602 is committed 00000100:00100000:0.0:1746147126.922600:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13258 00000100:00100000:0.0:1746147126.922609:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3764:x1830967310485120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147126.922682:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967310485120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (2210us total) trans 21474841196 rc 0/0 00000100:00100000:0.0:1746147126.925116:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13258 00000100:00100000:0.0:1746147126.925131:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484736 00000100:00100000:0.0:1746147126.925134:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484736 00000100:00100000:0.0:1746147126.925150:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310485248 00000100:00100000:0.0:1746147126.925152:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310485248 00000100:00100000:0.0:1746147126.925163:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13263 00000100:00100000:0.0:1746147126.925167:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3766:x1830967310484736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147126.925251:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310484736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (140us total) trans 21474841199 rc 0/0 00000100:00100000:0.0:1746147126.925659:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13263 00010000:00010000:0.0:1746147126.925687:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.925695:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.925701:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.925707:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147126.925711:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.925718:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.925732:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147126.925735:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147126.925738:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147126.925742:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505323d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000004:00080000:0.0:1746147126.926996:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094536300/2, rc 0, transno 17179873917 00000100:00100000:0.0:1746147126.927000:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310483968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147126.928544:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.936415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.936451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.936477:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.936500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.936513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.936525:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307502720 00000100:00100000:0.0:1746147126.936527:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307502720 00000100:00100000:0.0:1746147126.936605:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13265 00000100:00100000:0.0:1746147126.936612:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307502208:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.936628:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.936645:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425053259 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e762a9 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147126.936662:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141736, atime: 0x68141736, ctime: 0x68141736, blocks: 0x808 00010000:00010000:0.0:1746147126.936676:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.936678:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.936684:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425053259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762a9 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.936696:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400ae00/0x3139939425053259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762a9 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.936704:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ae00, rc 0) 00000100:00100000:0.0:1746147126.936742:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307502208:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 130us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.936748:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13265 00000100:00100000:0.0:1746147126.936764:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13267 00000100:00100000:0.0:1746147126.936768:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307502720:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147126.936774:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147126.936781:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeec00/0x3139939425053267 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e762c5 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147126.936790:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141735, atime: 0x68141735, ctime: 0x68141735, blocks: 0x1008 00010000:00010000:0.0:1746147126.936797:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.936798:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.936802:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeec00/0x3139939425053267 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762c5 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.936811:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeec00/0x3139939425053267 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762c5 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147126.936817:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeec00, rc 0) 00000100:00100000:0.0:1746147126.936837:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307502720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 68us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147126.936842:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13267 00000100:00100000:0.0:1746147126.936886:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.941328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.941370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.941400:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.941442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.941927:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.942025:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.944313:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.944347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.944370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.944388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.944404:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.944424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.950085:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.957722:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.965390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.968185:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.968535:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2952 00000100:00100000:0.0:1746147126.968542:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307505280:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147126.968565:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505328a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.968580:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.968581:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.968585:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505328a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.968597:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505328a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.971876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.971960:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147126.972075:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2955 00000100:00100000:0.0:1746147126.972109:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2000:x1830967307506048:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147126.972152:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x31399394250532a6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.972163:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.972165:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147126.972169:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x31399394250532a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147126.972185:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x31399394250532a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147126.979123:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.008405:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.015306:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.015347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.015372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.015395:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307506816 00000100:00100000:0.0:1746147127.015404:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307506816 00000100:00100000:0.0:1746147127.015460:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307506688 00000100:00100000:0.0:1746147127.015463:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307506688 00000100:00100000:0.0:1746147127.015482:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13285 00000100:00100000:0.0:1746147127.015490:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307506816:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147127.016488:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147127.016492:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.016494:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.016496:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.016497:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147127.016531:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307506816:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 1041us (1233us total) trans 21474841202 rc 0/0 00000100:00100000:0.0:1746147127.016538:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13285 00000100:00100000:0.0:1746147127.016766:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.016913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.021388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.025761:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147127.028846:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.028855:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.028861:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.028866:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03dc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147127.028869:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.028875:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.028887:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.028890:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147127.028893:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.028897:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x31399394250532b4 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147127.029390:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147127.029402:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310486016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.029452:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029569:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310485888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.029583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029597:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310486528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.029610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029619:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310487040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.029632:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029642:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310487424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.029657:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310486144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.029671:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029678:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310486656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.029687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029693:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310487168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.029702:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.029708:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310487680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.029774:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147127.029789:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147127.029792:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147127.029800:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147127.029805:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147127.029810:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147127.029814:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03d000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147127.029816:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147127.029821:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147127.029828:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.029831:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147127.029833:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147127.029838:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x31399394250532bb lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000100:00100000:0.0:1746147127.029850:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147127.029871:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cce00/2, rc 0, transno 17179873930 00000100:00100000:0.0:1746147127.029878:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310486016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.029894:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13294 00000100:00100000:0.0:1746147127.029899:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3765:x1830967310486784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147127.029940:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147127.029942:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.029944:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.029946:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.029948:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147127.029966:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3765:x1830967310486784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (368us total) trans 21474841205 rc 0/0 00000100:00100000:0.0:1746147127.029971:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13294 00000100:00100000:0.0:1746147127.029980:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13297 00000100:00100000:0.0:1746147127.029984:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3765:x1830967310487808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147127.030022:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147127.030024:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.030026:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147127.030028:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.030029:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147127.030048:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967310487808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (397us total) trans 17179873932 rc 0/0 00000100:00100000:0.0:1746147127.030056:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13297 00000100:00100000:0.0:1746147127.030067:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13301 00000100:00100000:0.0:1746147127.030071:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967310487680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.030142:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3764:x1830967310487680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (367us total) trans 21474841209 rc 0/0 00000100:00100000:0.0:1746147127.030148:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13301 00000004:00080000:0.0:1746147127.030166:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cd500/2, rc 0, transno 17179873933 00000100:00100000:0.0:1746147127.030169:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310486656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147127.030176:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca21c00/2, rc 0, transno 21474841208 00000100:00100000:0.0:1746147127.030178:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310487168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.030184:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca22680/2, rc 0, transno 21474841209 00000100:00100000:0.0:1746147127.030187:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310487680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.030198:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca21180/2, rc 0, transno 21474841206 00000100:00100000:0.0:1746147127.030200:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310486528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.030206:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca21880/2, rc 0, transno 21474841207 00000100:00100000:0.0:1746147127.030209:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310487040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.030214:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ced80/2, rc 0, transno 17179873934 00000100:00100000:0.0:1746147127.030217:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310487424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147127.030222:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce300/2, rc 0, transno 17179873931 00000100:00100000:0.0:1746147127.030224:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310485888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.030242:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147127.030246:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310487936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.030262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147127.030291:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cca80/2, rc 0, transno 17179873935 00000100:00100000:0.0:1746147127.030294:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310486144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.030723:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310486400 00000100:00100000:0.0:1746147127.030726:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310486400 00000100:00100000:0.0:1746147127.030739:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13305 00000100:00100000:0.0:1746147127.030743:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967310486400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.030778:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310486912 00000100:00100000:0.0:1746147127.031008:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310486912 00000100:00100000:0.0:1746147127.031027:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13307 00000100:00100000:0.0:1746147127.031031:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967310486912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.031772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.032507:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967310486400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1763us (1793us total) trans 17179873937 rc 0/0 00000100:00100000:0.0:1746147127.032512:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13305 00000004:00080000:0.0:1746147127.032533:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70a80/2, rc 0, transno 17179873936 00000100:00100000:0.0:1746147127.032537:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310487936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.032588:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967310486912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1556us (1842us total) trans 17179873938 rc 0/0 00000100:00100000:0.0:1746147127.032593:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13307 00000100:00100000:0.0:1746147127.034456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.062597:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.070405:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.070961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.071035:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307508992 00000100:00100000:0.0:1746147127.071038:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307508992 00000100:00100000:0.0:1746147127.071063:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13308 00000100:00100000:0.0:1746147127.071068:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:31761:x1830967307508992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147127.071076:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.071085:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x313993942505331d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e762e8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.071117:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147127.071119:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147127.071124:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x313993942505331d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762e8 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.071136:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x313993942505331d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762e8 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.071144:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33200, rc 0) 00000100:00100000:0.0:1746147127.071173:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:31761:x1830967307508992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.071178:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13308 00000100:00100000:0.0:1746147127.071622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.075686:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.075719:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.075733:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.075771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.075792:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307509504 00000100:00100000:0.0:1746147127.075794:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307509504 00010000:00010000:0.0:1746147127.075816:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x31399394250532de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762d3 expref: 31 pid: 16099 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746147127.075830:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307509760 00000100:00100000:0.0:1746147127.075833:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307509760 00010000:00010000:0.0:1746147127.075839:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03dc00/0x3139939425053301 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762da expref: 12 pid: 9138 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746147127.075849:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5758 00000100:00100000:0.0:1746147127.075852:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307509504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147127.075862:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147127.075866:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x31399394250532de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762d3 expref: 31 pid: 16099 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.075874:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x31399394250532de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762d3 expref: 32 pid: 16099 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.075887:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x31399394250532de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762d3 expref: 32 pid: 16099 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.075901:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.075905:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425053316 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147127.076034:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425053316 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147127.076038:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147127.076068:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307509504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 215us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.076073:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5758 00010000:00010000:0.0:1746147127.076345:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.076354:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147127.076368:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147127.076465:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425053324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762f6 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.076474:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762f6 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.076480:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.076482:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147127.076484:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57200, rc 0) 00000100:00100000:0.0:1746147127.076503:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:31760:x1830967307509376:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5184us (5513us total) trans 8589935612 rc 0/0 00000100:00100000:0.0:1746147127.076508:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14999 00000100:00100000:0.0:1746147127.081174:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.081793:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.102729:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.106597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.108143:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.116798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.116832:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.124150:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310488576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124170:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310489216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124206:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124215:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310489088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124244:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488704 00000100:00100000:0.0:1746147127.124250:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488704 00000100:00100000:0.0:1746147127.124275:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488576 00000100:00100000:0.0:1746147127.124276:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488576 00000100:00100000:0.0:1746147127.124288:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13312 00000100:00100000:0.0:1746147127.124294:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967310488704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124361:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124374:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147127.124378:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310488960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124398:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310489472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124409:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147127.124432:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0c000/2, rc 0, transno 21474841212 00000100:00100000:0.0:1746147127.124436:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310489216:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147127.124457:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147127.124459:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.124461:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.124463:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147126 -> 1746147126 00002000:00010000:0.0:1746147127.124464:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147127.124484:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967310488704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (321us total) trans 21474841213 rc 0/0 00000100:00100000:0.0:1746147127.124492:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13312 00000100:00100000:0.0:1746147127.124497:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310489472 00000100:00100000:0.0:1746147127.124499:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310489472 00000100:00100000:0.0:1746147127.124509:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13316 00000100:00100000:0.0:1746147127.124513:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967310489344:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.124546:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e9880/2, rc 0, transno 21474841214 00000100:00100000:0.0:1746147127.124549:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310488832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.124555:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930eaa00/2, rc 0, transno 21474841213 00000100:00100000:0.0:1746147127.124557:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310488704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124583:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967310489344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (360us total) trans 21474841215 rc 0/0 00000100:00100000:0.0:1746147127.124587:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13316 00000100:00100000:0.0:1746147127.124595:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13317 00000100:00100000:0.0:1746147127.124599:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3767:x1830967310489088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124639:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967310489088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (277us total) trans 21474841217 rc 0/0 00000100:00100000:0.0:1746147127.124643:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13317 00000100:00100000:0.0:1746147127.124650:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13318 00000100:00100000:0.0:1746147127.124654:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3767:x1830967310488960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147127.124686:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147127.124688:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.124690:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147127.124692:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.124694:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147127.124708:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967310488960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (314us total) trans 21474841218 rc 0/0 00000100:00100000:0.0:1746147127.124712:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13318 00000004:00080000:0.0:1746147127.124730:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930ead80/2, rc 0, transno 21474841218 00000100:00100000:0.0:1746147127.124733:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310488960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.124739:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0df80/2, rc 0, transno 21474841219 00000100:00100000:0.0:1746147127.124741:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310489472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.124746:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930ebb80/2, rc 0, transno 21474841216 00000100:00100000:0.0:1746147127.124749:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310488576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147127.124754:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e9f80/2, rc 0, transno 21474841217 00000100:00100000:0.0:1746147127.124756:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310489088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124763:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310489600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124778:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124791:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310490112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124802:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124810:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147127.124814:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310489984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124824:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124830:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310490496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124839:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124849:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310489728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124860:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124866:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310490240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124876:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124882:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147127.124885:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310489856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124896:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147127.124901:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310490368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124913:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147127.124927:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca0ea00/2, rc 0, transno 21474841215 00000100:00100000:0.0:1746147127.124930:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310489344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147127.124937:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490368 00000100:00100000:0.0:1746147127.124939:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490368 00000100:00100000:0.0:1746147127.124949:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13322 00000100:00100000:0.0:1746147127.124953:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3767:x1830967310489984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.124983:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13323 00000100:00100000:0.0:1746147127.124987:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3767:x1830967310490496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147127.125019:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147127.125021:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.125023:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147127.125025:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.125026:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147127.125041:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3767:x1830967310490496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (201us total) trans 17179873942 rc 0/0 00000100:00100000:0.0:1746147127.125046:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13323 00000100:00100000:0.0:1746147127.125054:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13325 00000100:00100000:0.0:1746147127.125057:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967310490240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.125118:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967310490240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (240us total) trans 17179873944 rc 0/0 00000100:00100000:0.0:1746147127.125122:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13325 00000100:00100000:0.0:1746147127.125129:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13327 00000100:00100000:0.0:1746147127.125132:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310490368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147127.125160:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147127.125162:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.125164:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147127.125165:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147127.125167:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147127.125178:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3764:x1830967310490368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (265us total) trans 17179873946 rc 0/0 00000100:00100000:0.0:1746147127.125182:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13327 00000004:00080000:0.0:1746147127.125196:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4998000/2, rc 0, transno 17179873945 00000100:00100000:0.0:1746147127.125201:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310489856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147127.125207:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4998700/2, rc 0, transno 17179873946 00000100:00100000:0.0:1746147127.125210:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310490368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147127.125215:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4998e00/2, rc 0, transno 17179873943 00000100:00100000:0.0:1746147127.125217:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310489728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147127.125222:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4998a80/2, rc 0, transno 17179873944 00000100:00100000:0.0:1746147127.125225:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310490240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.125267:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3767:x1830967310489984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 313us (441us total) trans 17179873941 rc 0/0 00000100:00100000:0.0:1746147127.125272:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13322 00000100:00100000:0.0:1746147127.125279:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490624 00000100:00100000:0.0:1746147127.125280:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490624 00000100:00100000:0.0:1746147127.125292:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13328 00000100:00100000:0.0:1746147127.125295:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3767:x1830967310490624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147127.125346:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3767:x1830967310490624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (79us total) trans 17179873947 rc 0/0 00000100:00100000:0.0:1746147127.125350:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13328 00000100:00100000:0.0:1746147127.126802:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.128952:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.129851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.131324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.136364:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.137038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.143400:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.155250:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.155332:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.164214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.164946:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.169000:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.172336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.173016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.182519:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.192006:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.192059:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.196741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.206257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.213327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.213436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.228368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.231493:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.239290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.242153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.248621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.253862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.264371:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307516800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10333us (10503us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147127.264385:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2969 00002000:00100000:0.0:1746147127.264400:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88009c30b800 x1830967307516800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:503/0 lens 488/440 e 0 to 0 dl 1746147138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147127.264410:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b800 with x1830967307516800 ext(2097152->3145727) 00002000:00010000:0.0:1746147127.264417:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30b800 00000100:00100000:0.0:1746147127.273957:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.274019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.275243:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.322339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.322402:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307518592 00000100:00100000:0.0:1746147127.322411:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307518592 00000100:00100000:0.0:1746147127.322464:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15005 00000100:00100000:0.0:1746147127.322474:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:31767:x1830967307518592:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147127.322495:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.322516:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x31399394250533cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7637b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.322595:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20a00/0x31399394250533d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147127.322608:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20a00/0x31399394250533d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147127.322619:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20a00/0x31399394250533d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147127.327691:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.332662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.334164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.341076:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.350264:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.360843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.378470:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.383956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.414963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.418264:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.418333:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.418363:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307521408 00000100:00100000:0.0:1746147127.418366:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307521408 00010000:00010000:0.0:1746147127.418383:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x313993942505326e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762a2 expref: 17 pid: 17600 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746147127.424210:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.428760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.428792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.428889:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307521792 00000100:00100000:0.0:1746147127.428897:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307521792 00010000:00010000:0.0:1746147127.429043:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d000/0x313993942505335c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76312 expref: 18 pid: 9585 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746147127.429065:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5772 00000100:00100000:0.0:1746147127.429071:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307521792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147127.429078:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147127.429086:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f03d000/0x313993942505335c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76312 expref: 18 pid: 9585 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.429118:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f03d000/0x313993942505335c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76312 expref: 18 pid: 9585 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.429131:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147127.429747:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967307521792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 674us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.429753:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5772 00000100:00100000:0.0:1746147127.430318:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.437781:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.478846:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.485421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.485524:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.492441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.492492:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.530997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.539714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.555875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.564836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.590941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147127.593402:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147127.601958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.601998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.602024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.602054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.602127:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307524480 00000100:00100000:0.0:1746147127.602133:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307524480 00000100:00100000:0.0:1746147127.602178:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 751 00000100:00100000:0.0:1746147127.602185:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307524480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147127.602200:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147127.602235:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x313993942505346d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763b3 expref: 35 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.602256:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.602261:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147127.602302:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307524480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.602309:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 751 00000100:00100000:0.0:1746147127.602397:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13347 00000100:00100000:0.0:1746147127.602404:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307524736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147127.602416:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.602428:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x3139939425053489 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e763c8 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.602443:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147127.602445:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147127.602454:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x3139939425053489 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763c8 expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147127.602468:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x3139939425053489 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763c8 expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147127.602477:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ae00, rc 0) 00000100:00100000:0.0:1746147127.602496:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307524736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 93us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.602502:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13347 00000100:00100000:0.0:1746147127.615028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.621203:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.627013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.627121:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967307524992:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10573us (12095us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147127.627130:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2982 00002000:00100000:0.0:1746147127.627140:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3c000 x1830967307524992/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:503/0 lens 488/440 e 0 to 0 dl 1746147138 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147127.627149:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c000 with x1830967307524992 ext(4194304->4919295) 00002000:00010000:0.0:1746147127.627154:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c000 00000100:00100000:0.0:1746147127.627208:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307525376 00000100:00100000:0.0:1746147127.627212:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307525376 00000100:00100000:0.0:1746147127.627257:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15009 00000100:00100000:0.0:1746147127.627262:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:31780:x1830967307525376:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147127.627277:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.627290:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30000/0x3139939425053497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e763d6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.627359:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627371:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627382:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627397:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627403:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627408:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627511:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x31399394250534ac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627521:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x31399394250534ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627526:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x31399394250534ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147127.627534:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147127.627609:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627616:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627621:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627626:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a31c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147127.627630:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627635:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627646:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147127.627649:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147127.627652:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627656:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31c00/0x313993942505349e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627669:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627674:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627678:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627681:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a31600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147127.627683:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627688:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627694:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5700) 00010000:00010000:0.0:1746147127.627695:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147127.627697:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627702:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x31399394250534a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147127.627733:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30000/0x3139939425053497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763d6 expref: 37 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.627743:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x31399394250534ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763d6 expref: 36 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.627749:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.627751:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147127.627753:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31000, rc 0) 00000100:00100000:0.0:1746147127.627774:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:31780:x1830967307525376:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 511us (764us total) trans 8589935623 rc 0/0 00000100:00100000:0.0:1746147127.627779:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15009 00000100:00100000:0.0:1746147127.633881:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.633917:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.633956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.633980:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307525888 00000100:00100000:0.0:1746147127.633987:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307525888 00000100:00100000:0.0:1746147127.634038:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 752 00000100:00100000:0.0:1746147127.634047:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307525888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147127.634061:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147127.634103:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x31399394250534ac lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763d6 expref: 36 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.634122:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.634126:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147127.634166:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307525888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 120us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.634173:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 752 00000100:00100000:0.0:1746147127.634284:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.634369:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307526016 00000100:00100000:0.0:1746147127.634372:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307526016 00000100:00100000:0.0:1746147127.634400:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13349 00000100:00100000:0.0:1746147127.634406:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307526016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147127.634422:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.634437:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a31a00/0x31399394250534ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e763dd expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147127.634482:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310494336:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147127.634539:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147127.644154:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310494336:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147127.644190:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a31a00/0x31399394250534ba lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763dd expref: 27 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147127.644204:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a31a00/0x31399394250534ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763dd expref: 27 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147127.644229:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31a00, rc 0) 00000100:00100000:0.0:1746147127.644275:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967307526016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9868us (9990us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147127.644285:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13349 00000100:00100000:0.0:1746147127.646045:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307525504:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10999us (12169us total) trans 17179873951 rc 0/0 00000100:00100000:0.0:1746147127.646056:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 957 00002000:00100000:0.0:1746147127.646067:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (872448->1048575) req@ffff880091c3f480 x1830967307525504/t17179873951(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:503/0 lens 488/448 e 0 to 0 dl 1746147138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147127.646077:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3f480 with x1830967307525504 ext(872448->1048575) 00010000:00010000:0.0:1746147127.646085:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425053419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76390 expref: 26 pid: 9585 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.646148:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425053419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76390 expref: 26 pid: 9585 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746147127.646157:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c3f480 00000100:00100000:0.0:1746147127.654250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.656064:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.665537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.666461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.674771:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307526784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7589us (8297us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147127.674785:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2983 00002000:00100000:0.0:1746147127.674800:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011da9dc00 x1830967307526784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:503/0 lens 488/440 e 0 to 0 dl 1746147138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147127.674809:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9dc00 with x1830967307526784 ext(0->1048575) 00002000:00010000:0.0:1746147127.674816:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9dc00 00000100:00100000:0.0:1746147127.675031:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307527040 00000100:00100000:0.0:1746147127.675039:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307527040 00000100:00100000:0.0:1746147127.675215:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15010 00000100:00100000:0.0:1746147127.675233:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:31783:x1830967307527040:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147127.675256:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.675277:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x31399394250534c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e763eb expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.675354:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675368:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675380:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675392:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675397:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675402:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675497:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250534dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675506:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250534dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675511:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250534dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147127.675518:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147127.675592:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675598:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675604:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675610:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01b800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147127.675613:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675619:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675629:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147127.675632:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147127.675635:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675640:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b800/0x31399394250534cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675661:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675666:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675670:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675674:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01a800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147127.675676:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675679:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675688:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5900) 00010000:00010000:0.0:1746147127.675689:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147127.675691:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675695:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x31399394250534d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147127.675727:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x31399394250534c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763eb expref: 18 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.675737:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01be00/0x31399394250534dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763eb expref: 17 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.675742:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147127.675744:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147127.675747:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01be00, rc 0) 00000100:00100000:0.0:1746147127.676550:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:31783:x1830967307527040:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1316us (1611us total) trans 8589935626 rc 0/0 00000100:00100000:0.0:1746147127.676556:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15010 00000100:00100000:0.0:1746147127.678774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.680676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.683302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.690674:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310494720:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147127.690709:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x31399394250534eb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763f2 expref: 34 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.690732:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a2600, rc 0) 00000100:00100000:0.0:1746147127.690771:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:31778:x1830967307527424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9203us (10094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147127.690778:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13351 00000100:00100000:0.0:1746147127.699727:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307527680:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9762us (10042us total) trans 21474841220 rc 0/0 00000100:00100000:0.0:1746147127.699740:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 958 00002000:00100000:0.0:1746147127.699754:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1556479) req@ffff88009f086a00 x1830967307527680/t21474841220(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:503/0 lens 488/448 e 0 to 0 dl 1746147138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147127.699765:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086a00 with x1830967307527680 ext(1048576->1556479) 00010000:00010000:0.0:1746147127.699776:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425053420 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76397 expref: 18 pid: 9585 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.699795:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425053420 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76397 expref: 18 pid: 9585 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746147127.699803:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f086a00 00000100:00100000:0.0:1746147127.705705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.711166:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.751440:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.759839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.761332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.763274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.767264:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307528960 00000100:00100000:0.0:1746147127.767273:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307528960 00000100:00100000:0.0:1746147127.767330:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13353 00000100:00100000:0.0:1746147127.767337:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:31778:x1830967307528960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147127.767360:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.767378:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01b800/0x31399394250534f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76400 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.767406:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a2e00/0x31399394250534f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763f9 expref: 16 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.767414:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147127.767415:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147127.767418:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01b800/0x31399394250534f9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76400 expref: 34 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.767445:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a2e00/0x31399394250534f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2818047) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763f9 expref: 16 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.767455:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982a2e00/0x31399394250534f2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2818047) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763f9 expref: 16 pid: 10340 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746147127.767466:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310495488:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147127.767547:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147127.770054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.781682:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.791208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.813710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.822374:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.843761:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.848435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.852821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.852953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.853793:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.863761:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.864551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.876827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.889145:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.892974:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13362 00000100:00100000:0.0:1746147127.892980:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967307532928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147127.892985:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.892991:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x3139939425053554 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76446 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147127.893004:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x3139939425053554 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76446 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147127.893012:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x3139939425053554 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76446 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147127.893021:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ae00, rc 0) 00000100:00100000:0.0:1746147127.893045:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967307532928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (451us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147127.893050:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13362 00000100:00100000:0.0:1746147127.897398:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.902722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.902809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.923788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.923909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.923964:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13364 00000100:00100000:0.0:1746147127.923974:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967307534208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147127.923994:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147127.924012:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053569 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7645b expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147127.924063:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310496512:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147127.924260:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147127.927630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.930390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.948204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.952021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.961154:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.964735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.969894:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307535104:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4954us (5147us total) trans 21474841222 rc 0/0 00000100:00100000:0.0:1746147127.969909:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 963 00002000:00100000:0.0:1746147127.969921:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2449407) req@ffff880096cf8a80 x1830967307535104/t21474841222(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:503/0 lens 488/448 e 0 to 0 dl 1746147138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147127.969931:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8a80 with x1830967307535104 ext(2097152->2449407) 00010000:00010000:0.0:1746147127.969942:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d91000/0x3139939425053515 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7641c expref: 36 pid: 9584 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746147127.969967:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d91000/0x3139939425053515 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7641c expref: 36 pid: 9584 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746147127.969974:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cf8a80 00000100:00100000:0.0:1746147127.974885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.992225:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.994364:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147127.998102:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2995 00000100:00100000:0.0:1746147127.998116:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967307535744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147128.021905:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147128.022635:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147128.022673:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.023055:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15012 00000100:00100000:0.0:1746147128.023156:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:31797:x1830967307536000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147128.023531:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.023548:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x31399394250535a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76470 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.042105:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307537280 00000100:00100000:0.0:1746147128.042113:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307537280 00002000:00100000:0.0:1746147128.042154:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f084000 x1830967307537280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:504/0 lens 488/0 e 0 to 0 dl 1746147139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147128.042164:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084000 with x1830967307537280 ext(4194304->4919295) 00002000:00010000:0.0:1746147128.042169:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084000 00000100:00100000:0.0:1746147128.042183:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2996 00000100:00100000:0.0:1746147128.042188:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967307537280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147128.060678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.068772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.071246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.099461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.113341:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.128698:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.128759:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.143714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147128.143966:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147128.148827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.149124:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.149152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.149536:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307539328 00000100:00100000:0.0:1746147128.149543:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307539328 00010000:00010000:0.0:1746147128.149577:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425053275 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762b0 expref: 16 pid: 1853 timeout: 766 lvb_type: 1 00000100:00100000:0.0:1746147128.149596:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307539200 00000100:00100000:0.0:1746147128.149597:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307539200 00010000:00010000:0.0:1746147128.149605:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425053378 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76327 expref: 21 pid: 9585 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.150154:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5786 00000100:00100000:0.0:1746147128.150162:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307539328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.150175:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.150196:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425053275 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762b0 expref: 16 pid: 1853 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.150206:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425053275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762b0 expref: 16 pid: 1853 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.150241:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425053275 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762b0 expref: 16 pid: 1853 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.150257:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147128.150275:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307539328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 114us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.150280:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5786 00000100:00100000:0.0:1746147128.150293:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5788 00000100:00100000:0.0:1746147128.150298:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307539456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.150304:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.150310:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x313993942505338d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7633c expref: 36 pid: 9585 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.150319:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x313993942505338d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7633c expref: 36 pid: 9585 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.150330:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x313993942505338d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7633c expref: 36 pid: 9585 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.150339:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.150341:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.151564:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.151575:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.151609:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.151622:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310497536:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147128.152514:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.153708:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310497536:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147128.153726:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147128.153764:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307539456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3465us (4611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.153773:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5788 00000100:00100000:0.0:1746147128.160426:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.167016:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.167691:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307540096 00000100:00100000:0.0:1746147128.167694:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307540096 00010000:00010000:0.0:1746147128.167708:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x31399394250533a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76351 expref: 40 pid: 1853 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.182252:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.185375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.185444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.185476:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307540736 00000100:00100000:0.0:1746147128.185481:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307540736 00010000:00010000:0.0:1746147128.185494:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425053490 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763cf expref: 41 pid: 1854 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.185562:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5792 00000100:00100000:0.0:1746147128.185567:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307540736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.185573:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.185631:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425053490 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763cf expref: 41 pid: 1854 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.185640:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425053490 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e763cf expref: 41 pid: 1854 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.185664:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147128.191018:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.200480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.200528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.207051:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.209546:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.209560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.209622:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.209636:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307542016 00000100:00100000:0.0:1746147128.209639:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307542016 00000100:00100000:0.0:1746147128.209660:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 758 00000100:00100000:0.0:1746147128.209665:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967307542016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.209672:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.209687:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x313993942505362d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764af expref: 23 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.209702:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.209706:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147128.209737:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967307542016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.209743:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 758 00000100:00100000:0.0:1746147128.209800:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307541760 00000100:00100000:0.0:1746147128.209802:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307541760 00000100:00100000:0.0:1746147128.209820:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307541888 00000100:00100000:0.0:1746147128.209821:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307541888 00000100:00100000:0.0:1746147128.209834:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13374 00000100:00100000:0.0:1746147128.209838:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967307541760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147128.209854:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.209867:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c06c00/0x313993942505363b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e764b6 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.209913:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310498688:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147128.210656:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.212531:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.223525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.227048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.230137:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307542784 00000100:00100000:0.0:1746147128.230147:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307542784 00000100:00100000:0.0:1746147128.230207:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15016 00000100:00100000:0.0:1746147128.230225:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:31809:x1830967307542784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147128.230251:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.230274:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425053650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e764cb expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.230361:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230374:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230386:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230399:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230405:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230410:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230514:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x3139939425053665 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230524:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x3139939425053665 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230529:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x3139939425053665 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147128.230537:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147128.230700:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230707:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230713:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230719:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230723:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147128.230727:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230733:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230743:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147128.230745:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147128.230750:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230755:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425053657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230778:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230783:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230788:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230792:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147128.230794:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230801:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230808:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5e00) 00010000:00010000:0.0:1746147128.230810:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147128.230811:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230816:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942505365e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.230854:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425053650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764cb expref: 44 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.230866:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x3139939425053665 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764cb expref: 43 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.230871:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.230873:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147128.230875:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:0.0:1746147128.230924:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:31809:x1830967307542784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 700us (870us total) trans 8589935638 rc 0/0 00000100:00100000:0.0:1746147128.230931:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15016 00000100:00100000:0.0:1746147128.235794:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307543296 00000100:00100000:0.0:1746147128.235798:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307543296 00000100:00100000:0.0:1746147128.235817:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13379 00000100:00100000:0.0:1746147128.235822:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307543296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147128.235828:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.235836:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80600/0x3139939425053681 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e764e0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.235858:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310499456:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147128.235881:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2240 going to sleep for 11 seconds 00002000:00010000:0.0:1746147128.244684:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147127 -> 1746147128 00002000:00010000:0.0:1746147128.244689:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147126 -> 1746147128 00002000:00010000:0.0:1746147128.244691:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147127 -> 1746147128 00000100:00100000:0.0:1746147128.244712:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310499456:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147128.244744:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80600/0x3139939425053681 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764e0 expref: 44 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.244758:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80600/0x3139939425053681 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764e0 expref: 44 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.244772:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80600, rc 0) 00000100:00100000:0.0:1746147128.244819:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307543296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8995us (9054us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147128.244827:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13379 00000100:00100000:0.0:1746147128.244863:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307543424 00000100:00100000:0.0:1746147128.244869:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307543424 00010000:00010000:0.0:1746147128.244891:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505360a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764a1 expref: 43 pid: 10340 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.244910:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5795 00000100:00100000:0.0:1746147128.244917:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967307543424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.244931:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.244941:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505360a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764a1 expref: 43 pid: 10340 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.244952:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505360a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764a1 expref: 43 pid: 10340 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.244972:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.244974:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.244981:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425053649 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764c4 expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.244989:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425053649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764c4 expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.245014:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425053649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764c4 expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.245026:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310499584:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147128.245079:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2240 going to sleep for 11 seconds 00002000:00010000:0.0:1746147128.245149:0:10340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147126 -> 1746147128 00002000:00010000:0.0:1746147128.245151:0:10340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147126 -> 1746147128 00002000:00010000:0.0:1746147128.245153:0:10340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147126 -> 1746147128 00000100:00100000:0.0:1746147128.245165:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310499200:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147128.245182:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f213800/0x313993942505367a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764d9 expref: 36 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.245200:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f213800/0x313993942505367a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764d9 expref: 36 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.245217:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f213800, rc 0) 00000100:00100000:0.0:1746147128.245252:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307543168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9725us (9808us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147128.245257:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13378 00000100:00100000:0.0:1746147128.248751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.257039:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307544064 00000100:00100000:0.0:1746147128.257051:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307544064 00002000:00100000:0.0:1746147128.257116:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098e12300 x1830967307544064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:504/0 lens 488/0 e 0 to 0 dl 1746147139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147128.257126:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12300 with x1830967307544064 ext(0->1048575) 00002000:00010000:0.0:1746147128.257131:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e12300 00000100:00100000:0.0:1746147128.257179:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3004 00000100:00100000:0.0:1746147128.257186:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307544064:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147128.267474:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307544064:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10280us (10697us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147128.267486:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3004 00002000:00100000:0.0:1746147128.267496:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098e12300 x1830967307544064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:504/0 lens 488/440 e 0 to 0 dl 1746147139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147128.267504:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12300 with x1830967307544064 ext(0->1048575) 00002000:00010000:0.0:1746147128.267510:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e12300 00000100:00100000:0.0:1746147128.271625:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.276412:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.276915:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.285418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.290054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.297147:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.298015:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3009 00000100:00100000:0.0:1746147128.298022:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307545728:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147128.298430:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307546112 00000100:00100000:0.0:1746147128.298436:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307546112 00000100:00100000:0.0:1746147128.310004:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307546240 00000100:00100000:0.0:1746147128.310012:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307546240 00000100:00100000:0.0:1746147128.310046:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13383 00000100:00100000:0.0:1746147128.310189:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:31809:x1830967307546240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147128.310215:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.310233:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250536c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76503 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.310260:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 21 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.310267:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147128.310269:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147128.310272:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250536c0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76503 expref: 38 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.310300:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 20 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.310317:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 20 pid: 10340 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.310328:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310500096:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.310797:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.314078:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.314940:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.315023:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.315056:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307546752 00000100:00100000:0.0:1746147128.315059:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307546752 00002000:00100000:0.0:1746147128.315109:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1552384->2097151) req@ffff880095236680 x1830967307546752/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:504/0 lens 488/0 e 0 to 0 dl 1746147139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147128.315119:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095236680 with x1830967307546752 ext(1552384->2097151) 00010000:00010000:0.0:1746147128.315128:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 20 pid: 10340 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.315140:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x31399394250535fc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76493 expref: 20 pid: 10340 timeout: 766 lvb_type: 0 00002000:00010000:0.0:1746147128.315147:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095236680 00000100:00100000:0.0:1746147128.315161:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 966 00000100:00100000:0.0:1746147128.315167:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307546752:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147128.342817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.351986:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.364348:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.369816:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:1.0:1746147128.374549:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1187839) req@ffff880095235180 x1830967307547776/t17179873954(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:504/0 lens 488/448 e 0 to 0 dl 1746147139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147128.374564:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235180 with x1830967307547776 ext(1048576->1187839) 00010000:00010000:1.0:1746147128.374574:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7f600/0x3139939425053603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7649a expref: 28 pid: 10340 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.374588:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7f600/0x3139939425053603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7649a expref: 28 pid: 10340 timeout: 766 lvb_type: 0 00002000:00010000:1.0:1746147128.374594:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095235180 00000100:00100000:0.0:1746147128.378663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.378710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.384862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.385029:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307548288 00000100:00100000:1.0:1746147128.385035:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307548288 00002000:00100000:1.0:1746147128.385063:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a897f480 x1830967307548288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:504/0 lens 488/0 e 0 to 0 dl 1746147139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147128.385071:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f480 with x1830967307548288 ext(1048576->2097151) 00002000:00010000:1.0:1746147128.385075:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897f480 00000100:00100000:1.0:1746147128.385112:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3012 00000100:00100000:1.0:1746147128.385119:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307548288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147128.390218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.400242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.410010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.424947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.432494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.439841:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.446001:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.447027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.448588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.448627:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.456317:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.461784:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.461892:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307550464 00000100:00100000:1.0:1746147128.461900:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307550464 00000100:00100000:1.0:1746147128.461950:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13390 00000100:00100000:1.0:1746147128.461961:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:31815:x1830967307550464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147128.462051:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.462064:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425053714 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7653b expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.462081:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134ae8800/0x3139939425053577 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76462 expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.462114:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f391c00/0x31399394250535cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7647e expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.462121:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x3139939425053507 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7640e expref: 43 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.462126:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.462128:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.462131:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425053714 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3473408->3731455] (req 3473408->3731455) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7653b expref: 43 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.462159:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x3139939425053507 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7640e expref: 43 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.462168:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x3139939425053507 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7640e expref: 43 pid: 10340 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.462177:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310501504:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.462241:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f391c00/0x31399394250535cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7647e expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.462249:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f391c00/0x31399394250535cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7647e expref: 43 pid: 9585 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.462257:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310501632:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.462280:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134ae8800/0x3139939425053577 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76462 expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.462287:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134ae8800/0x3139939425053577 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76462 expref: 27 pid: 10340 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.462294:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310501760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.462310:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.465907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.468740:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310501504:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.468750:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310501632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.471478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.471572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.471825:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5803 00000100:00100000:0.0:1746147128.471832:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967307550848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.471839:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.471848:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f391c00/0x31399394250535cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7647e expref: 44 pid: 9585 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.471856:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f391c00/0x31399394250535cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7647e expref: 44 pid: 9585 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.471867:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f391c00/0x31399394250535cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7647e expref: 44 pid: 9585 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.471880:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147128.471895:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307550848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.471900:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5803 00000100:00100000:0.0:1746147128.477241:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.477384:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310501760:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.477411:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425053714 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3473408->3731455] (req 3473408->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7653b expref: 41 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.477422:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48c00, rc 0) 00000100:00100000:1.0:1746147128.477456:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:31815:x1830967307550464:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 15497us (15682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.477462:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13390 00000100:00100000:0.0:1746147128.484959:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.485363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.488031:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.492982:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.493491:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307551872 00000100:00100000:1.0:1746147128.493501:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307551872 00002000:00100000:1.0:1746147128.493544:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3727360->3731455) req@ffff88011e502680 x1830967307551872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:504/0 lens 488/0 e 0 to 0 dl 1746147139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147128.493555:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502680 with x1830967307551872 ext(3727360->3731455) 00002000:00010000:1.0:1746147128.493560:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e502680 00000100:00100000:1.0:1746147128.493588:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3016 00000100:00100000:1.0:1746147128.493595:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307551872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147128.493738:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307551872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 142us (767us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147128.493744:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3016 00002000:00100000:1.0:1746147128.493750:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3727360->3731455) req@ffff88011e502680 x1830967307551872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:504/0 lens 488/4536 e 0 to 0 dl 1746147139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147128.493755:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502680 with x1830967307551872 ext(3727360->3731455) 00002000:00010000:1.0:1746147128.493758:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e502680 00000100:00100000:0.0:1746147128.507021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147128.507716:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147128.511467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.511505:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.514053:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.514338:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.514386:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307552640 00000100:00100000:1.0:1746147128.514392:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307552640 00010000:00010000:1.0:1746147128.514420:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762f6 expref: 26 pid: 16099 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.514443:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5806 00000100:00100000:1.0:1746147128.514449:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967307552640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147128.514458:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147128.514463:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762f6 expref: 26 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.514472:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762f6 expref: 26 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.514489:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505332b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e762f6 expref: 26 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.514631:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.514636:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7800/0x3139939425053730 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.514643:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7800/0x3139939425053730 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.514648:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7800/0x3139939425053730 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.514653:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147128.514693:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967307552640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 243us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.514698:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5806 00000100:00100000:0.0:1746147128.521016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.521200:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307553024 00000100:00100000:1.0:1746147128.521215:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307553024 00000100:00100000:1.0:1746147128.521262:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13391 00000100:00100000:1.0:1746147128.521270:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307553024:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147128.521285:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.521301:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x3139939425053737 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76550 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.521348:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310502400:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147128.521422:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.522212:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.522263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147128.522532:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147128.522547:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13392 00000100:00100000:0.0:1746147128.522684:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307553280:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147128.522694:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.522705:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0af400/0x313993942505373e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7655e expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.522717:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.522719:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.522726:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0af400/0x313993942505373e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7655e expref: 17 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.522738:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0af400/0x313993942505373e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7655e expref: 17 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.522747:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0af400, rc 0) 00000100:00100000:0.0:1746147128.522772:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307553280:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 220us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.522828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.522837:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307552896 00000100:00100000:1.0:1746147128.522839:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307552896 00000100:00100000:1.0:1746147128.522855:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13394 00000100:00100000:1.0:1746147128.522859:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307552896:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147128.522865:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.522871:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x313993942505374c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76549 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.522880:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.522882:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.522886:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x313993942505374c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76549 expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.522895:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x313993942505374c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76549 expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.522901:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49e00, rc 0) 00000100:00100000:1.0:1746147128.522915:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307552896:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 56us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.522920:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13394 00000100:00100000:1.0:1746147128.522947:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307553152 00000100:00100000:1.0:1746147128.522950:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307553152 00000100:00100000:0.0:1746147128.522982:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13392 00000100:00100000:0.0:1746147128.523213:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307553408 00000100:00100000:0.0:1746147128.523216:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307553408 00000100:00100000:0.0:1746147128.523234:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13396 00000100:00100000:0.0:1746147128.523239:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307553408:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147128.523245:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.523251:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942505375a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76565 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.523272:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310502656:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147128.523304:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147128.524236:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310502400:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147128.524256:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x3139939425053737 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76550 expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.524265:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x3139939425053737 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76550 expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.524286:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7e600, rc 0) 00000100:00100000:1.0:1746147128.524306:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307553024:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3038us (3299us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147128.524311:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13391 00002000:00010000:1.0:1746147128.525968:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147127 -> 1746147128 00002000:00010000:1.0:1746147128.525973:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147127 -> 1746147128 00002000:00010000:1.0:1746147128.525975:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147127 -> 1746147128 00000100:00100000:1.0:1746147128.525989:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310502656:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147128.526007:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942505375a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76565 expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.526015:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942505375a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76565 expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.526023:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae800, rc 0) 00000100:00100000:1.0:1746147128.526061:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307553408:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2820us (3098us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147128.526066:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13396 00000100:00100000:0.0:1746147128.528824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.533149:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.536658:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.538215:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.538300:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307554176 00000100:00100000:1.0:1746147128.538311:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307554176 00010000:00010000:1.0:1746147128.538344:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7800/0x3139939425053768 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76573 expref: 10 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.538381:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5809 00000100:00100000:1.0:1746147128.538387:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307554176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147128.538399:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147128.538408:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7800/0x3139939425053768 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76573 expref: 10 pid: 9138 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.538419:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7800/0x3139939425053768 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76573 expref: 10 pid: 9138 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.538437:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.538441:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x313993942505377d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.538449:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x313993942505377d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.538455:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x313993942505377d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.538469:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147128.538510:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307554176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.538517:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5809 00000100:00100000:1.0:1746147128.545517:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307554304 00000100:00100000:1.0:1746147128.545526:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307554304 00000100:00100000:1.0:1746147128.545565:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307554432 00000100:00100000:1.0:1746147128.545567:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307554432 00000100:00100000:1.0:1746147128.545585:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307554560 00000100:00100000:1.0:1746147128.545587:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307554560 00000100:00100000:1.0:1746147128.545603:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13397 00000100:00100000:1.0:1746147128.545611:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307554304:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147128.545613:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13398 00000100:00100000:0.0:1746147128.545622:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307554432:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147128.545629:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.545630:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.545647:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x313993942505378b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76581 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.545647:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae400/0x3139939425053784 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76588 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.545698:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310503168:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147128.545698:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310503040:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147128.545782:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147128.545928:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147128.551541:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310503168:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147128.551561:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x313993942505378b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76581 expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.551570:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x313993942505378b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76581 expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.551593:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7e600, rc 0) 00000100:00100000:1.0:1746147128.551620:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307554304:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6010us (6254us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147128.551626:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13397 00000100:00100000:0.0:1746147128.555624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560517:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560607:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560646:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.560684:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307554944 00000100:00100000:0.0:1746147128.560692:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307554944 00000100:00100000:0.0:1746147128.560729:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307555072 00000100:00100000:0.0:1746147128.560731:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307555072 00000100:00100000:0.0:1746147128.560743:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307555200 00000100:00100000:0.0:1746147128.560745:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307555200 00000100:00100000:0.0:1746147128.560753:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307555328 00000100:00100000:0.0:1746147128.560755:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307555328 00000100:00100000:0.0:1746147128.560763:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307555456 00000100:00100000:0.0:1746147128.560765:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307555456 00000100:00100000:0.0:1746147128.560773:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307555584 00000100:00100000:0.0:1746147128.560774:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307555584 00000100:00100000:0.0:1746147128.560783:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13400 00000100:00100000:0.0:1746147128.560797:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2000:x1830967307554944:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147128.560843:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afc00/0x31399394250537ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.560861:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425053649 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764c4 expref: 26 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.560869:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x313993942505374c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76549 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.560877:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425053688 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764e7 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.560884:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.560885:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.560888:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afc00/0x31399394250537ae lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.560919:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425053688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764e7 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.560933:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425053688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764e7 expref: 40 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.560947:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310503424:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.561026:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x313993942505374c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76549 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.561038:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x313993942505374c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76549 expref: 20 pid: 9585 timeout: 766 lvb_type: 1 00000100:00100000:0.0:1746147128.561045:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310503552:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.561067:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425053649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764c4 expref: 26 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561074:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425053649 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e764c4 expref: 26 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.561081:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310503680:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.561131:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.561150:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13401 00000100:00100000:0.0:1746147128.561156:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307555072:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147128.561176:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250537b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561186:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561191:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147128.561192:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147128.561194:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250537b5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561226:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561234:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 21 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.561243:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310503808:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.561262:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.561280:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13402 00000100:00100000:0.0:1746147128.561285:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307555200:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147128.561301:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c11c00/0x31399394250537bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561310:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.561315:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147128.561317:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147128.561318:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c11c00/0x31399394250537bc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.561479:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13403 00000100:00100000:1.0:1746147128.561488:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2000:x1830967307555328:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147128.561507:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097c7f600/0x31399394250537c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561517:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f391e00/0x31399394250536ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76511 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561524:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0af400/0x313993942505373e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7655e expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561535:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f390a00/0x31399394250536dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7651f expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561541:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.561542:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.561544:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7f600/0x31399394250537c3 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561559:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f390a00/0x31399394250536dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7651f expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561567:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f390a00/0x31399394250536dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7651f expref: 26 pid: 9584 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.561575:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310503936:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.561601:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0af400/0x313993942505373e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7655e expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561609:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0af400/0x313993942505373e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7655e expref: 20 pid: 1136 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.561616:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310504064:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.561635:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f391e00/0x31399394250536ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76511 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561647:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f391e00/0x31399394250536ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76511 expref: 40 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.561654:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310504192:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.561670:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147128.561686:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13404 00000100:00100000:1.0:1746147128.561691:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2000:x1830967307555456:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147128.561706:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561715:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425053714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7653b expref: 40 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561721:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.561722:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.561724:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561738:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425053714 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->3731455) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7653b expref: 40 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561745:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425053714 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->3731455) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7653b expref: 40 pid: 10340 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.561753:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310504320:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.561770:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147128.561786:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13405 00000100:00100000:1.0:1746147128.561791:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307555584:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147128.561805:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x31399394250537d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561814:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x313993942505357e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76469 expref: 21 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561821:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425053745 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7656c expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561827:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x31399394250535d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76485 expref: 35 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561832:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.561834:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.561835:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x31399394250537d1 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561852:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x31399394250535d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76485 expref: 35 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561859:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x31399394250535d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76485 expref: 35 pid: 9585 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.561867:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310504448:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.561890:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425053745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7656c expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.561898:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425053745 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7656c expref: 18 pid: 9584 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.561905:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310504576:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.561920:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x313993942505357e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76469 expref: 21 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.561928:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x313993942505357e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76469 expref: 21 pid: 10340 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.561935:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310504704:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.561945:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8300 going to sleep for 11 seconds 00010000:00010000:0.0:1746147128.563111:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.563127:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 21 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.563141:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310504832:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.563586:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.564763:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310503936:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.564773:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310504064:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.564780:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310504192:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.564801:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097c7f600/0x31399394250537c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.564988:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310503808:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.565004:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250537b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.569145:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.569174:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.569189:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.569340:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.569353:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.572360:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310504320:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.572373:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.587569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147128.588754:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588774:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588800:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588807:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588813:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588820:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974a7c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147128.588824:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588831:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588847:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.588853:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x31399394250537ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.588944:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307555456:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 27248us (28316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.588953:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13404 00000100:00100000:0.0:1746147128.590180:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.590361:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307557376 00000100:00100000:1.0:1746147128.590367:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307557376 00010000:00010000:1.0:1746147128.590389:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 25 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.590416:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5820 00000100:00100000:1.0:1746147128.590423:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967307557376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147128.590434:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147128.590447:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 25 pid: 9584 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.590577:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 25 pid: 9584 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.590594:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f391000/0x31399394250536e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76526 expref: 25 pid: 9584 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.590605:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.590607:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.590611:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250537b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.591430:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250537b5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.591608:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147128.591927:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307557376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1502us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.591936:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5820 00000100:00100000:0.0:1746147128.595181:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.595451:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307557504 00000100:00100000:1.0:1746147128.595460:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307557504 00010000:00010000:1.0:1746147128.595490:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 24 pid: 9584 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.595779:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5821 00000100:00100000:1.0:1746147128.595787:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967307557504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147128.595800:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147128.595817:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 24 pid: 9584 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.595828:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 24 pid: 9584 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.595845:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x313993942505370d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76534 expref: 24 pid: 9584 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.595857:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.595859:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.595862:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c11c00/0x31399394250537bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.595869:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c11c00/0x31399394250537bc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.597402:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147128.597993:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967307557504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2204us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.598001:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5821 00000100:00100000:0.0:1746147128.601588:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307557760 00000100:00100000:0.0:1746147128.601599:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307557760 00000100:00100000:0.0:1746147128.601655:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15023 00000100:00100000:0.0:1746147128.601663:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31818:x1830967307557760:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1746147128.601715:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.601742:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7c00/0x313993942505377d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7657a expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601773:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.601778:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147128.601803:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.601817:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250533e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7637b expref: 44 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601824:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425053404 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76382 expref: 24 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601830:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x313993942505336a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76319 expref: 44 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601836:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 44 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601843:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 24 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601848:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.601878:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 24 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.601890:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 24 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.601908:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310504960:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.603746:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 44 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.603759:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 44 pid: 16099 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.603770:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310505088:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.604179:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x313993942505336a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76319 expref: 44 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.604186:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x313993942505336a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76319 expref: 44 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.604194:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310505216:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.604227:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425053404 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76382 expref: 24 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.604234:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425053404 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76382 expref: 24 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.604240:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310505344:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147128.604255:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250533e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7637b expref: 44 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.604265:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250533e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7637b expref: 44 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.604271:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310505472:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.604281:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.606342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.606412:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307557888 00000100:00100000:1.0:1746147128.606420:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307557888 00010000:00010000:1.0:1746147128.606612:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 25 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.606640:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5822 00000100:00100000:1.0:1746147128.606649:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967307557888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147128.606661:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147128.606667:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 25 pid: 9138 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.606677:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 25 pid: 9138 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.606705:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942505337f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7632e expref: 25 pid: 9138 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.606719:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.606724:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.606734:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147128.606768:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307557888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 121us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.606775:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5822 00000100:00100000:0.0:1746147128.607331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.607354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.607367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.607385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.607404:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307558144 00000100:00100000:0.0:1746147128.607407:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307558144 00010000:00010000:0.0:1746147128.607421:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x313993942505336a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76319 expref: 45 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.607440:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307558016 00000100:00100000:0.0:1746147128.607443:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307558016 00010000:00010000:0.0:1746147128.607453:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 47 pid: 16099 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.607466:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307558272 00000100:00100000:0.0:1746147128.607468:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307558272 00010000:00010000:0.0:1746147128.607476:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425053404 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76382 expref: 24 pid: 9138 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.607486:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5824 00000100:00100000:0.0:1746147128.607492:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967307558016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.607501:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.607505:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 47 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.607516:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 47 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.608293:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425053371 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76320 expref: 43 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746147128.608305:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.608309:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.608316:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.608323:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.608347:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147128.608369:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307558016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 877us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.608376:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5824 00000100:00100000:1.0:1746147128.615499:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310505984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.615566:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.615912:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310505600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.615915:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310506496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.615939:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.615975:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310506112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.615990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.616431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.616436:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310506624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.616459:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310505728:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147128.616782:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.616789:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.616795:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.616800:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c11e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147128.616803:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.616809:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.616818:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.616820:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147128.616823:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.616827:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250537d8 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147128.617265:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310507008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.617289:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.617521:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310507520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.617538:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.617555:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507008 00000100:00100000:1.0:1746147128.617559:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507520 00000100:00100000:0.0:1746147128.617561:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507008 00000100:00100000:1.0:1746147128.617562:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507520 00000100:00100000:1.0:1746147128.617581:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13407 00000100:00100000:1.0:1746147128.617586:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3764:x1830967310505600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.617587:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13408 00000100:00100000:0.0:1746147128.617594:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3764:x1830967310506112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.617687:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13409 00000100:00100000:1.0:1746147128.617692:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3767:x1830967310506496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147128.617704:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147128.617707:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147128.617709:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147128.617711:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147128.617712:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147128.617741:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3764:x1830967310506112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (1750us total) trans 21474841227 rc 0/0 00000100:00100000:0.0:1746147128.617746:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13408 00000100:00100000:0.0:1746147128.617759:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13410 00000100:00100000:0.0:1746147128.617763:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3767:x1830967310507520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.617774:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967310506496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (1342us total) trans 17179873956 rc 0/0 00000100:00100000:1.0:1746147128.617780:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13409 00000100:00100000:1.0:1746147128.617793:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13411 00000100:00100000:1.0:1746147128.617798:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3767:x1830967310507008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.617825:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3767:x1830967310507520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (285us total) trans 21474841229 rc 0/0 00000100:00100000:0.0:1746147128.617830:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13410 00000100:00100000:0.0:1746147128.617848:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.617850:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967310507008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (560us total) trans 17179873957 rc 0/0 00000100:00100000:1.0:1746147128.617855:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13411 00000100:00100000:0.0:1746147128.617864:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310506240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.617866:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505728 00000100:00100000:1.0:1746147128.617868:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505728 00000100:00100000:1.0:1746147128.617879:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13412 00000100:00100000:0.0:1746147128.617880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.617883:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967310505728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.617888:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310506752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.617903:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.617910:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310507264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.617922:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.617939:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.617948:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310507136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.617961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147128.617985:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8a80/2, rc 0, transno 21474841227 00000100:00100000:0.0:1746147128.617989:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310506112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.618000:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506240 00000100:00100000:0.0:1746147128.618002:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506240 00000100:00100000:0.0:1746147128.618014:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506752 00000100:00100000:0.0:1746147128.618015:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506752 00000100:00100000:0.0:1746147128.618021:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507264 00000100:00100000:0.0:1746147128.618023:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507264 00000100:00100000:0.0:1746147128.618029:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506624 00000100:00100000:0.0:1746147128.618030:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506624 00000100:00100000:0.0:1746147128.618036:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507136 00000100:00100000:0.0:1746147128.618037:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507136 00000100:00100000:0.0:1746147128.618044:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13413 00000100:00100000:0.0:1746147128.618048:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967310506240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.618124:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3765:x1830967310506240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (242us total) trans 21474841230 rc 0/0 00000100:00100000:0.0:1746147128.618129:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13413 00000100:00100000:0.0:1746147128.618139:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13414 00000100:00100000:0.0:1746147128.618144:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3765:x1830967310506752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.618217:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3765:x1830967310506752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (312us total) trans 17179873958 rc 0/0 00000100:00100000:0.0:1746147128.618222:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13414 00000100:00100000:0.0:1746147128.618231:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13415 00000100:00100000:0.0:1746147128.618235:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3765:x1830967310507264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147128.618273:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147128.618276:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147128.618278:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147128.618279:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147128.618281:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147128.618300:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3765:x1830967310507264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (376us total) trans 17179873960 rc 0/0 00000100:00100000:0.0:1746147128.618309:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13415 00000100:00100000:0.0:1746147128.618320:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13417 00000100:00100000:0.0:1746147128.618324:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3764:x1830967310507136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147128.618366:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147128.618369:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147128.618370:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147128.618372:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147128.618374:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147128.618393:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967310507136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (430us total) trans 17179873962 rc 0/0 00000100:00100000:0.0:1746147128.618398:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13417 00000004:00080000:0.0:1746147128.618420:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fbb80/2, rc 0, transno 21474841230 00000100:00100000:0.0:1746147128.618423:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310506240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.618432:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d94e00/2, rc 0, transno 17179873958 00000100:00100000:1.0:1746147128.618434:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3765:x1830967310505728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 550us (584us total) trans 21474841231 rc 0/0 00000100:00100000:0.0:1746147128.618439:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310506752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.618440:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13412 00000004:00080000:0.0:1746147128.618445:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d97100/2, rc 0, transno 17179873960 00000100:00100000:0.0:1746147128.618447:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310507264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.618455:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fb480/2, rc 0, transno 21474841231 00000100:00100000:0.0:1746147128.618457:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310505728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.618469:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d94000/2, rc 0, transno 17179873961 00000100:00100000:0.0:1746147128.618471:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310506624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.618474:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967310505600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 889us (2535us total) trans 21474841228 rc 0/0 00000004:00080000:0.0:1746147128.618478:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d96300/2, rc 0, transno 17179873962 00000100:00100000:1.0:1746147128.618479:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13407 00000100:00100000:0.0:1746147128.618480:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310507136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.618489:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8700/2, rc 0, transno 21474841228 00000100:00100000:0.0:1746147128.618491:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310505600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147128.618506:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fb100/2, rc 0, transno 21474841229 00000100:00100000:1.0:1746147128.618511:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310507520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147128.618519:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d95f80/2, rc 0, transno 17179873959 00000100:00100000:1.0:1746147128.618522:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310505984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.618525:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1746147128.618529:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d96d80/2, rc 0, transno 17179873956 00000100:00100000:1.0:1746147128.618532:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310506496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.618532:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310507648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147128.618540:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d97480/2, rc 0, transno 17179873957 00000100:00100000:1.0:1746147128.618543:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310507008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.618551:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.618573:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507648 00000100:00100000:1.0:1746147128.618576:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507648 00000100:00100000:1.0:1746147128.618604:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13418 00000100:00100000:1.0:1746147128.618610:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+75:3765:x1830967310507648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.618680:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3765:x1830967310507648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (128us total) trans 17179873963 rc 0/0 00000100:00100000:1.0:1746147128.618685:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13418 00000004:00080000:0.0:1746147128.620652:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312eb100/2, rc 0, transno 17179873963 00000100:00100000:0.0:1746147128.620659:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310507648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.620701:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307558528 00000100:00100000:0.0:1746147128.620705:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307558528 00000100:00100000:0.0:1746147128.620769:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15024 00000100:00100000:0.0:1746147128.620775:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:31818:x1830967307558528:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147128.620791:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.620805:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x31399394250537df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7659d expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.620846:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x31399394250537df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7659d expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.620858:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6400/0x31399394250537df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7659d expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.620871:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.620873:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147128.620876:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6400, rc 0) 00000100:00100000:0.0:1746147128.620905:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31818:x1830967307558528:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 130us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.620910:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15024 00000100:00100000:0.0:1746147128.625029:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307558656 00000100:00100000:0.0:1746147128.625041:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307558656 00000100:00100000:0.0:1746147128.625117:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15025 00000100:00100000:0.0:1746147128.625127:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31818:x1830967307558656:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147128.625148:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.625167:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250537e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765a4 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.625277:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x31399394250537ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.625291:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x31399394250537ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.625301:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x31399394250537ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147128.625326:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147128.625330:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147128.625344:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x31399394250537ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147128.625368:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250537e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765a4 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.625402:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x31399394250537ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765a4 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.625410:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.625412:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147128.625415:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db32800, rc 0) 00000100:00100000:0.0:1746147128.625465:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:31818:x1830967307558656:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 339us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.625471:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15025 00000100:00100000:0.0:1746147128.630388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.630428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.631674:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.631695:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.631706:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.631733:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.631758:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307559040 00000100:00100000:0.0:1746147128.631766:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307559040 00000100:00100000:1.0:1746147128.631916:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307558912 00000100:00100000:1.0:1746147128.631923:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307558912 00000100:00100000:0.0:1746147128.632414:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307559168 00000100:00100000:0.0:1746147128.632417:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307559168 00000100:00100000:1.0:1746147128.632581:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307559424 00000100:00100000:1.0:1746147128.632584:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307559424 00000100:00100000:0.0:1746147128.633217:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13426 00000100:00100000:0.0:1746147128.633223:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307559168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147128.633230:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.633238:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765c0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147128.633249:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141738, atime: 0x68141736, ctime: 0x68141738, blocks: 0x800 00010000:00010000:0.0:1746147128.633259:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.633260:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.633265:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 19 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.633274:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 19 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.633285:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:0.0:1746147128.633306:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2000:x1830967307559168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 84us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.633311:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13426 00000100:00100000:0.0:1746147128.633344:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13427 00000100:00100000:0.0:1746147128.633349:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967307558912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147128.633355:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.633365:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425053810 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765b2 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147128.633379:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141738, atime: 0x68141738, ctime: 0x68141738, blocks: 0x808 00010000:00010000:0.0:1746147128.633386:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.633388:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.633391:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425053810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b2 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.633399:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425053810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b2 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147128.633405:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33400, rc 0) 00000100:00100000:0.0:1746147128.633420:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307558912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 71us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.633425:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13427 00000100:00100000:1.0:1746147128.633492:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13428 00000100:00100000:1.0:1746147128.633498:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307559424:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147128.633504:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.633513:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765ce expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147128.633523:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141737, atime: 0x68141736, ctime: 0x68141737, blocks: 0x1008 00010000:00010000:1.0:1746147128.633530:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.633532:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.633536:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ce expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.633545:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ce expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.633552:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b6a00, rc 0) 00000100:00100000:1.0:1746147128.633569:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307559424:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 71us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.633574:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13428 00000100:00100000:0.0:1746147128.637576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.638912:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.638941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.638971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.638985:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.639006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.639026:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307559552 00000100:00100000:0.0:1746147128.639033:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307559552 00000100:00100000:0.0:1746147128.639301:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307559680 00000100:00100000:0.0:1746147128.639304:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307559680 00000100:00100000:1.0:1746147128.639359:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307559936 00000100:00100000:1.0:1746147128.639369:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307559936 00000100:00100000:1.0:1746147128.639413:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307560064 00000100:00100000:1.0:1746147128.639415:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307560064 00000100:00100000:1.0:1746147128.639436:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13430 00000100:00100000:1.0:1746147128.639443:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307559680:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147128.639523:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307559680:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 80us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.639529:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13430 00000100:00100000:1.0:1746147128.639542:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13432 00000100:00100000:1.0:1746147128.639546:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307560192:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147128.639577:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307560192:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.639583:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13432 00000100:00100000:1.0:1746147128.639594:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13434 00000100:00100000:1.0:1746147128.639598:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307560064:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147128.639634:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307560064:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.639639:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13434 00000100:00100000:0.0:1746147128.645675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.646882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.646903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.646930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.647145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.647159:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307560320 00000100:00100000:1.0:1746147128.647170:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307560320 00000100:00100000:1.0:1746147128.647220:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307560576 00000100:00100000:1.0:1746147128.647222:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307560576 00000100:00100000:1.0:1746147128.647233:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307560832 00000100:00100000:1.0:1746147128.647234:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307560832 00000100:00100000:1.0:1746147128.647243:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307560448 00000100:00100000:1.0:1746147128.647244:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307560448 00000100:00100000:1.0:1746147128.647259:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13435 00000100:00100000:1.0:1746147128.647266:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2002:x1830967307560320:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147128.647377:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2002:x1830967307560320:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 111us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.647387:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13435 00000100:00100000:1.0:1746147128.647402:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13437 00000100:00100000:1.0:1746147128.647406:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2002:x1830967307560832:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147128.647436:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2002:x1830967307560832:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.647441:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13437 00000100:00100000:0.0:1746147128.647616:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.653441:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307561088 00000100:00100000:1.0:1746147128.653451:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307561088 00000100:00100000:1.0:1746147128.653506:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13441 00000100:00100000:1.0:1746147128.653514:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307561088:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147128.653715:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147128.653719:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.653721:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147128.653723:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.653725:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147128.653782:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307561088:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 268us (449us total) trans 21474841235 rc 0/0 00000100:00100000:1.0:1746147128.653789:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13441 00000100:00100000:0.0:1746147128.658950:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.659046:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307561216 00000100:00100000:1.0:1746147128.659055:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307561216 00000100:00100000:1.0:1746147128.659195:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13442 00000100:00100000:1.0:1746147128.659214:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2000:x1830967307561216:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147128.659367:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147128.659371:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.659374:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147128.659375:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.659377:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147128.659427:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2000:x1830967307561216:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 214us (484us total) trans 17179873965 rc 0/0 00000100:00100000:1.0:1746147128.659433:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13442 00000100:00100000:0.0:1746147128.664227:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.664265:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.666048:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.670240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.670769:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307562240 00000100:00100000:1.0:1746147128.670776:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307562240 00000100:00100000:1.0:1746147128.670821:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3020 00000100:00100000:1.0:1746147128.670827:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307562240:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:0.0:1746147128.670845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147128.670850:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.670855:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307562496 00000100:00100000:0.0:1746147128.670858:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307562496 00010000:00010000:1.0:1746147128.670860:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.670861:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.670865:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.670873:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.670879:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3021 00000100:00100000:0.0:1746147128.670884:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2000:x1830967307562496:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147128.670898:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505383a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.670906:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.670907:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.670910:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505383a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.670918:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505383a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.671424:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.671437:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307562752 00000100:00100000:1.0:1746147128.671439:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307562752 00000100:00100000:1.0:1746147128.671458:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3022 00000100:00100000:1.0:1746147128.671462:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2000:x1830967307562752:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147128.671475:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.671485:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.671486:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.671489:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.671495:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.671531:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.671543:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307563008 00000100:00100000:0.0:1746147128.671546:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307563008 00000100:00100000:0.0:1746147128.671580:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3023 00000100:00100000:0.0:1746147128.671585:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2000:x1830967307563008:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147128.671597:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425053848 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.671604:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.671606:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.671608:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425053848 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.671615:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425053848 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680595:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680605:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680613:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680620:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f390c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147128.680623:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680629:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680643:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.680649:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x313993942505381e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.680704:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2000:x1830967307561600:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 14280us (16484us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746147128.680711:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3017 00010000:00010000:0.0:1746147128.684003:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.684021:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.684029:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.684036:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f391400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147128.684041:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.684049:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.684067:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.684074:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f391400/0x3139939425053825 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.684173:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2000:x1830967307561856:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17154us (19902us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147128.684183:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3018 00010000:00010000:1.0:1746147128.693491:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.693516:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.693524:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.693531:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dacf400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147128.693535:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.693543:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.693562:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.693567:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425053833 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.693727:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2000:x1830967307562240:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 22894us (23485us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147128.693737:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3020 00010000:00010000:1.0:1746147128.700916:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.700935:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.700942:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.700949:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147128.700953:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.700962:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.700982:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.700987:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425053841 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147128.701118:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2000:x1830967307562752:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 29624us (29663us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147128.701132:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3022 00000100:00100000:0.0:1746147128.716738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.721747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.722274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.722474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.723084:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307564032 00000100:00100000:0.0:1746147128.723101:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307564032 00000100:00100000:0.0:1746147128.723121:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13444 00000100:00100000:0.0:1746147128.723126:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307563776:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147128.723197:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147128.723211:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723213:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723215:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723217:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147128.723265:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307563776:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 137us (990us total) trans 21474841236 rc 0/0 00000100:00100000:0.0:1746147128.723271:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13444 00000100:00100000:0.0:1746147128.723287:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13445 00000100:00100000:0.0:1746147128.723291:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2001:x1830967307564032:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147128.723329:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147128.723332:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723333:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147126 -> 1746147128 00002000:00010000:0.0:1746147128.723335:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723337:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147128.723351:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2001:x1830967307564032:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 60us (878us total) trans 17179873967 rc 0/0 00000100:00100000:0.0:1746147128.723356:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13445 00000100:00100000:0.0:1746147128.723385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.723400:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307564288 00000100:00100000:0.0:1746147128.723402:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307564288 00000100:00100000:0.0:1746147128.723414:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13446 00000100:00100000:0.0:1746147128.723417:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307564288:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147128.723458:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147128.723460:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147127 -> 1746147128 00002000:00010000:0.0:1746147128.723462:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147126 -> 1746147128 00002000:00010000:0.0:1746147128.723463:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147127 -> 1746147128 00002000:00010000:0.0:1746147128.723465:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147128.723480:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2001:x1830967307564288:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 62us (94us total) trans 21474841237 rc 0/0 00000100:00100000:0.0:1746147128.723488:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13446 00000100:00100000:0.0:1746147128.723535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.723545:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307563904 00000100:00100000:0.0:1746147128.723548:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307563904 00000100:00100000:0.0:1746147128.723562:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13447 00000100:00100000:0.0:1746147128.723566:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2001:x1830967307563904:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147128.723603:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147128.723605:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723607:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723608:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723610:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147128.723623:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2001:x1830967307563904:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 57us (88us total) trans 21474841238 rc 0/0 00000100:00100000:0.0:1746147128.723627:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13447 00000100:00100000:0.0:1746147128.723662:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.723671:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307564160 00000100:00100000:0.0:1746147128.723673:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307564160 00000100:00100000:0.0:1746147128.723684:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13448 00000100:00100000:0.0:1746147128.723688:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2001:x1830967307564160:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147128.723722:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147128.723724:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723726:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147127 -> 1746147128 00002000:00010000:0.0:1746147128.723728:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.723729:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147128.723741:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2001:x1830967307564160:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 52us (79us total) trans 17179873968 rc 0/0 00000100:00100000:0.0:1746147128.723746:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13448 00000100:00100000:0.0:1746147128.728042:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.735451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.741460:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310508160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.741522:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.741560:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310508672:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147128.741587:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.741601:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.741608:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.741636:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43600 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:1.0:1746147128.741641:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147128.741641:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.741647:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147128.741658:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310509184:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147128.741668:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.741671:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746147128.741672:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147128.741675:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.741680:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053856 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147128.741683:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310509696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.741693:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.741705:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147128.741709:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310509568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.741720:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.741724:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310507904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.741741:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13449 00000100:00100000:1.0:1746147128.741748:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:3767:x1830967310508160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.741780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.741812:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.741828:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.741837:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.741846:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507904 00000100:00100000:1.0:1746147128.741849:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507904 00000100:00100000:0.0:1746147128.741854:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.741861:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508928 00000100:00100000:0.0:1746147128.741862:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310509440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.741863:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508928 00000100:00100000:1.0:1746147128.741871:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13454 00000100:00100000:1.0:1746147128.741875:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+72:3767:x1830967310509696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.741880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.741893:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746147128.741897:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.741912:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.741918:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.741932:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.741942:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310509312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.741951:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3767:x1830967310509696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (256us total) trans 21474841239 rc 0/0 00000100:00100000:0.0:1746147128.741955:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.741956:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13454 00000100:00100000:0.0:1746147128.741962:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310509824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.741964:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508288 00000100:00100000:1.0:1746147128.741967:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508288 00000100:00100000:1.0:1746147128.741975:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509056 00000100:00100000:0.0:1746147128.741975:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.741976:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509056 00000100:00100000:1.0:1746147128.741983:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508800 00000100:00100000:1.0:1746147128.741985:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508800 00000100:00100000:1.0:1746147128.741990:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509824 00000100:00100000:1.0:1746147128.741992:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509824 00000100:00100000:1.0:1746147128.742000:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13456 00000100:00100000:1.0:1746147128.742004:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3765:x1830967310507904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.742009:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13458 00000100:00100000:0.0:1746147128.742020:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967310508928:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147128.742044:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e501180/2, rc 0, transno 21474841241 00000100:00100000:1.0:1746147128.742047:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310509568:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147128.742055:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e501c00/2, rc 0, transno 21474841240 00000100:00100000:1.0:1746147128.742057:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310509184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147128.742062:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e503480/2, rc 0, transno 21474841239 00000100:00100000:1.0:1746147128.742065:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310509696:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147128.742128:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147128.742130:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742132:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742134:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742135:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147128.742151:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+89:3766:x1830967310508032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 402us (584us total) trans 17179873974 rc 0/0 00000100:00100000:1.0:1746147128.742156:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13450 00000100:00100000:1.0:1746147128.742163:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13463 00000100:00100000:1.0:1746147128.742166:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967310509824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.742224:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967310509824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (247us total) trans 21474841244 rc 0/0 00000100:00100000:1.0:1746147128.742230:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13463 00002000:00010000:1.0:1746147128.742254:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147128.742256:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742258:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742259:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742261:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:1.0:1746147128.742277:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+87:3767:x1830967310508160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 531us (756us total) trans 17179873971 rc 0/0 00000100:00100000:1.0:1746147128.742281:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13449 00002000:00010000:1.0:1746147128.742301:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147128.742303:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.742304:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147128.742306:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.742307:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147128.742321:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3767:x1830967310508672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 549us (680us total) trans 17179873970 rc 0/0 00000100:00100000:1.0:1746147128.742326:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13452 00000004:00080000:1.0:1746147128.742344:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e486a00/2, rc 0, transno 17179873971 00000100:00100000:1.0:1746147128.742347:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310508160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147128.742353:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e502a00/2, rc 0, transno 17179873970 00000100:00100000:1.0:1746147128.742356:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310508672:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147128.742373:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147128.742375:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742377:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742379:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.742381:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147128.742394:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967310507904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 390us (616us total) trans 17179873972 rc 0/0 00000100:00100000:1.0:1746147128.742399:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13456 00002000:00010000:0.0:1746147128.742505:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147128.742508:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.742510:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.742512:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.742514:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147128.742542:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967310508928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 525us (685us total) trans 21474841246 rc 0/0 00000100:00100000:0.0:1746147128.742548:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13458 00000100:00100000:0.0:1746147128.742567:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147128.742573:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310509952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.742592:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147128.742637:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e486680/2, rc 0, transno 17179873975 00000100:00100000:0.0:1746147128.742642:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.742650:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e500380/2, rc 0, transno 17179873976 00000100:00100000:0.0:1746147128.742653:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.742661:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e500000/2, rc 0, transno 21474841245 00000100:00100000:0.0:1746147128.742664:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310509312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.742671:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce680/2, rc 0, transno 21474841244 00000100:00100000:0.0:1746147128.742673:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310509824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.742681:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487100/2, rc 0, transno 17179873972 00000100:00100000:0.0:1746147128.742683:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310507904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.742690:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487800/2, rc 0, transno 17179873973 00000100:00100000:0.0:1746147128.742692:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.742696:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e503800/2, rc 0, transno 21474841246 00000100:00100000:0.0:1746147128.742698:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310508928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.742705:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e503100/2, rc 0, transno 21474841242 00000100:00100000:0.0:1746147128.742707:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310509440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.743137:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801323d7480/2, rc 0, transno 17179873977 00000100:00100000:0.0:1746147128.743140:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310509952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.744606:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.746585:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.767916:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.768030:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307565312 00000100:00100000:1.0:1746147128.768038:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307565312 00000100:00100000:1.0:1746147128.768667:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15028 00000100:00100000:1.0:1746147128.768675:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:31829:x1830967307565312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.768696:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.768711:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505386b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765dc expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.768771:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768782:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768790:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768800:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768806:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768810:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768894:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425053880 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768904:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425053880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768910:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425053880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147128.768917:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147128.768973:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768978:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768982:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768987:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.768993:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147128.768996:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769001:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769010:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147128.769012:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147128.769015:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769020:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42c00/0x3139939425053872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769055:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769060:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769064:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769068:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147128.769070:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769074:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769079:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dde00) 00010000:00010000:1.0:1746147128.769081:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147128.769082:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769086:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43600/0x3139939425053879 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.769132:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505386b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765dc expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.769142:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425053880 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765dc expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.769147:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.769149:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147128.769152:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43000, rc 0) 00000100:00100000:1.0:1746147128.769196:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:31829:x1830967307565312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 522us (1289us total) trans 8589935653 rc 0/0 00000100:00100000:1.0:1746147128.769210:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15028 00000100:00100000:0.0:1746147128.773458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.773529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.773595:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307565440 00000100:00100000:1.0:1746147128.773603:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307565440 00000100:00100000:1.0:1746147128.773638:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13466 00000100:00100000:1.0:1746147128.773644:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:31829:x1830967307565440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.773657:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.773670:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765e3 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.773689:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.773690:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.773695:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765e3 expref: 26 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.773706:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765e3 expref: 26 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.773714:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c11800, rc 0) 00000100:00100000:1.0:1746147128.773746:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:31829:x1830967307565440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.773751:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13466 00000100:00100000:0.0:1746147128.775383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.775445:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307565952 00000100:00100000:1.0:1746147128.775449:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307565952 00000100:00100000:1.0:1746147128.775485:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15030 00000100:00100000:1.0:1746147128.775491:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:31830:x1830967307565952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.775503:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.775511:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11c00/0x31399394250538a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765f1 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.775549:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775557:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775564:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775574:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775579:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775583:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775643:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250538b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775650:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250538b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775654:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250538b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147128.775661:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147128.775714:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775720:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775724:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775729:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775733:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c10400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147128.775736:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775741:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775749:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147128.775751:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147128.775754:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775759:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250538aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775784:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775788:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775792:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775796:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c11e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147128.775798:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775802:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775807:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369ddb00) 00010000:00010000:1.0:1746147128.775809:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147128.775811:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775815:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11e00/0x31399394250538b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147128.775842:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11c00/0x31399394250538a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765f1 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.775851:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250538b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765f1 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.775856:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.775858:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147128.775859:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00000100:00100000:1.0:1746147128.775884:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:31830:x1830967307565952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 393us (503us total) trans 8589935654 rc 0/0 00000100:00100000:1.0:1746147128.775890:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15030 00000100:00100000:0.0:1746147128.776935:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.778763:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.791536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.791577:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.791667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.791752:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307566720 00000100:00100000:1.0:1746147128.791761:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307566720 00000100:00100000:1.0:1746147128.791794:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307566976 00000100:00100000:1.0:1746147128.791796:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307566976 00000100:00100000:1.0:1746147128.791812:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13467 00000100:00100000:1.0:1746147128.791820:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:31830:x1830967307566720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.791836:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.791852:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e765ff expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.791876:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.791878:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.791885:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ff expref: 41 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.791899:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ff expref: 41 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.791908:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43000, rc 0) 00000100:00100000:1.0:1746147128.791947:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:31830:x1830967307566720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 127us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.791953:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13467 00000100:00100000:1.0:1746147128.791965:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13468 00000100:00100000:1.0:1746147128.791970:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+23:31829:x1830967307566976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.791977:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.791985:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x31399394250538f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76606 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.791995:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.791996:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.792000:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x31399394250538f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76606 expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.792014:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x31399394250538f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76606 expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.792020:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42c00, rc 0) 00000100:00100000:1.0:1746147128.792035:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:31829:x1830967307566976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 65us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.792039:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13468 00000100:00100000:0.0:1746147128.796726:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307567104 00000100:00100000:0.0:1746147128.796737:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307567104 00000100:00100000:0.0:1746147128.796782:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15032 00000100:00100000:0.0:1746147128.796789:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:31827:x1830967307567104:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147128.796807:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.796810:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746147128.796832:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x31399394250538e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765f8 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.796852:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250538b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765f1 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.796861:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147128.796865:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147128.796875:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250538fe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7660d expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.796920:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.796930:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425053864 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765d5 expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.796939:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147128.796964:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425053864 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765d5 expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.796974:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425053864 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765d5 expref: 7 pid: 16099 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746147128.796984:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310510208:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147128.797438:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147128.801084:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307567232 00000100:00100000:1.0:1746147128.801120:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307567232 00000100:00100000:1.0:1746147128.801186:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307567360 00000100:00100000:1.0:1746147128.801190:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307567360 00000100:00100000:1.0:1746147128.801230:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15033 00000100:00100000:1.0:1746147128.801241:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:31830:x1830967307567232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.801266:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.801290:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11c00/0x313993942505390c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76614 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.801352:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147128.801360:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11c00/0x313993942505390c lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76614 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.801381:0:7237:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147128.801397:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11c00/0x313993942505390c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76614 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.801411:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.801415:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147128.801417:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147128.801424:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c11c00, rc 0) 00000100:00100000:1.0:1746147128.801487:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:31830:x1830967307567232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 246us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.801495:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15033 00000100:00100000:0.0:1746147128.804693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.804835:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307567488 00000100:00100000:1.0:1746147128.804843:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307567488 00010000:00010000:1.0:1746147128.804877:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425053864 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765d5 expref: 8 pid: 16099 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.804909:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5829 00000100:00100000:1.0:1746147128.804916:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307567488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147128.804928:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147128.804934:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425053864 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765d5 expref: 8 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.804944:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425053864 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765d5 expref: 8 pid: 16099 timeout: 766 lvb_type: 0 00010000:00010000:1.0:1746147128.804967:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147128.804971:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147128.804984:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147128.804990:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425053905 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147128.805002:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11c00/0x313993942505390c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76614 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.805016:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147128.805058:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307567488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 142us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.805065:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5829 00000100:00100000:1.0:1746147128.819704:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310510464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.819757:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310510592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.820699:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.820728:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310510976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.820749:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.820773:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13472 00000100:00100000:1.0:1746147128.820779:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3767:x1830967310510976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147128.820840:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147128.820843:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.820845:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147128.820846:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.820848:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147128.821517:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3767:x1830967310510976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 736us (765us total) trans 21474841250 rc 0/0 00000100:00100000:1.0:1746147128.821533:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13472 00000100:00100000:0.0:1746147128.821550:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147128.821566:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094573100/2, rc 0, transno 21474841250 00000100:00100000:1.0:1746147128.821571:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310510976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.821572:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310511104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.821583:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310510592 00000100:00100000:1.0:1746147128.821587:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310510592 00000100:00100000:0.0:1746147128.821589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.821607:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511104 00000100:00100000:1.0:1746147128.821609:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511104 00000100:00100000:0.0:1746147128.821612:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147128.821617:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310510720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147128.821620:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13473 00000100:00100000:1.0:1746147128.821624:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3764:x1830967310510592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.821634:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.821648:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310511232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147128.821672:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147128.821673:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147128.821675:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.821677:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.821679:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.821680:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147128.821706:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+87:3764:x1830967310510592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (155us total) trans 21474841251 rc 0/0 00000100:00100000:1.0:1746147128.821713:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13473 00000100:00100000:1.0:1746147128.821725:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13475 00000100:00100000:1.0:1746147128.821729:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3764:x1830967310510720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147128.821774:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147128.821776:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.821778:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147128.821779:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310512000:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147128.821780:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.821781:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147128.821802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.821805:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+87:3764:x1830967310510720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (170us total) trans 21474841253 rc 0/0 00000100:00100000:1.0:1746147128.821811:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13475 00000100:00100000:0.0:1746147128.821812:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310512512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.821820:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512000 00000100:00100000:1.0:1746147128.821823:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512000 00000100:00100000:0.0:1746147128.821824:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.821832:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512512 00000100:00100000:0.0:1746147128.821832:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147128.821834:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512512 00000100:00100000:0.0:1746147128.821836:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310511872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.821842:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13477 00000100:00100000:1.0:1746147128.821845:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+87:3765:x1830967310512000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.821849:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.821856:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310512384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.821869:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.821881:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310511616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.821895:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147128.821900:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310512128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.821918:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.821929:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+90:3765:x1830967310512000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (126us total) trans 17179873978 rc 0/0 00000100:00100000:0.0:1746147128.821929:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147128.821933:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310511744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.821935:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13477 00000100:00100000:0.0:1746147128.821946:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.821949:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511616 00000100:00100000:1.0:1746147128.821952:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511616 00000100:00100000:0.0:1746147128.821954:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310512256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.821961:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512128 00000100:00100000:1.0:1746147128.821963:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512128 00000100:00100000:0.0:1746147128.821965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147128.821970:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511744 00000100:00100000:1.0:1746147128.821972:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511744 00000100:00100000:1.0:1746147128.821978:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512256 00000100:00100000:1.0:1746147128.821981:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512256 00000100:00100000:1.0:1746147128.821989:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13479 00000004:00080000:0.0:1746147128.821991:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e320700/2, rc 0, transno 17179873978 00000100:00100000:1.0:1746147128.821993:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3765:x1830967310511872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.821999:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310512000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.822006:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13480 00000100:00100000:1.0:1746147128.822010:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3765:x1830967310512384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.822021:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13481 00000100:00100000:0.0:1746147128.822022:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310512640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.822025:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:3766:x1830967310511616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.822035:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13482 00000100:00100000:1.0:1746147128.822039:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:3766:x1830967310512128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.822051:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13483 00000100:00100000:1.0:1746147128.822055:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3766:x1830967310511744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147128.823252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147128.823293:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f57100/2, rc 0, transno 17179873979 00000100:00100000:0.0:1746147128.823298:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310512512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.823315:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094571f80/2, rc 0, transno 21474841253 00000100:00100000:0.0:1746147128.823318:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310510720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.823325:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094571880/2, rc 0, transno 21474841254 00000100:00100000:0.0:1746147128.823327:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310511232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.823339:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094573b80/2, rc 0, transno 21474841251 00000100:00100000:0.0:1746147128.823341:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310510592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.823347:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094573480/2, rc 0, transno 21474841252 00000100:00100000:0.0:1746147128.823349:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310511104:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147128.823522:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147128.823527:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.823529:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.823531:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.823533:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147128.823570:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+96:3766:x1830967310511744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1513us (1621us total) trans 17179873980 rc 0/0 00000100:00100000:1.0:1746147128.823578:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13483 00000100:00100000:1.0:1746147128.823595:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13485 00000100:00100000:1.0:1746147128.823602:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+95:3766:x1830967310512640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.823675:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+95:3766:x1830967310512640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (425us total) trans 17179873982 rc 0/0 00000100:00100000:1.0:1746147128.823680:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13485 00002000:00010000:1.0:1746147128.823736:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147128.823739:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.823741:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.823742:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:1.0:1746147128.823744:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:1.0:1746147128.823766:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3765:x1830967310511872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1773us (1916us total) trans 17179873983 rc 0/0 00000100:00100000:1.0:1746147128.823771:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13479 00000004:00080000:0.0:1746147128.823856:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e323480/2, rc 0, transno 17179873983 00000100:00100000:0.0:1746147128.823860:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310511872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.823875:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098821f80/2, rc 0, transno 17179873982 00000100:00100000:0.0:1746147128.823877:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310512640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.823885:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e321f80/2, rc 0, transno 17179873980 00000100:00100000:0.0:1746147128.823887:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310511744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.823892:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e321c00/2, rc 0, transno 17179873981 00000100:00100000:0.0:1746147128.823894:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310512256:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147128.826436:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147128.826441:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.826443:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147128.826445:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147128.826447:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147128.826482:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+95:3765:x1830967310512384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4470us (4610us total) trans 17179873984 rc 0/0 00000004:00080000:0.0:1746147128.826546:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094572680/2, rc 0, transno 21474841249 00000100:00100000:0.0:1746147128.826552:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310510464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147128.826575:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f56a00/2, rc 0, transno 17179873984 00000100:00100000:0.0:1746147128.826582:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310512384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147128.826599:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094572300/2, rc 0, transno 21474841247 00000100:00100000:0.0:1746147128.826602:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310510336:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147128.826674:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147128.826677:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.826679:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.826681:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147128 -> 1746147128 00002000:00010000:0.0:1746147128.826683:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147128.826707:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3766:x1830967310511616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4681us (4811us total) trans 17179873985 rc 0/0 00000100:00100000:0.0:1746147128.826713:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13481 00000004:00080000:0.0:1746147128.826734:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e323b80/2, rc 0, transno 17179873985 00000100:00100000:0.0:1746147128.826736:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310511616:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147128.826786:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:0.0:1746147128.826788:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:0.0:1746147128.826790:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147128.826791:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147128.826793:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147128.826815:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+96:3766:x1830967310512128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4775us (4894us total) trans 17179873986 rc 0/0 00000100:00100000:0.0:1746147128.826820:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13482 00000004:00080000:0.0:1746147128.826838:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e322d80/2, rc 0, transno 17179873986 00000100:00100000:0.0:1746147128.826841:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310512128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147128.826882:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13480 00000100:00100000:0.0:1746147128.827282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.827350:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.827368:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307567616 00000100:00100000:0.0:1746147128.827373:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307567616 00000100:00100000:0.0:1746147128.827394:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307567744 00000100:00100000:0.0:1746147128.827397:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307567744 00000100:00100000:0.0:1746147128.827407:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5315 00000100:00100000:0.0:1746147128.827412:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:31829:x1830967307567616:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147128.827460:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:31829:x1830967307567616:12345-192.168.204.25@tcp:49:cat.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.827466:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5315 00000100:00100000:0.0:1746147128.827475:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5316 00000100:00100000:0.0:1746147128.827479:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:31830:x1830967307567744:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147128.827508:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:31830:x1830967307567744:12345-192.168.204.25@tcp:49:cat.0 Request processed in 28us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.827512:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5316 00000100:00100000:0.0:1746147128.832831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.837438:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.850263:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.850303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.850826:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307568512 00000100:00100000:1.0:1746147128.850836:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307568512 00000100:00100000:1.0:1746147128.850884:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13486 00000100:00100000:1.0:1746147128.850891:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:31827:x1830967307568512:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147128.850908:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.851576:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76622 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.851611:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 21 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.851619:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.851620:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.851623:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1343488->1462271] (req 1343488->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.851655:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 21 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147128.851667:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 21 pid: 17600 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.851683:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310512768:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.852261:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.861105:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307568640 00000100:00100000:0.0:1746147128.861113:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307568640 00000100:00100000:0.0:1746147128.861149:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13487 00000100:00100000:0.0:1746147128.861156:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:31830:x1830967307568640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147128.861172:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147128.861187:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x3139939425053921 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76629 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.861218:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.861220:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.861227:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x3139939425053921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76629 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.861239:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x3139939425053921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76629 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.861249:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7800, rc 0) 00000100:00100000:0.0:1746147128.861286:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:31830:x1830967307568640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147128.861292:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13487 00000100:00100000:0.0:1746147128.862302:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307568768 00000100:00100000:0.0:1746147128.862306:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307568768 00010000:00010000:0.0:1746147128.862327:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 22 pid: 17600 timeout: 766 lvb_type: 1 00000100:00100000:0.0:1746147128.862344:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5830 00000100:00100000:0.0:1746147128.862349:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307568768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147128.862357:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147128.862370:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 22 pid: 17600 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.862379:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 22 pid: 17600 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746147128.862393:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.862394:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147128.862398:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.862404:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147128.862428:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147128.862439:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013486a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310512896:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147128.862651:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x31399394250537f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b9 expref: 22 pid: 17600 timeout: 766 lvb_type: 1 00000100:00100000:1.0:1746147128.862679:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094570000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310512768:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.862698:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.862704:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e81000, rc 0) 00000100:00100000:1.0:1746147128.862722:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:31827:x1830967307568512:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11832us (12418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.862727:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13486 00000100:00100000:0.0:1746147128.872010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.872923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147128.873953:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147128.874019:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307569152 00000100:00100000:1.0:1746147128.874023:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307569152 00000100:00100000:1.0:1746147128.874052:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13488 00000100:00100000:1.0:1746147128.874058:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:31829:x1830967307569152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.874067:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.874082:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76630 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.874114:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 38 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.874126:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.874128:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.874131:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76630 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.874149:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 38 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.874158:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x313993942505391a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1462271) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76622 expref: 38 pid: 9585 timeout: 766 lvb_type: 0 00000100:00100000:1.0:1746147128.874167:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310513152:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147128.874216:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147128.882267:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.882861:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094570000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310513152:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147128.882882:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76630 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.882898:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeea00, rc 0) 00000100:00100000:1.0:1746147128.882921:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:31829:x1830967307569152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8864us (10000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.882928:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13488 00000100:00100000:0.0:1746147128.887350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.895394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.901572:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.902386:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307570176 00000100:00100000:1.0:1746147128.902393:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307570176 00000100:00100000:1.0:1746147128.902616:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13489 00000100:00100000:1.0:1746147128.902624:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:31830:x1830967307570176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.902638:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.902657:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76637 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.902681:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147128.902686:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76637 expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.902850:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76637 expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.902861:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee800, rc 0) 00000100:00100000:1.0:1746147128.903482:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:31830:x1830967307570176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 858us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.903487:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13489 00000100:00100000:0.0:1746147128.903782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.903820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.903863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.918599:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.934592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.934645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.959836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.960085:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307571584 00000100:00100000:1.0:1746147128.960144:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307571584 00000100:00100000:1.0:1746147128.960212:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13490 00000100:00100000:1.0:1746147128.960222:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:31829:x1830967307571584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147128.960242:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147128.960260:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7663e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.960285:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.960287:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147128.960294:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.960314:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147128.960324:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714200, rc 0) 00000100:00100000:1.0:1746147128.960378:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:31829:x1830967307571584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 156us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147128.960384:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13490 00000100:00100000:0.0:1746147128.967138:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.967650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.974084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.982297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.987062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.988209:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.990505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147128.994317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147128.997392:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.001180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.001225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.045812:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.047464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.054239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.054266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.054330:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307574784 00000100:00100000:0.0:1746147129.054338:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307574784 00010000:00010000:0.0:1746147129.054373:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425053959 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76668 expref: 40 pid: 12201 timeout: 767 lvb_type: 1 00000100:00100000:1.0:1746147129.054758:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307574912 00000100:00100000:1.0:1746147129.054762:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307574912 00010000:00010000:1.0:1746147129.054776:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ce expref: 21 pid: 1136 timeout: 767 lvb_type: 1 00000100:00100000:1.0:1746147129.054919:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5833 00000100:00100000:1.0:1746147129.054925:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307574784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.054938:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.054958:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425053959 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76668 expref: 40 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.054967:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425053959 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76668 expref: 40 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.054994:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425053959 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76668 expref: 40 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.055009:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.055026:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307574784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.055032:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5833 00000100:00100000:1.0:1746147129.055045:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5834 00000100:00100000:1.0:1746147129.055049:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2001:x1830967307574912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.055054:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.055060:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ce expref: 21 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.055068:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ce expref: 21 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.055079:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b6a00/0x3139939425053817 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ce expref: 21 pid: 1136 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.055997:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.056010:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307575040 00000100:00100000:0.0:1746147129.056014:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307575040 00010000:00010000:0.0:1746147129.056031:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093714000/0x3139939425053952 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7665a expref: 27 pid: 1136 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.056053:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5835 00000100:00100000:0.0:1746147129.056058:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967307575040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.056065:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.056074:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093714000/0x3139939425053952 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7665a expref: 27 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.056082:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093714000/0x3139939425053952 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7665a expref: 27 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.056113:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093714000/0x3139939425053952 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7665a expref: 27 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.056128:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.056130:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.056138:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 26 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.056145:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 26 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.056178:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 26 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.056191:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310514432:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147129.056262:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147129.056553:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.056609:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307574912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1558us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.056617:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5834 00000100:00100000:0.0:1746147129.063662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.072719:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.078528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.078603:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.078626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.078657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.078697:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307575552 00000100:00100000:0.0:1746147129.078704:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307575552 00010000:00010000:0.0:1746147129.078743:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7664c expref: 31 pid: 12201 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.078768:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307575680 00000100:00100000:0.0:1746147129.078770:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307575680 00010000:00010000:0.0:1746147129.078779:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x31399394250538f7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76606 expref: 26 pid: 1136 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.078793:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307575936 00000100:00100000:0.0:1746147129.078794:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307575936 00010000:00010000:0.0:1746147129.078802:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425053810 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b2 expref: 20 pid: 1398 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.078811:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307575808 00000100:00100000:0.0:1746147129.078813:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307575808 00010000:00010000:0.0:1746147129.078822:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x3139939425053921 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76629 expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.078833:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5836 00000100:00100000:0.0:1746147129.078840:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967307575552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.078853:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.078874:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7664c expref: 31 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.078885:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7664c expref: 31 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.078910:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053944 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7664c expref: 31 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.078930:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.078931:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.078939:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.078947:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.078955:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.078957:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.078960:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 30 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.078971:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 30 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.079001:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 30 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.079012:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310514944:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147129.079120:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.079129:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310515072:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147129.079156:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147129.079173:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5837 00000100:00100000:0.0:1746147129.079178:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307575680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.079185:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.079205:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x31399394250538f7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76606 expref: 26 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.079213:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x31399394250538f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76606 expref: 26 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.079225:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.079240:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307575680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.079248:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5837 00000100:00100000:0.0:1746147129.079261:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5838 00000100:00100000:0.0:1746147129.079265:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307575936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.079270:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.079275:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425053810 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b2 expref: 20 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.079281:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425053810 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765b2 expref: 20 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.079290:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.079298:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2001:x1830967307575936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 33us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.079302:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5838 00000100:00100000:0.0:1746147129.079307:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5839 00000100:00100000:0.0:1746147129.079311:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307575808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.079315:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.079319:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x3139939425053921 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76629 expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.079328:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x3139939425053921 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76629 expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.079336:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.079337:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.079341:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 41 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.079347:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 41 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.079360:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 41 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.079366:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310515200:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147129.079380:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147129.089386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.089436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.089464:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307576192 00000100:00100000:0.0:1746147129.089472:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307576192 00002000:00100000:0.0:1746147129.089522:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1990656->1994751) req@ffff880093144700 x1830967307576192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.089533:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144700 with x1830967307576192 ext(1990656->1994751) 00002000:00010000:0.0:1746147129.089539:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093144700 00000100:00100000:0.0:1746147129.089563:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307576448 00000100:00100000:0.0:1746147129.089565:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307576448 00002000:00100000:0.0:1746147129.089580:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880093145f80 x1830967307576448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.089587:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145f80 with x1830967307576448 ext(2097152->3145727) 00002000:00010000:0.0:1746147129.089590:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145f80 00000100:00100000:0.0:1746147129.089603:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3036 00000100:00100000:0.0:1746147129.089612:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967307576192:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147129.089750:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967307576192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (377us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147129.089756:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3036 00002000:00100000:0.0:1746147129.089761:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1990656->1994751) req@ffff880093144700 x1830967307576192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.089767:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144700 with x1830967307576192 ext(1990656->1994751) 00002000:00010000:0.0:1746147129.089770:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093144700 00000100:00100000:0.0:1746147129.089781:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3037 00000100:00100000:0.0:1746147129.089785:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307576448:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147129.090910:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310515200:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147129.090921:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.090942:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307575808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11629us (12284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.090950:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5839 00000100:00100000:0.0:1746147129.099669:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307577216 00000100:00100000:0.0:1746147129.099678:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307577216 00000100:00100000:0.0:1746147129.099724:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5319 00000100:00100000:0.0:1746147129.099732:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:31836:x1830967307577216:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147129.100031:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:31836:x1830967307577216:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 297us (424us total) trans 8589935660 rc 0/0 00000100:00100000:1.0:1746147129.100038:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5319 00000100:00100000:1.0:1746147129.106081:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307576448:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 16291us (16641us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.106109:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3037 00002000:00100000:1.0:1746147129.106120:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880093145f80 x1830967307576448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.106128:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145f80 with x1830967307576448 ext(2097152->3145727) 00002000:00010000:1.0:1746147129.106134:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145f80 00000100:00100000:0.0:1746147129.131876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.131953:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.134142:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.139327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.146735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.146812:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307577984 00000100:00100000:1.0:1746147129.146820:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307577984 00010000:00010000:1.0:1746147129.146856:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 27 pid: 1136 timeout: 767 lvb_type: 0 00000100:00100000:1.0:1746147129.146893:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5840 00000100:00100000:1.0:1746147129.146900:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967307577984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.146914:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147129.146932:0:16749:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147128 -> 1746147129 00010000:00010000:1.0:1746147129.146937:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 27 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.146950:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 27 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.146974:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x313993942505396e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2772991) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76676 expref: 27 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.146993:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.146995:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.147003:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 39 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.147011:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 39 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.147044:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 39 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.147055:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310515584:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147129.147166:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147129.150036:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.150919:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.150982:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310515584:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147129.151008:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.151054:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967307577984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4154us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.151064:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5840 00000100:00100000:0.0:1746147129.155382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.155405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.158357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.174710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.175447:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307579136 00000100:00100000:1.0:1746147129.175456:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307579136 00000100:00100000:1.0:1746147129.175510:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5320 00000100:00100000:1.0:1746147129.175518:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:31829:x1830967307579136:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147129.175714:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:31829:x1830967307579136:12345-192.168.204.25@tcp:35:cat.0 Request processed in 197us (1004us total) trans 8589935661 rc 0/0 00000100:00100000:1.0:1746147129.175720:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5320 00000100:00100000:1.0:1746147129.204888:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.223281:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.223637:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307579648 00000100:00100000:1.0:1746147129.223645:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307579648 00000100:00100000:1.0:1746147129.223687:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5321 00000100:00100000:1.0:1746147129.223694:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:31830:x1830967307579648:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147129.223994:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:31830:x1830967307579648:12345-192.168.204.25@tcp:35:cat.0 Request processed in 300us (718us total) trans 8589935662 rc 0/0 00000100:00100000:1.0:1746147129.223999:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5321 00000100:00100000:0.0:1746147129.235210:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.239932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.242266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.245176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.245578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.245603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.245631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.245750:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13509 00000100:00100000:1.0:1746147129.245761:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307580544:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147129.245768:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.245776:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e766ca expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.245807:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.245809:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.245814:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766ca expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.245823:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766ca expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.245830:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380600, rc 0) 00000100:00100000:1.0:1746147129.245846:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2000:x1830967307580544:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.245851:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13509 00000100:00100000:0.0:1746147129.250657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.254283:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.257524:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.260676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.265295:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307581440 00000100:00100000:0.0:1746147129.265302:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307581440 00000100:00100000:0.0:1746147129.265357:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13510 00000100:00100000:0.0:1746147129.265365:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2000:x1830967307581440:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147129.265379:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147129.265394:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa200/0x3139939425053a24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e766e6 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.265438:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310516480:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147129.266895:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147129.270416:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.272749:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.272779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.272804:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.272834:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.272847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.272872:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.273348:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13513 00000100:00100000:0.0:1746147129.273354:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2001:x1830967307582208:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147129.273372:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.273381:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.273387:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.273393:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.273398:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.273399:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.273401:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.273418:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.273429:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 29 pid: 9585 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.273436:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310517120:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147129.273456:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.273463:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.273470:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310517248:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147129.273483:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.273489:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.273495:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310517504:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147129.273506:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147129.275913:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310517504:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147129.276653:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310517120:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147129.276659:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310517248:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147129.276671:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.277870:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.278249:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583488 00000100:00100000:1.0:1746147129.278254:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583488 00010000:00010000:1.0:1746147129.278281:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 30 pid: 9585 timeout: 767 lvb_type: 0 00000100:00100000:1.0:1746147129.278311:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5844 00000100:00100000:1.0:1746147129.278319:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967307583488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.278330:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.278346:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 30 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.278354:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 30 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.278371:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425053936 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7663e expref: 30 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.278395:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.278425:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967307583488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 108us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.278431:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5844 00000100:00100000:0.0:1746147129.280534:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.280602:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.280666:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583872 00000100:00100000:1.0:1746147129.280672:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583872 00010000:00010000:1.0:1746147129.280696:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 29 pid: 17600 timeout: 767 lvb_type: 0 00000100:00100000:1.0:1746147129.280715:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307584000 00000100:00100000:1.0:1746147129.280716:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307584000 00010000:00010000:1.0:1746147129.280725:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x31399394250539ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766c3 expref: 24 pid: 12201 timeout: 767 lvb_type: 1 00000100:00100000:1.0:1746147129.280751:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5845 00000100:00100000:1.0:1746147129.280758:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2002:x1830967307583872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.280768:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.280781:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 29 pid: 17600 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.280789:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 29 pid: 17600 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.280805:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844a400/0x3139939425053975 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7667d expref: 29 pid: 17600 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.280817:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.280845:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+28:2002:x1830967307583872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.280851:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5845 00000100:00100000:1.0:1746147129.280864:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5846 00000100:00100000:1.0:1746147129.280868:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2002:x1830967307584000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.280876:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.280886:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x31399394250539ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766c3 expref: 24 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.280894:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x31399394250539ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766c3 expref: 24 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.280904:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x31399394250539ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766c3 expref: 24 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.280912:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.280926:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307584000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 57us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.280931:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5846 00000100:00100000:0.0:1746147129.281876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.281901:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307582720 00000100:00100000:0.0:1746147129.281905:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307582720 00010000:00010000:0.0:1746147129.281920:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715a00/0x31399394250539bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766a7 expref: 27 pid: 12201 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.281936:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5847 00000100:00100000:0.0:1746147129.281942:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967307582720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.281948:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.281959:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093715a00/0x31399394250539bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766a7 expref: 27 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.281968:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093715a00/0x31399394250539bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766a7 expref: 27 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.281980:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715a00/0x31399394250539bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766a7 expref: 27 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.281993:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282010:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307582720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282016:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5847 00000100:00100000:0.0:1746147129.282057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282068:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307582976 00000100:00100000:0.0:1746147129.282070:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307582976 00010000:00010000:0.0:1746147129.282081:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425053802 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ab expref: 26 pid: 9585 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.282114:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5848 00000100:00100000:0.0:1746147129.282119:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2001:x1830967307582976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282126:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282134:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425053802 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ab expref: 26 pid: 9585 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.282142:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425053802 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ab expref: 26 pid: 9585 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.282154:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425053802 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ab expref: 26 pid: 9585 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.282162:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282177:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2001:x1830967307582976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282182:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5848 00000100:00100000:0.0:1746147129.282224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282233:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583232 00000100:00100000:0.0:1746147129.282236:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583232 00010000:00010000:0.0:1746147129.282245:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ff expref: 43 pid: 1136 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.282258:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5849 00000100:00100000:0.0:1746147129.282262:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307583232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282268:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282273:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ff expref: 43 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282279:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ff expref: 43 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282289:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x31399394250538f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765ff expref: 43 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282296:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282309:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307583232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282314:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5849 00000100:00100000:0.0:1746147129.282362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282373:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583616 00000100:00100000:0.0:1746147129.282375:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583616 00010000:00010000:0.0:1746147129.282385:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.282399:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5850 00000100:00100000:0.0:1746147129.282404:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307583616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282409:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282416:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282423:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282432:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x313993942505393d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76645 expref: 42 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282443:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282455:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307583616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282460:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5850 00000100:00100000:0.0:1746147129.282485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282492:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307584128 00000100:00100000:0.0:1746147129.282494:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307584128 00010000:00010000:0.0:1746147129.282503:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76637 expref: 40 pid: 9585 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.282515:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5851 00000100:00100000:0.0:1746147129.282519:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307584128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282524:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282531:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76637 expref: 40 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282538:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76637 expref: 40 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282548:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x313993942505392f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76637 expref: 40 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282554:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282567:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307584128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282574:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5851 00000100:00100000:0.0:1746147129.282605:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282615:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307582592 00000100:00100000:0.0:1746147129.282617:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307582592 00010000:00010000:0.0:1746147129.282627:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.282639:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5852 00000100:00100000:0.0:1746147129.282643:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2001:x1830967307582592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282648:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282655:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.282662:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.282671:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425053809 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765c0 expref: 25 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.282678:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.282680:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.282684:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.282691:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.282712:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282724:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2001:x1830967307582592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 80us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282729:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5852 00000100:00100000:0.0:1746147129.282759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282768:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307584256 00000100:00100000:0.0:1746147129.282771:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307584256 00010000:00010000:0.0:1746147129.282780:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76630 expref: 26 pid: 9585 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.282792:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5853 00000100:00100000:0.0:1746147129.282796:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967307584256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282800:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282806:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76630 expref: 26 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282813:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76630 expref: 26 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282822:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425053928 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76630 expref: 26 pid: 9585 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282828:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.282829:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.282832:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425053a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.282841:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425053a5c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.282851:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.282864:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967307584256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.282869:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5853 00000100:00100000:0.0:1746147129.282898:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.282906:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307582848 00000100:00100000:0.0:1746147129.282909:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307582848 00010000:00010000:0.0:1746147129.282917:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765e3 expref: 28 pid: 9584 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.282928:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5854 00000100:00100000:0.0:1746147129.282932:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967307582848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.282937:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.282943:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765e3 expref: 28 pid: 9584 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282951:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765e3 expref: 28 pid: 9584 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282960:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c11800/0x313993942505388e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e765e3 expref: 28 pid: 9584 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.282967:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.282968:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.282971:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0aec00/0x3139939425053a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.282976:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0aec00/0x3139939425053a40 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.282987:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.283001:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967307582848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.283005:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5854 00000100:00100000:0.0:1746147129.283039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.283074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.283084:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583360 00000100:00100000:0.0:1746147129.283105:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583360 00010000:00010000:0.0:1746147129.283116:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x31399394250539f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766d1 expref: 23 pid: 1136 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.283130:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5855 00000100:00100000:0.0:1746147129.283134:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2001:x1830967307583360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.283140:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.283145:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x31399394250539f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766d1 expref: 23 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.283152:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x31399394250539f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766d1 expref: 23 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.283162:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x31399394250539f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766d1 expref: 23 pid: 1136 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.283170:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.283181:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2001:x1830967307583360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.283186:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5855 00000100:00100000:0.0:1746147129.283213:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583104 00000100:00100000:0.0:1746147129.283216:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583104 00002000:00100000:0.0:1746147129.283235:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1724416->1994751) req@ffff8800a4395500 x1830967307583104/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.283243:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967307583104 ext(1724416->1994751) 00010000:00010000:0.0:1746147129.283248:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 39 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.283254:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 39 pid: 1136 timeout: 767 lvb_type: 0 00002000:00010000:0.0:1746147129.283260:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4395500 00000100:00100000:0.0:1746147129.283274:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 979 00000100:00100000:0.0:1746147129.283279:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307583104:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:1.0:1746147129.283689:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283696:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283710:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283716:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283722:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283728:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffa800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147129.283731:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283737:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283746:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.283751:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425053a4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.283793:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2001:x1830967307582208:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 10439us (10987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.283800:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13513 00000100:00100000:1.0:1746147129.286253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.286590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.286630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.286647:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307583744 00000100:00100000:1.0:1746147129.286653:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307583744 00010000:00010000:1.0:1746147129.286675:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766ca expref: 22 pid: 9585 timeout: 767 lvb_type: 1 00000100:00100000:1.0:1746147129.286695:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307584512 00000100:00100000:1.0:1746147129.286697:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307584512 00010000:00010000:1.0:1746147129.286707:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 41 pid: 12201 timeout: 767 lvb_type: 0 00000100:00100000:1.0:1746147129.286724:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307584384 00000100:00100000:1.0:1746147129.286726:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307584384 00000100:00100000:0.0:1746147129.286729:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5856 00010000:00010000:1.0:1746147129.286735:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.286736:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2001:x1830967307583744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.286745:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147129.286746:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5857 00000100:00100000:1.0:1746147129.286750:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307584512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.286755:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.286759:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766ca expref: 22 pid: 9585 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.286764:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 41 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.286773:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 41 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.286773:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766ca expref: 22 pid: 9585 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.286786:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715000/0x31399394250539a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76692 expref: 41 pid: 12201 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.286786:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x31399394250539fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766ca expref: 22 pid: 9585 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.286795:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.286795:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147129.286797:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.286799:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x3139939425053a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.286806:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x3139939425053a55 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.286815:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2001:x1830967307583744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.286819:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5856 00010000:00010000:1.0:1746147129.286825:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.286835:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307584512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.286839:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5857 00000100:00100000:1.0:1746147129.286847:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5858 00000100:00100000:1.0:1746147129.286851:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307584384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.286856:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.286863:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.286870:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.286880:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425053967 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7666f expref: 41 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.286888:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.286889:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.286891:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425053a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.286897:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425053a63 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.286909:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.286921:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307584384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.286925:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5858 00000100:00100000:0.0:1746147129.287843:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307583104:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4563us (4803us total) trans 21474841257 rc 0/0 00000100:00100000:0.0:1746147129.287851:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 979 00002000:00100000:0.0:1746147129.287858:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1724416->1994751) req@ffff8800a4395500 x1830967307583104/t21474841257(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/448 e 0 to 0 dl 1746147140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.289733:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967307583104 ext(1724416->1994751) 00010000:00010000:0.0:1746147129.289744:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 40 pid: 1136 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.289756:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x313993942505399f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7668b expref: 40 pid: 1136 timeout: 767 lvb_type: 0 00002000:00010000:0.0:1746147129.289762:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4395500 00000100:00100000:0.0:1746147129.295403:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.308918:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.310840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.313345:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.313922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.320545:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.320615:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.320644:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.320663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.320682:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147129.320687:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.320702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.320712:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.320725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.320749:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519296 00000100:00100000:1.0:1746147129.320756:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519296 00000100:00100000:1.0:1746147129.320799:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519808 00000100:00100000:1.0:1746147129.320802:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519808 00000100:00080000:0.0:1746147129.320849:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147129.320923:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310520192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.320947:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.322562:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519168 00000100:00100000:1.0:1746147129.322569:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519168 00000100:00100000:1.0:1746147129.322598:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519680 00000100:00100000:1.0:1746147129.322601:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519680 00000100:00100000:1.0:1746147129.322612:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520192 00000100:00100000:1.0:1746147129.322614:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520192 00000100:00100000:1.0:1746147129.322636:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13517 00000100:00100000:1.0:1746147129.322645:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+88:3765:x1830967310519296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.322805:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967310519296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (2189us total) trans 21474841258 rc 0/0 00000100:00100000:1.0:1746147129.322812:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13517 00000100:00100000:1.0:1746147129.322826:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13518 00000100:00100000:1.0:1746147129.322831:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+88:3765:x1830967310519808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147129.322878:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147129.322881:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147129.322883:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147129.322885:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147129.322887:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147129.322908:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967310519808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (2243us total) trans 21474841259 rc 0/0 00000100:00100000:1.0:1746147129.322913:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13518 00000100:00100000:1.0:1746147129.323049:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13519 00000100:00100000:1.0:1746147129.323054:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+88:3765:x1830967310519168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.323123:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967310519168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (2420us total) trans 21474841260 rc 0/0 00000100:00100000:1.0:1746147129.323128:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13519 00000100:00100000:1.0:1746147129.323137:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13520 00000100:00100000:1.0:1746147129.323140:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+88:3765:x1830967310519680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.323200:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967310519680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (2460us total) trans 21474841261 rc 0/0 00000100:00100000:1.0:1746147129.323205:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13520 00000100:00100000:1.0:1746147129.323214:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13521 00000100:00100000:1.0:1746147129.323218:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:3764:x1830967310520192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.323285:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+96:3764:x1830967310520192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (2338us total) trans 17179873988 rc 0/0 00000100:00100000:1.0:1746147129.323290:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13521 00000100:00100000:1.0:1746147129.323316:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310520320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.323339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.323356:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310520832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.323369:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147129.323396:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094572d80/2, rc 0, transno 21474841260 00000100:00100000:1.0:1746147129.323402:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.323410:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e8380/2, rc 0, transno 21474841261 00000100:00100000:1.0:1746147129.323413:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.323419:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094571500/2, rc 0, transno 21474841258 00000100:00100000:1.0:1746147129.323422:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.323427:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e9c00/2, rc 0, transno 21474841259 00000100:00100000:1.0:1746147129.323429:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310519808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.323445:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520320 00000100:00100000:1.0:1746147129.323448:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520320 00000100:00100000:1.0:1746147129.323463:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520832 00000100:00100000:1.0:1746147129.323465:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520832 00000100:00100000:1.0:1746147129.323470:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13522 00000100:00100000:1.0:1746147129.323473:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+97:3765:x1830967310520320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.323527:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+98:3765:x1830967310520320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (187us total) trans 17179873989 rc 0/0 00000100:00100000:1.0:1746147129.323532:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13522 00000100:00100000:1.0:1746147129.323540:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13523 00000100:00100000:1.0:1746147129.323543:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+97:3765:x1830967310520832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.323586:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+98:3765:x1830967310520832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (215us total) trans 17179873990 rc 0/0 00000100:00100000:1.0:1746147129.323590:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13523 00000004:00080000:1.0:1746147129.323617:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396680/2, rc 0, transno 17179873989 00000004:00080000:0.0:1746147129.323861:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397800/2, rc 0, transno 17179873988 00000100:00100000:0.0:1746147129.323870:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310520192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.323874:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310520704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.323892:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.323912:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520704 00000100:00100000:0.0:1746147129.323914:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520704 00000100:00100000:0.0:1746147129.323930:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13524 00000100:00100000:0.0:1746147129.323934:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:3764:x1830967310520704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147129.323978:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:0.0:1746147129.323981:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:0.0:1746147129.323983:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.323984:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.323986:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147129.324015:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+99:3764:x1830967310520704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (122us total) trans 17179873991 rc 0/0 00000100:00100000:0.0:1746147129.324025:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13524 00000100:00080000:0.0:1746147129.324041:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147129.324102:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310521216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.324120:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147129.324141:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395f80/2, rc 0, transno 17179873991 00000100:00100000:0.0:1746147129.324145:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310520704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.324156:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521216 00000100:00100000:0.0:1746147129.324157:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521216 00000100:00100000:0.0:1746147129.324170:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13525 00000100:00100000:0.0:1746147129.324174:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+99:3764:x1830967310521216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.324239:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:3764:x1830967310521216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (118us total) trans 17179873992 rc 0/0 00000100:00100000:0.0:1746147129.324244:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13525 00000004:00080000:0.0:1746147129.324263:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395180/2, rc 0, transno 17179873992 00000100:00100000:0.0:1746147129.324266:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310521216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.324984:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310520320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147129.324997:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396d80/2, rc 0, transno 17179873990 00000100:00100000:1.0:1746147129.324999:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310520832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.325722:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13531 00000100:00100000:0.0:1746147129.325730:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3767:x1830967310520064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.325795:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3767:x1830967310520064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (285us total) trans 21474841265 rc 0/0 00000100:00100000:0.0:1746147129.325800:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13531 00000100:00100000:0.0:1746147129.325810:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13533 00000100:00100000:0.0:1746147129.325814:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+104:3767:x1830967310521088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147129.325849:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147129.325852:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.325853:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.325855:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.325857:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147129.325874:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+104:3767:x1830967310521088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (313us total) trans 17179873996 rc 0/0 00000100:00100000:0.0:1746147129.325879:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13533 00000100:00100000:0.0:1746147129.330839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.336080:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.337158:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307585664 00000100:00100000:1.0:1746147129.337168:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307585664 00000100:00100000:1.0:1746147129.337295:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15042 00000100:00100000:1.0:1746147129.337303:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31841:x1830967307585664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147129.337324:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.337346:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae200/0x3139939425053a78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e766fb expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.337443:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425053a7f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.337457:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425053a7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.337467:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425053a7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147129.337492:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147129.337496:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147129.337512:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425053a7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.337537:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae200/0x3139939425053a78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766fb expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.337568:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425053a7f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766fb expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.337578:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.337580:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147129.337584:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb600, rc 0) 00000100:00100000:1.0:1746147129.337645:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:31841:x1830967307585664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 342us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.337651:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15042 00000100:00100000:0.0:1746147129.339922:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.340020:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.340048:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.340076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.340116:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.340144:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.340160:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307586176 00000100:00100000:0.0:1746147129.340163:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307586176 00000100:00100000:0.0:1746147129.340179:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307586432 00000100:00100000:0.0:1746147129.340181:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307586432 00000100:00100000:0.0:1746147129.340211:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13535 00000100:00100000:0.0:1746147129.340216:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2000:x1830967307585920:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147129.340224:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147129.340236:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425053a8d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76709 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147129.340249:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141739, atime: 0x68141738, ctime: 0x68141739, blocks: 0x808 00010000:00010000:0.0:1746147129.340263:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.340265:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.340271:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425053a8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76709 expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.340283:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425053a8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76709 expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.340292:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42c00, rc 0) 00000100:00100000:0.0:1746147129.340330:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307585920:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 113us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.340335:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13535 00000100:00100000:0.0:1746147129.340352:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13536 00000100:00100000:0.0:1746147129.340357:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2000:x1830967307586048:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147129.340363:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147129.340372:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76710 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147129.340382:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x68141738, atime: 0x68141738, ctime: 0x68141738, blocks: 0x808 00010000:00010000:0.0:1746147129.340389:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.340390:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.340394:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76710 expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.340402:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76710 expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.340409:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b000, rc 0) 00000100:00100000:1.0:1746147129.340529:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13538 00000100:00100000:1.0:1746147129.340536:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2000:x1830967307586304:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147129.340542:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.340551:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425053aa2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7671e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147129.340561:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141738, atime: 0x68141738, ctime: 0x68141738, blocks: 0x1590 00010000:00010000:1.0:1746147129.340568:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.340569:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.340574:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425053aa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7671e expref: 24 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.340582:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425053aa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7671e expref: 24 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.340588:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae000, rc 0) 00000100:00100000:1.0:1746147129.340606:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2000:x1830967307586304:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 71us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.340611:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13538 00000100:00100000:0.0:1746147129.340733:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307586048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 375us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.340738:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13536 00000100:00100000:0.0:1746147129.345901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.345941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.347837:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.348073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.348085:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.348134:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.348185:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13541 00000100:00100000:0.0:1746147129.348202:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2003:x1830967307586816:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147129.348291:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2003:x1830967307586816:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 91us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.348298:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13541 00000100:00100000:0.0:1746147129.348312:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13543 00000100:00100000:0.0:1746147129.348315:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2003:x1830967307586688:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147129.348339:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2003:x1830967307586688:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.348346:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13543 00000100:00100000:0.0:1746147129.348354:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13545 00000100:00100000:0.0:1746147129.348357:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2003:x1830967307587200:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147129.348377:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2003:x1830967307587200:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 18us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.348381:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13545 00000100:00100000:0.0:1746147129.353051:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.353329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.353465:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.353589:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.353620:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307587456 00000100:00100000:1.0:1746147129.353627:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307587456 00000100:00100000:1.0:1746147129.353665:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307587712 00000100:00100000:1.0:1746147129.353667:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307587712 00000100:00100000:1.0:1746147129.353681:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307587968 00000100:00100000:1.0:1746147129.353683:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307587968 00000100:00100000:1.0:1746147129.353696:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13546 00000100:00100000:1.0:1746147129.353701:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307587456:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147129.353791:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307587456:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 88us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.353797:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13546 00000100:00100000:1.0:1746147129.353811:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13547 00000100:00100000:1.0:1746147129.353815:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307587712:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147129.353845:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307587712:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.353850:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13547 00000100:00100000:1.0:1746147129.353858:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13548 00000100:00100000:1.0:1746147129.353862:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2002:x1830967307587968:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147129.353889:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2002:x1830967307587968:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.353893:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13548 00000100:00100000:0.0:1746147129.355620:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.355900:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.358923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.361752:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307588224 00000100:00100000:0.0:1746147129.361760:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307588224 00000100:00100000:0.0:1746147129.361804:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13553 00000100:00100000:0.0:1746147129.361812:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307588224:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:0.0:1746147129.361954:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147129.361957:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.361959:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.361961:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.361963:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147129.362014:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2002:x1830967307588224:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 202us (328us total) trans 17179873997 rc 0/0 00000100:00100000:0.0:1746147129.362020:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13553 00000100:00100000:0.0:1746147129.370478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.372574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.372816:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307588736 00000100:00100000:1.0:1746147129.372822:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307588736 00000100:00100000:1.0:1746147129.372860:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3045 00000100:00100000:1.0:1746147129.372867:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2002:x1830967307588736:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147129.372889:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.372899:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.372901:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.372904:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.372913:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.376491:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307588992 00000100:00100000:1.0:1746147129.376501:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307588992 00000100:00100000:1.0:1746147129.376561:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307589248 00000100:00100000:1.0:1746147129.376563:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307589248 00000100:00100000:1.0:1746147129.376584:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3046 00000100:00100000:1.0:1746147129.376592:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2002:x1830967307588992:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147129.376627:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098eb2600/0x3139939425053abe lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.376640:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.376641:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.376646:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098eb2600/0x3139939425053abe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.376658:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098eb2600/0x3139939425053abe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.384716:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.391584:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.391624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.391653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.391669:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307589760 00000100:00100000:0.0:1746147129.391676:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307589760 00000100:00100000:0.0:1746147129.391949:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3049 00000100:00100000:0.0:1746147129.391958:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+28:2002:x1830967307590016:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147129.391988:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425053ad3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.392002:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.392003:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.392008:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425053ad3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.392018:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425053ad3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.392604:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3050 00000100:00100000:0.0:1746147129.392609:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+28:2003:x1830967307589760:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147129.392624:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.392630:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.392631:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.392633:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394323:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394331:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394337:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394344:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f007800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147129.394347:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394354:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394370:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.394376:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f007800/0x3139939425053ab7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.394427:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+27:2002:x1830967307588736:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 21560us (21857us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.394434:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3045 00010000:00010000:0.0:1746147129.399002:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422467:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422477:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422482:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422487:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147129.422490:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422495:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422505:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.422509:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425053ada lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.422710:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2003:x1830967307589760:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 30099us (31133us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.422717:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3050 00000100:00100000:0.0:1746147129.428382:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.428442:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307590528 00000100:00100000:1.0:1746147129.428454:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307590528 00000100:00100000:1.0:1746147129.428507:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15043 00000100:00100000:1.0:1746147129.428515:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:31841:x1830967307590528:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:1.0:1746147129.428558:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.428579:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425053a7f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766fb expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.428607:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.428610:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147129.428649:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053ae8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.428659:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.428666:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00010000:1.0:1746147129.428750:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099010e00 reply state ffff8800991ea000 transno 8589935667 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.428758:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.428763:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.428765:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746147129.428767:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147129.428835:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31841:x1830967307590528:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 320us (460us total) trans 8589935667 rc 0/0 00000100:00100000:1.0:1746147129.428840:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15043 00000100:00100000:0.0:1746147129.433652:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.433691:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.433715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.433737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.433748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.433770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.433796:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307590656 00000100:00100000:0.0:1746147129.433804:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307590656 00000100:00100000:0.0:1746147129.433839:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307590784 00000100:00100000:0.0:1746147129.433842:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307590784 00000100:00100000:0.0:1746147129.433852:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307590912 00000100:00100000:0.0:1746147129.433854:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307590912 00000100:00100000:0.0:1746147129.433862:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307591040 00000100:00100000:0.0:1746147129.433864:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307591040 00000100:00100000:0.0:1746147129.433871:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307591168 00000100:00100000:0.0:1746147129.433872:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307591168 00000100:00100000:0.0:1746147129.433879:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307591296 00000100:00100000:0.0:1746147129.433880:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307591296 00000100:00100000:0.0:1746147129.433888:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13554 00000100:00100000:0.0:1746147129.433895:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2000:x1830967307590656:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147129.434003:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147129.434005:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147128 -> 1746147129 00002000:00010000:0.0:1746147129.434007:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147128 -> 1746147129 00002000:00010000:0.0:1746147129.434009:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147128 -> 1746147129 00002000:00010000:0.0:1746147129.434011:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147129.434046:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+27:2000:x1830967307590656:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 151us (402us total) trans 17179873998 rc 0/0 00000100:00100000:0.0:1746147129.434051:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13554 00000100:00100000:0.0:1746147129.434067:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13555 00000100:00100000:0.0:1746147129.434071:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2000:x1830967307590784:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147129.434142:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147129.434144:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.434146:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147128 -> 1746147129 00002000:00010000:0.0:1746147129.434148:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.434149:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147129.434166:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2000:x1830967307590784:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 95us (474us total) trans 21474841267 rc 0/0 00000100:00100000:0.0:1746147129.434172:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13555 00000100:00100000:0.0:1746147129.439660:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.443693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.443761:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307591680 00000100:00100000:1.0:1746147129.443766:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307591680 00010000:00010000:1.0:1746147129.443793:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053a71 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766f4 expref: 11 pid: 7238 timeout: 767 lvb_type: 0 00000100:00100000:1.0:1746147129.443832:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5864 00000100:00100000:1.0:1746147129.443839:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307591680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.443850:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.443855:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053a71 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766f4 expref: 11 pid: 7238 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.443864:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053a71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766f4 expref: 11 pid: 7238 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.443879:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053a71 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e766f4 expref: 11 pid: 7238 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.443893:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.443897:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425053aef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147129.443904:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425053aef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147129.443908:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425053aef lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147129.443923:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.443953:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307591680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 114us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.443958:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5864 00000001:00080000:0.0:1746147129.446391:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935668 is committed 00000004:00080000:0.0:1746147129.446398:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 382 committed 00000004:00080000:0.0:1746147129.446407:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 425 committed 00000004:00080000:0.0:1746147129.446411:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 424 committed 00000004:00080000:0.0:1746147129.446413:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 423 committed 00000004:00080000:0.0:1746147129.446414:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 422 committed 00000004:00080000:0.0:1746147129.446416:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 381 committed 00000004:00080000:0.0:1746147129.446417:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 421 committed 00000004:00080000:0.0:1746147129.446418:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 380 committed 00000004:00080000:0.0:1746147129.446420:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 420 committed 00000004:00080000:0.0:1746147129.446421:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 379 committed 00000004:00080000:0.0:1746147129.446422:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 378 committed 00000004:00080000:0.0:1746147129.446424:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 377 committed 00000004:00080000:0.0:1746147129.446425:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 419 committed 00000004:00080000:0.0:1746147129.446426:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 418 committed 00000004:00080000:0.0:1746147129.446427:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 376 committed 00000004:00080000:0.0:1746147129.446428:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 375 committed 00000004:00080000:0.0:1746147129.446430:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 417 committed 00000100:00100000:0.0:1746147129.446637:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147129.446650:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310521472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.446687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.446699:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310521984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.446710:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310521856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.446725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.446731:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521472 00000100:00100000:0.0:1746147129.446736:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521472 00000100:00100000:1.0:1746147129.446750:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.446756:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521984 00000100:00100000:0.0:1746147129.446758:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521984 00000100:00100000:1.0:1746147129.446764:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310522368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.446767:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521856 00000100:00100000:0.0:1746147129.446768:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521856 00000100:00100000:0.0:1746147129.446777:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521728 00000100:00100000:0.0:1746147129.446779:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521728 00000100:00100000:1.0:1746147129.446782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.446789:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522368 00000100:00100000:0.0:1746147129.446791:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522368 00000100:00100000:0.0:1746147129.446804:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13560 00000100:00100000:1.0:1746147129.446809:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13561 00000100:00100000:0.0:1746147129.446809:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+108:3764:x1830967310521472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.446815:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+108:3765:x1830967310521984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.446875:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13562 00000100:00100000:0.0:1746147129.446880:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+110:3764:x1830967310521856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147129.446889:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:1.0:1746147129.446891:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:1.0:1746147129.446893:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147129.446895:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147129.446896:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:1.0:1746147129.446920:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+111:3765:x1830967310521984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (194us total) trans 17179874002 rc 0/0 00000100:00100000:1.0:1746147129.446925:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13561 00000100:00100000:0.0:1746147129.446932:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+111:3764:x1830967310521856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (181us total) trans 17179874003 rc 0/0 00000100:00100000:0.0:1746147129.446937:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13562 00000100:00100000:1.0:1746147129.446939:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521600 00000100:00100000:1.0:1746147129.446941:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521600 00000100:00100000:0.0:1746147129.446948:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522112 00000100:00100000:0.0:1746147129.446950:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522112 00000100:00100000:1.0:1746147129.446953:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13563 00000100:00100000:1.0:1746147129.446957:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+111:3767:x1830967310521728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.446960:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13564 00000100:00100000:0.0:1746147129.446964:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+111:3764:x1830967310522368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147129.446995:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147129.446997:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.446999:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.447001:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.447002:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00002000:00010000:0.0:1746147129.447005:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147129.447007:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.447010:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.447012:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.447013:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:1.0:1746147129.447020:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+113:3767:x1830967310521728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (250us total) trans 17179874004 rc 0/0 00000100:00100000:1.0:1746147129.447025:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13563 00000100:00100000:0.0:1746147129.447033:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+112:3764:x1830967310522368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (249us total) trans 17179874005 rc 0/0 00000100:00100000:1.0:1746147129.447035:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13565 00000100:00100000:1.0:1746147129.447542:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+113:3766:x1830967310521600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.447577:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13564 00002000:00010000:1.0:1746147129.447584:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147129.447586:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.447588:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.447589:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00000100:00100000:0.0:1746147129.447589:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13566 00002000:00010000:1.0:1746147129.447591:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147129.447594:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:3766:x1830967310522112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.447613:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+113:3766:x1830967310521600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (717us total) trans 17179874006 rc 0/0 00000100:00100000:1.0:1746147129.447618:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13565 00000100:00100000:1.0:1746147129.447637:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310522496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.447650:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:3766:x1830967310522112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (724us total) trans 17179874007 rc 0/0 00000100:00100000:1.0:1746147129.447655:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.447655:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13566 00000100:00100000:0.0:1746147129.447665:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522496 00000100:00100000:0.0:1746147129.447668:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522496 00000004:00080000:1.0:1746147129.447671:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a0000/2, rc 0, transno 17179874002 00000100:00100000:1.0:1746147129.447675:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310521984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.447681:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13567 00000100:00100000:0.0:1746147129.447685:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:3765:x1830967310522496:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147129.447691:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a3800/2, rc 0, transno 17179874003 00000100:00100000:1.0:1746147129.447693:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310521856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147129.447700:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a2a00/2, rc 0, transno 17179874005 00000100:00100000:1.0:1746147129.447702:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310522368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.447738:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+114:3765:x1830967310522496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (81us total) trans 17179874008 rc 0/0 00000100:00100000:0.0:1746147129.447743:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13567 00002000:00010000:0.0:1746147129.447766:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147129.447769:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.447771:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.447772:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.447774:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147129.447782:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310523008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.447790:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+113:3764:x1830967310521472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 981us (1103us total) trans 17179874001 rc 0/0 00000100:00100000:0.0:1746147129.447795:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13560 00000100:00100000:1.0:1746147129.447800:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.447804:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523008 00000100:00100000:0.0:1746147129.447807:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523008 00000100:00100000:1.0:1746147129.447811:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310523520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.447820:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13568 00000100:00100000:1.0:1746147129.447822:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.447824:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3765:x1830967310523008:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.447834:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8a80/2, rc 0, transno 17179874008 00000100:00100000:1.0:1746147129.447837:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310522496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.447844:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147129.447847:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310522880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.447859:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.447865:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310523392:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147129.447873:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746147129.447876:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147129.447876:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.447878:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.447879:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.447881:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147129.447888:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523520 00000100:00100000:1.0:1746147129.447891:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523520 00000100:00100000:0.0:1746147129.447901:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:3765:x1830967310523008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (100us total) trans 21474841270 rc 0/0 00000100:00100000:1.0:1746147129.447903:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522880 00000100:00100000:1.0:1746147129.447904:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522880 00000100:00100000:0.0:1746147129.447906:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13568 00000100:00100000:1.0:1746147129.447911:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523392 00000100:00100000:1.0:1746147129.447913:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523392 00000100:00100000:0.0:1746147129.447916:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13569 00000100:00100000:0.0:1746147129.447921:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+96:3765:x1830967310523520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.447922:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13570 00000100:00100000:1.0:1746147129.447926:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:3765:x1830967310522880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147129.447967:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147129.447969:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00000100:00100000:0.0:1746147129.447970:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+98:3765:x1830967310523520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (146us total) trans 21474841271 rc 0/0 00002000:00010000:1.0:1746147129.447971:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.447973:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.447975:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147129.447975:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13569 00000100:00100000:0.0:1746147129.447985:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13571 00000100:00100000:0.0:1746147129.447989:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+97:3765:x1830967310523392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.447993:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+97:3765:x1830967310522880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (132us total) trans 21474841272 rc 0/0 00000100:00100000:1.0:1746147129.447998:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13570 00000004:00080000:1.0:1746147129.448016:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094570e00/2, rc 0, transno 17179874001 00000100:00100000:1.0:1746147129.448019:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310521472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147129.448032:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a3480/2, rc 0, transno 21474841272 00000100:00100000:1.0:1746147129.448035:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310522880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.448041:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a1f80/2, rc 0, transno 21474841270 00000100:00100000:1.0:1746147129.448043:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310523008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.448048:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd44380/2, rc 0, transno 21474841271 00000100:00100000:1.0:1746147129.448051:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310523520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.448261:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+97:3765:x1830967310523392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (382us total) trans 21474841273 rc 0/0 00000100:00100000:0.0:1746147129.448267:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13571 00000004:00080000:1.0:1746147129.449112:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd47b80/2, rc 0, transno 21474841273 00000100:00100000:1.0:1746147129.449115:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310523392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.450952:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.454478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.468374:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.468505:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307592320 00000100:00100000:1.0:1746147129.468514:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307592320 00000100:00100000:1.0:1746147129.468565:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15045 00000100:00100000:1.0:1746147129.468572:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:31852:x1830967307592320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147129.468593:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.468609:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x3139939425053afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76733 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.468666:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468676:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468685:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468698:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468703:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468708:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468789:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x3139939425053b12 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468796:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x3139939425053b12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468801:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x3139939425053b12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147129.468808:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147129.468854:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468859:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468864:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468868:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097035e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147129.468871:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468875:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468883:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147129.468886:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147129.468889:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468893:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x3139939425053b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468924:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468929:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468933:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468937:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097034a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147129.468939:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468943:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468948:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dd400) 00010000:00010000:1.0:1746147129.468950:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147129.468951:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468955:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x3139939425053b0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.468985:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x3139939425053afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76733 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.468995:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x3139939425053b12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76733 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.469000:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.469002:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147129.469005:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034600, rc 0) 00000100:00100000:1.0:1746147129.469057:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:31852:x1830967307592320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 485us (690us total) trans 8589935670 rc 0/0 00000100:00100000:1.0:1746147129.469063:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15045 00000100:00100000:0.0:1746147129.469927:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.469994:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307592576 00000100:00100000:1.0:1746147129.469998:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307592576 00000100:00100000:1.0:1746147129.470241:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15046 00000100:00100000:1.0:1746147129.470248:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:31847:x1830967307592576:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147129.470262:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.470272:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x3139939425053b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7673a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.470312:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470320:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470327:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470336:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470341:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470346:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470396:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cc7000/0x3139939425053b35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470404:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cc7000/0x3139939425053b35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470410:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cc7000/0x3139939425053b35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147129.470415:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147129.470454:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470459:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470464:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470468:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f007e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147129.470471:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470475:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470482:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147129.470485:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147129.470487:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470491:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007e00/0x3139939425053b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470499:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470506:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470510:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470514:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147129.470516:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470521:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470526:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369ddd00) 00010000:00010000:1.0:1746147129.470528:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147129.470530:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470534:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425053b2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147129.470558:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x3139939425053b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7673a expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.470567:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cc7000/0x3139939425053b35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7673a expref: 28 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.470572:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.470574:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147129.470576:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cc7000, rc 0) 00000100:00100000:1.0:1746147129.470618:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:31847:x1830967307592576:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 369us (692us total) trans 8589935671 rc 0/0 00000100:00100000:1.0:1746147129.470625:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15046 00000100:00100000:0.0:1746147129.470781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.475442:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.475558:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307592960 00000100:00100000:1.0:1746147129.475565:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307592960 00002000:00100000:1.0:1746147129.475603:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011db14000 x1830967307592960/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.475612:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14000 with x1830967307592960 ext(0->1048575) 00002000:00010000:1.0:1746147129.475617:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14000 00000100:00100000:1.0:1746147129.475634:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3052 00000100:00100000:1.0:1746147129.475640:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307592960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147129.481815:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.484817:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307594240 00000100:00100000:0.0:1746147129.484823:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307594240 00000100:00100000:0.0:1746147129.484858:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15050 00000100:00100000:0.0:1746147129.484864:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:31849:x1830967307594240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147129.484874:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147129.484882:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972e00/0x3139939425053b7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7675d expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.484924:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.484937:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.484945:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.484957:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.484962:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.484967:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485044:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485051:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485056:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147129.485063:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147129.485144:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485150:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485155:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485163:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147129.485165:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485170:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485179:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147129.485182:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746147129.485195:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48800/0x3139939425053b74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147129.485200:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48800/0x3139939425053b74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147129.485205:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485209:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425053b90 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485226:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485230:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485235:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485238:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f972c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147129.485240:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485247:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485252:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147129.485254:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147129.485256:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485260:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425053b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485266:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485270:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485274:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485279:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147129.485280:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485284:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485289:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800930f4500) 00010000:00010000:0.0:1746147129.485291:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147129.485293:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485298:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425053b89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147129.485328:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972e00/0x3139939425053b7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7675d expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.485334:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972e00/0x3139939425053b7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7675d expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.485341:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f972e00, rc 0) 00000100:00100000:0.0:1746147129.485380:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:31849:x1830967307594240:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 516us (697us total) trans 8589935673 rc 301/301 00000100:00100000:0.0:1746147129.485386:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15050 00000100:00100000:0.0:1746147129.485423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.486636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.486731:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307592960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11090us (11379us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.486739:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3052 00002000:00100000:1.0:1746147129.486748:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011db14000 x1830967307592960/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.486756:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14000 with x1830967307592960 ext(0->1048575) 00002000:00010000:1.0:1746147129.486760:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14000 00000100:00100000:0.0:1746147129.487004:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.493558:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310524288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.493583:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.494551:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310524416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.495072:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310524800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.495099:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.501472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.501514:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524800 00000100:00100000:1.0:1746147129.501520:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524800 00000100:00100000:1.0:1746147129.501548:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524416 00000100:00100000:1.0:1746147129.501549:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524416 00000100:00100000:1.0:1746147129.501562:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13581 00000100:00100000:1.0:1746147129.501568:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+116:3764:x1830967310524800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.501713:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+117:3764:x1830967310524800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (6611us total) trans 17179874013 rc 0/0 00000100:00100000:1.0:1746147129.501719:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13581 00000100:00100000:1.0:1746147129.501733:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13582 00000100:00100000:1.0:1746147129.501737:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:3765:x1830967310524416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147129.501791:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147129.501794:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.501796:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.501798:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147129.501799:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147129.501823:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:3765:x1830967310524416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (355us total) trans 21474841278 rc 0/0 00000100:00100000:1.0:1746147129.501827:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13582 00000004:00080000:0.0:1746147129.502349:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098820380/2, rc 0, transno 17179874013 00000100:00100000:0.0:1746147129.502357:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310524800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.502365:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310525312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.502399:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525184 00000100:00100000:0.0:1746147129.502401:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525184 00000100:00100000:0.0:1746147129.502414:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13585 00000100:00100000:0.0:1746147129.502418:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3767:x1830967310525184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147129.502461:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147129.502463:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.502465:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.502467:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147129.502468:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147129.502483:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3767:x1830967310525184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (93us total) trans 21474841279 rc 0/0 00000100:00100000:0.0:1746147129.502487:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13585 00000100:00100000:0.0:1746147129.502494:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525696 00000100:00100000:0.0:1746147129.502496:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525696 00000100:00100000:0.0:1746147129.502507:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13586 00000100:00100000:0.0:1746147129.502511:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3767:x1830967310525696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147129.502545:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147129.502548:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.502549:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147129.502551:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147129.502552:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147129.502573:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3767:x1830967310525696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (152us total) trans 21474841280 rc 0/0 00000100:00100000:0.0:1746147129.502578:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13586 00000100:00100000:0.0:1746147129.502587:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525568 00000100:00100000:0.0:1746147129.502589:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525568 00000100:00100000:0.0:1746147129.502602:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13587 00000100:00100000:0.0:1746147129.502606:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3767:x1830967310525568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.502654:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+105:3767:x1830967310525568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (98us total) trans 21474841281 rc 0/0 00000100:00100000:0.0:1746147129.502663:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13587 00000004:00080000:1.0:1746147129.503120:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd47480/2, rc 0, transno 21474841278 00000100:00100000:1.0:1746147129.503124:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310524416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.503129:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310524928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147129.503148:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.503161:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310525440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.503173:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.503182:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310525952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.503209:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.503227:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524928 00000100:00100000:1.0:1746147129.503230:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524928 00000100:00100000:1.0:1746147129.503243:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525440 00000100:00100000:1.0:1746147129.503245:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525440 00000100:00100000:1.0:1746147129.503255:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525952 00000100:00100000:1.0:1746147129.503257:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525952 00000100:00100000:1.0:1746147129.503266:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13591 00000100:00100000:1.0:1746147129.503270:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:3765:x1830967310524928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147129.503310:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147129.503313:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147129.503314:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147129.503316:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147129.503317:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147129.503337:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+122:3765:x1830967310524928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (188us total) trans 17179874018 rc 0/0 00000100:00100000:1.0:1746147129.503342:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13591 00000100:00100000:1.0:1746147129.503351:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13593 00000100:00100000:1.0:1746147129.503355:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+106:3765:x1830967310525952:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.503392:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098822d80/2, rc 0, transno 17179874018 00000100:00100000:1.0:1746147129.503395:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310524928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147129.503706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147129.503722:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310525824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147129.503739:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147129.504106:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+107:3765:x1830967310525952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 750us (896us total) trans 21474841282 rc 0/0 00000100:00100000:1.0:1746147129.504112:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13593 00000004:00080000:1.0:1746147129.505708:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd45c00/2, rc 0, transno 21474841283 00000100:00100000:1.0:1746147129.505714:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310525440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147129.505722:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd44a80/2, rc 0, transno 21474841282 00000100:00100000:1.0:1746147129.505725:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310525952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147129.518841:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307595520 00000100:00100000:1.0:1746147129.518846:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307595520 00000100:00100000:1.0:1746147129.518882:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 762 00000100:00100000:1.0:1746147129.518887:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307595520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.518895:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.518908:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425053ba5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7676b expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.518919:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147129.518922:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.518940:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307595520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.518945:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 762 00000100:00100000:0.0:1746147129.519577:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310526208:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147129.519603:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc200/0x3139939425053bac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3211264->3301375] (req 3211264->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76772 expref: 22 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.519618:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fc200, rc 0) 00000100:00100000:0.0:1746147129.519664:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:31847:x1830967307594624:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2917us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.519672:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13596 00000100:00100000:0.0:1746147129.520244:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307595776 00000100:00100000:0.0:1746147129.520250:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307595776 00010000:00010000:0.0:1746147129.520271:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425053aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76725 expref: 10 pid: 12201 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.520299:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5868 00000100:00100000:0.0:1746147129.520305:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307595776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.520316:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.520335:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425053aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76725 expref: 10 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.520390:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425053aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76725 expref: 10 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.520417:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425053aa9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76725 expref: 10 pid: 12201 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.520549:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.520551:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147129.520557:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc200/0x3139939425053bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76772 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.520565:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc200/0x3139939425053bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76772 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147129.520594:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc200/0x3139939425053bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76772 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147129.520607:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310526336:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147129.520666:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147129.523656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.523781:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307596032 00000100:00100000:1.0:1746147129.523788:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307596032 00002000:00100000:1.0:1746147129.523825:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3211264->3215359) req@ffff880099152a00 x1830967307596032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.523835:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152a00 with x1830967307596032 ext(3211264->3215359) 00002000:00010000:1.0:1746147129.523840:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152a00 00000100:00100000:1.0:1746147129.523962:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3053 00000100:00100000:1.0:1746147129.523968:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967307596032:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147129.524113:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967307596032:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 118us (432us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147129.524120:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3053 00002000:00100000:1.0:1746147129.524125:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3211264->3215359) req@ffff880099152a00 x1830967307596032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.524132:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152a00 with x1830967307596032 ext(3211264->3215359) 00002000:00010000:1.0:1746147129.524135:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152a00 00000100:00100000:0.0:1746147129.526127:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.531467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.531516:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.531545:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.531571:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.531578:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307596672 00000100:00100000:1.0:1746147129.531588:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307596672 00000100:00100000:0.0:1746147129.531595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:1.0:1746147129.531647:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880099150380 x1830967307596672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.531657:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150380 with x1830967307596672 ext(0->1048575) 00002000:00010000:1.0:1746147129.531663:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099150380 00000100:00100000:1.0:1746147129.531688:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307596928 00000100:00100000:1.0:1746147129.531691:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307596928 00002000:00100000:1.0:1746147129.531704:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099151500 x1830967307596928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.531711:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151500 with x1830967307596928 ext(1048576->2097151) 00002000:00010000:1.0:1746147129.531714:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151500 00000100:00100000:1.0:1746147129.531734:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307597184 00000100:00100000:1.0:1746147129.531737:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307597184 00002000:00100000:1.0:1746147129.531747:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880134868a80 x1830967307597184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.531754:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134868a80 with x1830967307597184 ext(1048576->2097151) 00002000:00010000:1.0:1746147129.531757:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134868a80 00000100:00100000:1.0:1746147129.531766:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307597440 00000100:00100000:1.0:1746147129.531768:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307597440 00002000:00100000:1.0:1746147129.531777:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880129f56d80 x1830967307597440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.531783:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967307597440 ext(1048576->2097151) 00002000:00010000:1.0:1746147129.531786:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56d80 00000100:00100000:1.0:1746147129.531798:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3055 00000100:00100000:1.0:1746147129.531807:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967307596672:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147129.531824:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3056 00000100:00100000:0.0:1746147129.531831:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967307596928:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147129.532625:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3058 00000100:00100000:1.0:1746147129.532631:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967307597440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147129.532763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.541241:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967307596672:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9421us (9711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.541255:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3055 00002000:00100000:1.0:1746147129.541267:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880099150380 x1830967307596672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.541277:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150380 with x1830967307596672 ext(0->1048575) 00010000:00010000:1.0:1746147129.541288:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fcc00/0x3139939425053bb3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76780 expref: 45 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:1.0:1746147129.541301:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fcc00/0x3139939425053bb3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76780 expref: 45 pid: 1398 timeout: 767 lvb_type: 1 00002000:00010000:1.0:1746147129.541308:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099150380 00000100:00100000:0.0:1746147129.544292:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.545849:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307596928:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14016us (14300us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.545858:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3056 00002000:00100000:1.0:1746147129.545867:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099151500 x1830967307596928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.545876:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151500 with x1830967307596928 ext(1048576->2097151) 00002000:00010000:1.0:1746147129.545881:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151500 00000100:00100000:0.0:1746147129.550775:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.557747:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307598080 00000100:00100000:0.0:1746147129.557756:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307598080 00000100:00100000:1.0:1746147129.557993:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967307597440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 25360us (26394us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147129.558006:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3058 00002000:00100000:1.0:1746147129.558020:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880129f56d80 x1830967307597440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.558029:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967307597440 ext(1048576->2097151) 00002000:00010000:1.0:1746147129.558036:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56d80 00000100:00100000:0.0:1746147129.564846:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310526848:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147129.564873:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.565006:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307598464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6334us (6566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.565017:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5871 00000100:00100000:1.0:1746147129.565062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.565103:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307598848 00000100:00100000:0.0:1746147129.565110:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307598848 00002000:00100000:0.0:1746147129.565151:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (524288->528383) req@ffff8800984d6a00 x1830967307598848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.565161:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6a00 with x1830967307598848 ext(524288->528383) 00002000:00010000:0.0:1746147129.565165:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6a00 00000100:00100000:0.0:1746147129.565260:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307598976 00000100:00100000:0.0:1746147129.565263:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307598976 00002000:00100000:0.0:1746147129.565277:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88012ca13800 x1830967307598976/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.565284:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13800 with x1830967307598976 ext(1048576->2097151) 00002000:00010000:0.0:1746147129.565288:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca13800 00000100:00100000:0.0:1746147129.565300:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3060 00000100:00100000:0.0:1746147129.565307:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967307598848:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147129.565535:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967307598848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 227us (473us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147129.565542:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3060 00002000:00100000:0.0:1746147129.565547:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (524288->528383) req@ffff8800984d6a00 x1830967307598848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.565553:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6a00 with x1830967307598848 ext(524288->528383) 00002000:00010000:0.0:1746147129.565556:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6a00 00000100:00100000:0.0:1746147129.573741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.573810:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307599232 00000100:00100000:1.0:1746147129.573869:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307599232 00002000:00100000:1.0:1746147129.573914:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (1040384->1044479) req@ffff8800a5576d80 x1830967307599232/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.573924:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576d80 with x1830967307599232 ext(1040384->1044479) 00002000:00010000:1.0:1746147129.573930:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576d80 00000100:00100000:1.0:1746147129.573953:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3062 00000100:00100000:1.0:1746147129.573961:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307599232:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147129.574926:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.575448:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307599232:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1486us (1716us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147129.575454:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3062 00002000:00100000:1.0:1746147129.575460:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (1040384->1044479) req@ffff8800a5576d80 x1830967307599232/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.575466:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576d80 with x1830967307599232 ext(1040384->1044479) 00002000:00010000:1.0:1746147129.575469:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576d80 00000100:00100000:0.0:1746147129.577798:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.583160:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307599744 00000100:00100000:1.0:1746147129.583164:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307599744 00002000:00100000:1.0:1746147129.583202:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801323d4700 x1830967307599744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 504/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.583211:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4700 with x1830967307599744 ext(2097152->4194303) 00002000:00010000:1.0:1746147129.583216:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d4700 00000100:00100000:1.0:1746147129.583232:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3064 00000100:00100000:1.0:1746147129.583237:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967307599744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147129.592760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.598166:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967307599744:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14927us (15257us total) trans 0 rc 2007040/2007040 00000100:00100000:0.0:1746147129.598173:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3064 00002000:00100000:0.0:1746147129.598179:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801323d4700 x1830967307599744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 504/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 2007040/2007040 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.598198:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4700 with x1830967307599744 ext(2097152->4194303) 00002000:00010000:0.0:1746147129.598202:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d4700 00000100:00100000:0.0:1746147129.610401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.613228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.613262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.617511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.625487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.634723:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.637798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.640299:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.640522:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307601664 00000100:00100000:1.0:1746147129.640528:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307601664 00000100:00100000:1.0:1746147129.640577:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13611 00000100:00100000:1.0:1746147129.640586:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307601664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147129.640601:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.640620:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fce00/0x3139939425053c1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e767e2 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.640660:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310527488:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147129.640824:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147129.642881:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310527488:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147129.642913:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fce00/0x3139939425053c1c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767e2 expref: 43 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.642926:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fce00/0x3139939425053c1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767e2 expref: 43 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.642941:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fce00, rc 0) 00000100:00100000:1.0:1746147129.642969:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307601664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2383us (2677us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147129.642976:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13611 00000100:00100000:0.0:1746147129.645893:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.646607:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.653519:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.653577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.676451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.694285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147129.722773:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874018 is committed 00000001:00080000:0.0:1746147129.722866:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874000 is committed 00000001:00080000:0.0:1746147129.722898:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873987 is committed 00000001:00080000:0.0:1746147129.722960:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873955 is committed 00000100:00100000:0.0:1746147129.775178:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.777977:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.783874:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310527872:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147129.783918:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425053c4d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767f7 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.783932:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425053c4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767f7 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147129.784527:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714c00, rc 0) 00000100:00100000:0.0:1746147129.784589:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307603712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6313us (6617us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147129.784599:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13613 00000100:00100000:0.0:1746147129.784630:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307603840 00000100:00100000:0.0:1746147129.784635:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307603840 00000100:00100000:1.0:1746147129.784700:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13614 00000100:00100000:1.0:1746147129.784711:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967307603840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147129.784728:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.784744:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fcc00/0x3139939425053c54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e767fe expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.784764:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.784766:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.784774:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fcc00/0x3139939425053c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767fe expref: 24 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.784789:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fcc00/0x3139939425053c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767fe expref: 24 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.784798:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fcc00, rc 0) 00000100:00100000:1.0:1746147129.784831:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307603840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 122us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.784836:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13614 00000100:00100000:0.0:1746147129.792909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.795242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.795277:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.796346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.804963:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.811739:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.811822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.811837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.811866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.811917:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307604864 00000100:00100000:0.0:1746147129.811923:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307604864 00010000:00010000:0.0:1746147129.811952:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x3139939425053bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76795 expref: 27 pid: 1398 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746147129.811988:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307604992 00000100:00100000:0.0:1746147129.811991:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307604992 00010000:00010000:0.0:1746147129.812001:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425053bf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767b8 expref: 10 pid: 9586 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746147129.812014:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5875 00000100:00100000:0.0:1746147129.812021:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307604864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147129.812034:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147129.812053:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x3139939425053bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76795 expref: 27 pid: 1398 timeout: 767 lvb_type: 1 00000100:00100000:1.0:1746147129.812386:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5878 00000100:00100000:1.0:1746147129.812394:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307605248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.812401:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.812410:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f972e00/0x3139939425053be4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767aa expref: 11 pid: 9584 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.812423:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f972e00/0x3139939425053be4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->1044479) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767aa expref: 11 pid: 9584 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.812443:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f972e00/0x3139939425053be4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->1044479) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767aa expref: 11 pid: 9584 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.812462:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.812463:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.812470:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.812478:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.812508:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.812518:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310528768:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147129.812584:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00010000:00010000:0.0:1746147129.813115:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x3139939425053bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76795 expref: 27 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.813130:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x3139939425053bc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76795 expref: 27 pid: 1398 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746147129.813144:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147129.813170:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967307604864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1148us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.813176:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5875 00000100:00100000:0.0:1746147129.813268:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:31863:x1830967307604736:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8023us (8315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147129.813274:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13616 00000100:00100000:1.0:1746147129.817588:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310528768:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147129.817612:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147129.817665:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307605248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5270us (5795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.817675:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5878 00000100:00100000:0.0:1746147129.819548:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.819620:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.819643:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307605504 00000100:00100000:0.0:1746147129.819650:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307605504 00002000:00100000:0.0:1746147129.819696:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098859180 x1830967307605504/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.819706:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859180 with x1830967307605504 ext(0->1048575) 00002000:00010000:0.0:1746147129.819711:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098859180 00000100:00100000:0.0:1746147129.819728:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307605760 00000100:00100000:0.0:1746147129.819730:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307605760 00002000:00100000:0.0:1746147129.819740:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1667072->1671167) req@ffff88009885b800 x1830967307605760/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.819746:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b800 with x1830967307605760 ext(1667072->1671167) 00002000:00010000:0.0:1746147129.819749:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885b800 00000100:00100000:0.0:1746147129.819766:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3071 00000100:00100000:0.0:1746147129.819773:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967307605504:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147129.821236:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3072 00000100:00100000:1.0:1746147129.821249:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307605760:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147129.821344:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307605760:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 98us (1723us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147129.821351:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3072 00002000:00100000:1.0:1746147129.821358:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1667072->1671167) req@ffff88009885b800 x1830967307605760/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.821368:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b800 with x1830967307605760 ext(1667072->1671167) 00002000:00010000:1.0:1746147129.821373:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885b800 00000100:00100000:0.0:1746147129.840864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.841312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.860269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.860347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.861249:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3075 00000100:00100000:1.0:1746147129.861256:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307606528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147129.872574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.874542:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307606528:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 13281us (14188us total) trans 0 rc 618496/618496 00000100:00100000:1.0:1746147129.874552:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3075 00002000:00100000:1.0:1746147129.874561:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1667071) req@ffff880097d76a00 x1830967307606528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/440 e 0 to 0 dl 1746147140 ref 1 fl Complete:/200/0 rc 618496/618496 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.874570:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76a00 with x1830967307606528 ext(1048576->1667071) 00002000:00010000:1.0:1746147129.874573:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d76a00 00000100:00100000:0.0:1746147129.874857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.879445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.880374:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.885151:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.888400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.892486:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.893526:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.901262:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307608320:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7555us (7723us total) trans 21474841287 rc 0/0 00000100:00100000:0.0:1746147129.901274:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 984 00002000:00100000:0.0:1746147129.901287:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2723840->2949119) req@ffff880097d74380 x1830967307608320/t21474841287(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:505/0 lens 488/448 e 0 to 0 dl 1746147140 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.901297:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74380 with x1830967307608320 ext(2723840->2949119) 00010000:00010000:0.0:1746147129.901307:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715a00/0x3139939425053ca1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76821 expref: 10 pid: 9586 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.901323:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715a00/0x3139939425053ca1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76821 expref: 10 pid: 9586 timeout: 767 lvb_type: 0 00002000:00010000:0.0:1746147129.901330:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d74380 00000100:00100000:0.0:1746147129.904897:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.913895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.929608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.934646:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.934696:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.934743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.934815:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307609088 00000100:00100000:1.0:1746147129.934825:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307609088 00000100:00100000:1.0:1746147129.934869:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307609344 00000100:00100000:1.0:1746147129.934871:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307609344 00000100:00100000:1.0:1746147129.934883:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307609216 00000100:00100000:1.0:1746147129.934885:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307609216 00000100:00100000:1.0:1746147129.934898:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13619 00000100:00100000:1.0:1746147129.934907:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307609088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147129.934925:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.934944:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76836 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.934968:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.934970:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.934980:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.934995:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.935004:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56200, rc 0) 00000100:00100000:1.0:1746147129.935053:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307609088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 146us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147129.935059:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13619 00000100:00100000:1.0:1746147129.935075:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13621 00000100:00100000:1.0:1746147129.935079:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307609216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147129.935085:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147129.935117:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425053ce0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7683d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.935158:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310529664:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147129.935228:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147129.942982:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310529664:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147129.943020:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425053ce0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7683d expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147129.943034:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425053ce0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7683d expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147129.943425:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.943467:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307609728 00000100:00100000:0.0:1746147129.943474:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307609728 00000100:00100000:0.0:1746147129.943531:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5330 00000100:00100000:0.0:1746147129.943540:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:31860:x1830967307609728:12345-192.168.204.25@tcp:35:cat.0 00010000:00010000:1.0:1746147129.943772:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56e00, rc 0) 00000100:00100000:1.0:1746147129.943822:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307609216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8742us (9079us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147129.943830:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13621 00000100:00100000:0.0:1746147129.951426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.973330:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.974846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147129.979186:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307610496 00000100:00100000:0.0:1746147129.979193:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307610496 00002000:00100000:0.0:1746147129.979239:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1667072->1900543) req@ffff880094186d80 x1830967307610496/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/0 e 0 to 0 dl 1746147140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147129.979248:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967307610496 ext(1667072->1900543) 00010000:00010000:0.0:1746147129.979254:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 25 pid: 9586 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746147129.979268:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 25 pid: 9586 timeout: 767 lvb_type: 0 00002000:00010000:0.0:1746147129.979273:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094186d80 00000100:00100000:0.0:1746147129.979301:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 985 00000100:00100000:0.0:1746147129.979308:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307610496:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147129.982840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.986672:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307610496:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7353us (8061us total) trans 17179874020 rc 0/0 00000100:00100000:1.0:1746147129.986685:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 985 00002000:00100000:1.0:1746147129.986697:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1667072->1900543) req@ffff880094186d80 x1830967307610496/t17179874020(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:505/0 lens 488/448 e 0 to 0 dl 1746147140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147129.986707:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967307610496 ext(1667072->1900543) 00010000:00010000:1.0:1746147129.986717:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 27 pid: 9586 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.986732:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 27 pid: 9586 timeout: 767 lvb_type: 0 00002000:00010000:1.0:1746147129.986739:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094186d80 00000100:00100000:0.0:1746147129.996938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147129.997115:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307610880 00000100:00100000:1.0:1746147129.997126:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307610880 00010000:00010000:1.0:1746147129.997165:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 27 pid: 9586 timeout: 767 lvb_type: 0 00000100:00100000:1.0:1746147129.997215:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5882 00000100:00100000:1.0:1746147129.997223:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307610880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147129.997239:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147129.997260:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 27 pid: 9586 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.997272:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 27 pid: 9586 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.997296:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x3139939425053c77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->1900543) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76813 expref: 27 pid: 9586 timeout: 767 lvb_type: 0 00010000:00010000:1.0:1746147129.997315:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.997317:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147129.997324:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053ce7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7684b expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.997332:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053ce7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7684b expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147129.997643:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425053ce7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7684b expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147129.997656:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310529920:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147129.997956:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147130.001413:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310529920:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147130.001432:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.001469:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967307610880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4246us (4543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.001479:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5882 00000100:00100000:0.0:1746147130.001681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.001821:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307611136 00000100:00100000:1.0:1746147130.001827:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307611136 00002000:00100000:1.0:1746147130.001906:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880099888a80 x1830967307611136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.001916:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888a80 with x1830967307611136 ext(1048576->2097151) 00002000:00010000:1.0:1746147130.001920:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099888a80 00000100:00080000:0.0:1746147130.001978:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147130.002150:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3078 00000100:00100000:1.0:1746147130.002158:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307611136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147130.015190:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307611136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13008us (13485us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147130.015204:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3078 00002000:00100000:1.0:1746147130.015218:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880099888a80 x1830967307611136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/440 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.015228:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888a80 with x1830967307611136 ext(1048576->2097151) 00002000:00010000:1.0:1746147130.015235:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099888a80 00000100:00100000:0.0:1746147130.029709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147130.030287:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147130.032424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.032696:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307611648 00000100:00100000:1.0:1746147130.032704:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307611648 00002000:00100000:1.0:1746147130.032746:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009988a680 x1830967307611648/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00080000:0.0:1746147130.032761:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746147130.032763:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988a680 with x1830967307611648 ext(2097152->4194303) 00002000:00010000:1.0:1746147130.032768:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009988a680 00000100:00100000:1.0:1746147130.033328:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3079 00000100:00100000:1.0:1746147130.033339:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307611648:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.042335:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.042499:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307611776 00000100:00100000:1.0:1746147130.042509:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307611776 00000100:00100000:1.0:1746147130.042573:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 764 00000100:00100000:1.0:1746147130.042581:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307611776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.042596:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.042623:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x3139939425053d26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76859 expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.042643:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.042648:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.043083:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307611776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 502us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.043120:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 764 00000100:00100000:1.0:1746147130.055248:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307611648:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21899us (22813us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147130.055260:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3079 00002000:00100000:1.0:1746147130.055271:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009988a680 x1830967307611648/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/440 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.055281:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988a680 with x1830967307611648 ext(2097152->4194303) 00002000:00010000:1.0:1746147130.055287:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009988a680 00000100:00100000:0.0:1746147130.064593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.071407:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.071439:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.071469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.071517:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307612160 00000100:00100000:0.0:1746147130.071518:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307612032 00000100:00100000:1.0:1746147130.071525:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307612160 00000100:00100000:0.0:1746147130.071526:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307612032 00010000:00010000:1.0:1746147130.071561:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32e00/0x3139939425053cd9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76844 expref: 13 pid: 9584 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.071567:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13624 00000100:00100000:0.0:1746147130.071575:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307612032:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147130.071582:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307612288 00000100:00100000:1.0:1746147130.071584:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307612288 00010000:00010000:0.0:1746147130.071592:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.071601:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093714800/0x3139939425053ca8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76828 expref: 24 pid: 9586 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.071610:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f966000/0x3139939425053d3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76867 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.071616:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5883 00000100:00100000:1.0:1746147130.071621:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307612160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.071631:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.071631:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.071642:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f966000/0x3139939425053d3b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76867 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.071648:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db32e00/0x3139939425053cd9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76844 expref: 14 pid: 9584 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.071652:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f966000/0x3139939425053d3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76867 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.071658:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db32e00/0x3139939425053cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76844 expref: 14 pid: 9584 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.071667:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f966000, rc 0) 00010000:00010000:1.0:1746147130.071678:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.071710:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307612160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.071716:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5883 00000100:00080000:1.0:1746147130.071761:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147130.071978:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307612032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 401us (581us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147130.071985:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13624 00000100:00100000:0.0:1746147130.075152:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.075307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.075387:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307612544 00000100:00100000:1.0:1746147130.075394:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307612544 00002000:00100000:1.0:1746147130.075433:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2617344->2621439) req@ffff8800909f8000 x1830967307612544/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.075449:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967307612544 ext(2617344->2621439) 00002000:00010000:1.0:1746147130.075454:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8000 00000100:00100000:1.0:1746147130.075486:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3080 00000100:00100000:1.0:1746147130.075494:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307612544:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147130.075616:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307612544:12345-192.168.204.25@tcp:3:cat.0 Request processed in 122us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147130.075621:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3080 00002000:00100000:1.0:1746147130.075626:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2617344->2621439) req@ffff8800909f8000 x1830967307612544/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.075633:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967307612544 ext(2617344->2621439) 00002000:00010000:1.0:1746147130.075647:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8000 00000100:00100000:0.0:1746147130.080040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.083282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.117549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.122469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.122555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.122585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.122656:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307613696 00000100:00100000:1.0:1746147130.122660:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307613696 00010000:00010000:1.0:1746147130.122689:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425053a8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76709 expref: 9 pid: 9585 timeout: 768 lvb_type: 1 00000100:00080000:0.0:1746147130.122802:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147130.124888:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.132840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.136642:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.136673:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.136706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.136729:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307614592 00000100:00100000:1.0:1746147130.136734:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307614592 00000100:00100000:0.0:1746147130.136735:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307614464 00000100:00100000:0.0:1746147130.136737:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307614464 00010000:00010000:1.0:1746147130.136751:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91c00/0x3139939425053bc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7678e expref: 24 pid: 1854 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.136751:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76710 expref: 8 pid: 9585 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.136926:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5889 00000100:00100000:0.0:1746147130.136932:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307614464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.136939:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.137047:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76710 expref: 8 pid: 9585 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.137063:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76710 expref: 8 pid: 9585 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.137076:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b000/0x3139939425053a94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76710 expref: 8 pid: 9585 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.137126:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.137154:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2001:x1830967307614464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 222us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.137159:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5889 00000100:00100000:0.0:1746147130.140322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.149628:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147130.150142:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147130.155797:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.155873:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307615232 00000100:00100000:1.0:1746147130.155882:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307615232 00000100:00100000:1.0:1746147130.155961:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5334 00000100:00100000:1.0:1746147130.155969:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:30600:x1830967307615232:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746147130.156907:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147130.157073:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:30600:x1830967307615232:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 1102us (1283us total) trans 8589935690 rc 0/0 00000100:00100000:1.0:1746147130.157081:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5334 00000100:00100000:0.0:1746147130.158366:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.161949:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.161987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.162012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.162030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.162052:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.162484:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13629 00000100:00100000:1.0:1746147130.162492:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307615744:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147130.162498:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.162506:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425053d7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76891 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.162529:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310531712:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147130.162549:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147130.162565:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13631 00000100:00100000:1.0:1746147130.162569:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307616000:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147130.162574:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.162580:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x3139939425053d88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7689f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.162599:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310531840:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147130.162614:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00080000:0.0:1746147130.162780:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1746147130.165704:0:10340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147129 -> 1746147130 00002000:00010000:1.0:1746147130.165708:0:10340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147129 -> 1746147130 00000100:00100000:1.0:1746147130.165716:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310531712:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147130.165732:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425053d7a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76891 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.165744:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425053d7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76891 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.165762:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56c00, rc 0) 00000100:00100000:1.0:1746147130.165808:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307615744:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3317us (3794us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147130.165816:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13629 00000100:00100000:1.0:1746147130.167002:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310531840:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147130.167021:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x3139939425053d88 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7689f expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.167031:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x3139939425053d88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7689f expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.167039:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56a00, rc 0) 00000100:00100000:1.0:1746147130.167306:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2002:x1830967307616000:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4735us (5252us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147130.167311:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13631 00000100:00100000:1.0:1746147130.170869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.175864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.178896:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.181715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147130.183455:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094009c00/0x3139939425053dab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147130.183461:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094009c00/0x3139939425053dab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147130.183510:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147130.183514:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147130.183530:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094009c00/0x3139939425053dab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147130.183560:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094008a00/0x3139939425053da4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768ad expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.183576:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094009c00/0x3139939425053dab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768ad expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.183581:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.183583:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147130.183585:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009c00, rc 0) 00000100:00100000:0.0:1746147130.183610:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31881:x1830967307616512:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4179us (4722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.183615:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15061 00000100:00100000:0.0:1746147130.187651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.188133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.188465:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307616768 00000100:00100000:1.0:1746147130.188476:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307616768 00000100:00100000:1.0:1746147130.188528:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307616896 00000100:00100000:1.0:1746147130.188531:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307616896 00000100:00100000:1.0:1746147130.188698:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13632 00000100:00100000:1.0:1746147130.188707:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307616768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147130.188727:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.188747:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425053db2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e768b4 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.188802:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310532224:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147130.188880:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.189818:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.191683:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310532224:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147130.191716:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425053db2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768b4 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.191729:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425053db2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768b4 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.191742:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:1.0:1746147130.191776:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307616768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3071us (4138us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147130.191783:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13632 00000100:00100000:0.0:1746147130.200501:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.204994:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.205038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.205069:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.205117:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.205142:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307617408 00000100:00100000:0.0:1746147130.205158:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307617408 00000100:00100000:0.0:1746147130.205210:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307617664 00000100:00100000:0.0:1746147130.205212:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307617664 00000100:00100000:0.0:1746147130.205224:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307617920 00000100:00100000:0.0:1746147130.205226:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307617920 00000100:00100000:0.0:1746147130.205237:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307617536 00000100:00100000:1.0:1746147130.205324:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13635 00000100:00100000:1.0:1746147130.205335:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307617408:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147130.205385:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.205404:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.205416:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.205424:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.205430:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.205432:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.205435:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.205841:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.205848:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 9 pid: 1398 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.206543:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307617536 00000100:00100000:0.0:1746147130.206568:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13640 00000100:00100000:0.0:1746147130.206573:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307617536:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147130.206590:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.206600:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 22 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.206605:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147130.206606:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147130.206608:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.206621:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 22 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.206629:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 22 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746147130.206636:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310533504:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.206661:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147130.206724:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310532992:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.206755:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.206763:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 13 pid: 9586 timeout: 768 lvb_type: 1 00000100:00100000:1.0:1746147130.206772:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310533632:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.206796:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.206804:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 25 pid: 9586 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.206811:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310533760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147130.206827:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.214954:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310532992:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.214963:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310533632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.214968:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310533760:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147130.214990:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.215144:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310533504:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.215156:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.221007:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.221070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.221126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.221141:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.221163:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.221202:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307618560 00000100:00100000:0.0:1746147130.221211:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307618560 00000100:00100000:1.0:1746147130.221232:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307618304 00000100:00100000:1.0:1746147130.221237:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307618304 00002000:00100000:0.0:1746147130.221263:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->2097151) req@ffff8800a897e680 x1830967307618560/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746147130.221266:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425053d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76898 expref: 14 pid: 17600 timeout: 768 lvb_type: 1 00002000:00100000:0.0:1746147130.221271:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897e680 with x1830967307618560 ext(1323008->2097151) 00010000:00010000:0.0:1746147130.221280:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 23 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.221290:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307618816 00010000:00010000:0.0:1746147130.221290:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 23 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.221292:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307618816 00002000:00010000:0.0:1746147130.221295:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a897e680 00010000:00010000:1.0:1746147130.221299:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 15 pid: 9586 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.221306:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307618176 00000100:00100000:1.0:1746147130.221307:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619072 00000100:00100000:1.0:1746147130.221308:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619072 00000100:00100000:0.0:1746147130.221308:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307618176 00010000:00010000:1.0:1746147130.221314:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425053aa2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7671e expref: 16 pid: 12225 timeout: 768 lvb_type: 1 00002000:00100000:0.0:1746147130.221317:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1216511) req@ffff8800a897d180 x1830967307618176/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147130.221323:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5894 00002000:00100000:0.0:1746147130.221323:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d180 with x1830967307618176 ext(1048576->1216511) 00010000:00010000:0.0:1746147130.221327:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 24 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.221329:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307618304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.221340:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 24 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.221341:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147130.221345:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a897d180 00010000:00010000:1.0:1746147130.221356:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425053d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76898 expref: 16 pid: 17600 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.221362:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 986 00010000:00010000:1.0:1746147130.221364:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425053d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76898 expref: 16 pid: 17600 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.221367:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307618560:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:1.0:1746147130.221383:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425053d81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76898 expref: 16 pid: 17600 timeout: 768 lvb_type: 1 00010000:00010000:1.0:1746147130.221402:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.221536:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307618304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 205us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.221544:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5894 00000100:00100000:1.0:1746147130.221560:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5895 00000100:00100000:1.0:1746147130.221565:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307618816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.221573:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.221582:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 14 pid: 9586 timeout: 768 lvb_type: 1 00010000:00010000:1.0:1746147130.221595:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 14 pid: 9586 timeout: 768 lvb_type: 1 00010000:00010000:1.0:1746147130.221607:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714000/0x3139939425053d6c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76883 expref: 14 pid: 9586 timeout: 768 lvb_type: 1 00010000:00010000:1.0:1746147130.221621:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.221773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.221785:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307618432 00000100:00100000:0.0:1746147130.221788:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307618432 00002000:00100000:0.0:1746147130.221803:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2617344->3043327) req@ffff8800984d4e00 x1830967307618432/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.221810:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4e00 with x1830967307618432 ext(2617344->3043327) 00010000:00010000:0.0:1746147130.221815:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7c00/0x3139939425053d34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76860 expref: 8 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.221823:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7c00/0x3139939425053d34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76860 expref: 8 pid: 1398 timeout: 768 lvb_type: 0 00002000:00010000:0.0:1746147130.221829:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d4e00 00000100:00100000:0.0:1746147130.221841:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 988 00000100:00100000:0.0:1746147130.221845:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307618432:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147130.221978:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307618816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 412us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.221985:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5895 00000100:00100000:1.0:1746147130.222160:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.235682:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.235712:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.235726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.235754:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.235777:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307618944 00000100:00100000:0.0:1746147130.235786:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307618944 00010000:00010000:0.0:1746147130.235825:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 9 pid: 1398 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.235852:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619328 00000100:00100000:0.0:1746147130.235854:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619328 00010000:00010000:0.0:1746147130.235875:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425053bcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7679c expref: 26 pid: 1854 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.235889:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619200 00000100:00100000:0.0:1746147130.235890:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619200 00010000:00010000:0.0:1746147130.235898:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 27 pid: 9586 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746147130.235905:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619456 00000100:00100000:0.0:1746147130.235906:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619456 00010000:00010000:0.0:1746147130.235913:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x3139939425053c00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767c6 expref: 10 pid: 9586 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746147130.235923:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5898 00000100:00100000:0.0:1746147130.235930:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307618944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.235944:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.235962:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 10 pid: 1398 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.235973:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 10 pid: 1398 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236001:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425053cd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76836 expref: 10 pid: 1398 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236026:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.236064:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307618944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.236070:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5898 00000100:00100000:0.0:1746147130.236086:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5899 00000100:00100000:0.0:1746147130.236109:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307619328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.236117:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.236125:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425053bcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7679c expref: 27 pid: 1854 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236133:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425053bcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7679c expref: 27 pid: 1854 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236145:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425053bcf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7679c expref: 27 pid: 1854 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236153:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.236166:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307619328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 58us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.236185:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5899 00000100:00100000:0.0:1746147130.236195:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5900 00000100:00100000:0.0:1746147130.236200:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307619200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.236207:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.236214:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 25 pid: 9586 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.236221:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 25 pid: 9586 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.236231:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425053c69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7680c expref: 25 pid: 9586 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.236239:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.236241:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.236246:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236253:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236276:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.236289:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307619200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 89us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.236294:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5900 00000100:00100000:0.0:1746147130.236305:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5901 00000100:00100000:0.0:1746147130.236309:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307619456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.236314:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.236320:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x3139939425053c00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767c6 expref: 8 pid: 9586 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236332:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x3139939425053c00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767c6 expref: 8 pid: 9586 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236341:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x3139939425053c00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e767c6 expref: 8 pid: 9586 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746147130.236349:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.236350:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.236353:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236358:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236371:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.236385:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307619456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.236390:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5901 00000100:00080000:0.0:1746147130.236408:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147130.236420:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236427:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236443:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236454:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236461:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236467:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147130.236471:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236478:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236486:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236490:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425053ddc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.236530:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307617408:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 31198us (31547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.236538:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13635 00010000:00010000:0.0:1746147130.236640:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236648:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236660:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236666:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236671:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236676:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147130.236678:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236683:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236690:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.236696:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425053dea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.236726:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307617920:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 31030us (31656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.236731:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13637 00000100:00100000:1.0:1746147130.244246:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307618176:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 22690us (23078us total) trans 21474841289 rc 0/0 00000100:00100000:1.0:1746147130.244254:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 987 00002000:00100000:1.0:1746147130.244260:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1216511) req@ffff8800a897d180 x1830967307618176/t21474841289(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/448 e 0 to 0 dl 1746147141 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.244267:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d180 with x1830967307618176 ext(1048576->1216511) 00010000:00010000:1.0:1746147130.244273:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 27 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.244282:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 27 pid: 1398 timeout: 768 lvb_type: 0 00002000:00010000:1.0:1746147130.244287:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a897d180 00000100:00100000:0.0:1746147130.249246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.250383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.250620:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.250638:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619712 00000100:00100000:0.0:1746147130.250647:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619712 00000100:00100000:0.0:1746147130.250693:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 178 00000100:00100000:0.0:1746147130.250701:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2000:x1830967307619712:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147130.250767:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2000:x1830967307619712:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 65us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.250773:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 178 00000100:00100000:1.0:1746147130.250821:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619840 00000100:00100000:1.0:1746147130.250826:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619840 00000100:00100000:1.0:1746147130.250872:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307620096 00000100:00100000:1.0:1746147130.250875:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307620096 00000100:00100000:1.0:1746147130.250891:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 837 00000100:00100000:1.0:1746147130.250896:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2000:x1830967307619840:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1746147130.250925:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2000:x1830967307619840:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 29us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.250930:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 837 00000100:00100000:1.0:1746147130.250942:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 838 00000100:00100000:1.0:1746147130.250946:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2000:x1830967307620096:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1746147130.250964:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2000:x1830967307620096:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 17us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.250968:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 838 00000100:00080000:1.0:1746147130.250985:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746147130.251164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.251296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.251975:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307619584 00000100:00100000:0.0:1746147130.251978:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307619584 00010000:00010000:0.0:1746147130.252000:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 27 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746147130.252022:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5902 00000100:00100000:0.0:1746147130.252026:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307619584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.252035:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.252054:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 27 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.252065:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 27 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.252101:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x3139939425053d42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7686e expref: 27 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.252117:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.252119:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.252124:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252132:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252155:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.252190:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307619584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 162us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.252196:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5902 00010000:00010000:0.0:1746147130.252279:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252287:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252302:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252309:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252316:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252322:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147130.252325:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252337:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252346:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.252351:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x3139939425053dff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.252392:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307617536:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 45818us (47274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.252399:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13640 00000100:00080000:1.0:1746147130.252601:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746147130.252885:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.253552:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.253620:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307620224 00000100:00100000:1.0:1746147130.253626:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307620224 00010000:00010000:1.0:1746147130.253651:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 26 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.253678:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307620352 00000100:00100000:1.0:1746147130.253680:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307620352 00010000:00010000:1.0:1746147130.253691:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7c00/0x3139939425053d34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76860 expref: 10 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.253706:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5903 00000100:00100000:1.0:1746147130.253711:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307620224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.253719:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.253732:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 26 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.253746:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 26 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.253763:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425053d49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76875 expref: 26 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746147130.254188:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5904 00000100:00100000:0.0:1746147130.254194:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307620352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.254201:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.254210:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7c00/0x3139939425053d34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76860 expref: 10 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.254219:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7c00/0x3139939425053d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76860 expref: 10 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.254230:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7c00/0x3139939425053d34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76860 expref: 10 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.254245:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.254247:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.254250:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425053df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.254257:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425053df8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.254510:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.254539:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307620352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 345us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.254544:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5904 00010000:00010000:1.0:1746147130.254650:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.254652:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.254654:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6800/0x3139939425053de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.254661:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6800/0x3139939425053de3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.255000:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.255019:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307620224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1307us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.255026:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5903 00000100:00100000:0.0:1746147130.259139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.266350:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e11880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310534016:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.266362:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e10000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310534144:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.266370:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013486a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310534272:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.266377:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134868700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310534400:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147130.266408:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147130.266931:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5906 00000100:00100000:0.0:1746147130.266939:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307620736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.266947:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.266952:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425053b66 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7674f expref: 37 pid: 6215 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.266962:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425053b66 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7674f expref: 37 pid: 6215 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.266976:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425053b66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7674f expref: 37 pid: 6215 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.266991:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.266996:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147130.267005:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.267108:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5908 00000100:00100000:1.0:1746147130.267115:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307621120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.267121:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.267125:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7600/0x3139939425053bdd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76779 expref: 17 pid: 6215 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.267133:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7600/0x3139939425053bdd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76779 expref: 17 pid: 6215 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.267147:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7600/0x3139939425053bdd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76779 expref: 17 pid: 6215 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.267159:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.267162:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.267168:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.267188:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.267203:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.268228:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307621120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1114us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.268234:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5908 00000100:00100000:0.0:1746147130.268237:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307620736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1298us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.268245:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5906 00010000:00010000:0.0:1746147130.268266:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147130.268273:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000040:00080000:0.0:1746147130.268904:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].441, 88 off46856 00000004:00080000:0.0:1746147130.268925:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668258834367ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.269180:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].395, 88 off42808 00000004:00080000:0.0:1746147130.269187:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259097443ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.269203:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].396, 88 off42896 00000004:00080000:0.0:1746147130.269206:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259116724ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.269435:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].442, 88 off46944 00000004:00080000:0.0:1746147130.269440:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259350388ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269547:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].443, 88 off47032 00000004:00080000:1.0:1746147130.269554:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259464812ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269577:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].397, 88 off42984 00000004:00080000:1.0:1746147130.269580:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259490208ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147130.269600:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].398, 88 off43072 00000004:00080000:1.0:1746147130.269603:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259513854ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147130.269611:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].399, 88 off43160 00000004:00080000:1.0:1746147130.269614:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259524382ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147130.269621:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].444, 88 off47120 00000004:00080000:1.0:1746147130.269624:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259534443ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269632:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].400, 88 off43248 00000004:00080000:1.0:1746147130.269635:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259545954ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147130.269643:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].445, 88 off47208 00000004:00080000:1.0:1746147130.269646:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259556204ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269653:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].401, 88 off43336 00000004:00080000:1.0:1746147130.269655:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259565773ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147130.269663:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].446, 88 off47296 00000004:00080000:1.0:1746147130.269665:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259575487ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269673:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].447, 88 off47384 00000004:00080000:1.0:1746147130.269676:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259586608ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269684:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].448, 88 off47472 00000004:00080000:1.0:1746147130.269686:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259596543ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269693:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].449, 88 off47560 00000004:00080000:1.0:1746147130.269695:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668259606009ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147130.269704:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].402, 88 off43424 00000004:00080000:1.0:1746147130.269706:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668259617032ns, next at 554081490131ns, rc = 0 00000100:00100000:0.0:1746147130.274543:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310534784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.274615:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.274642:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.274657:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.274676:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.274694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.274707:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746147130.274712:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013486a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310534656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.274725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.274733:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.274745:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.274753:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.274764:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.274787:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534784 00000100:00100000:0.0:1746147130.274794:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534784 00000100:00100000:0.0:1746147130.274823:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535296 00000100:00100000:0.0:1746147130.274825:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535296 00000100:00100000:0.0:1746147130.274833:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535808 00000100:00100000:0.0:1746147130.274835:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535808 00000100:00100000:0.0:1746147130.274845:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534656 00000100:00100000:0.0:1746147130.274847:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534656 00000100:00100000:0.0:1746147130.274856:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535168 00000100:00100000:0.0:1746147130.274858:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535168 00000100:00100000:0.0:1746147130.274866:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535680 00000100:00100000:0.0:1746147130.274867:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535680 00000100:00100000:0.0:1746147130.274877:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13641 00000100:00100000:0.0:1746147130.274884:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310534784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.274991:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13643 00000100:00100000:0.0:1746147130.274996:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3765:x1830967310535808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.275075:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3765:x1830967310535808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (380us total) trans 17179874021 rc 0/0 00000100:00100000:0.0:1746147130.275081:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13643 00000100:00100000:0.0:1746147130.275113:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13645 00000100:00100000:0.0:1746147130.275117:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310535168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147130.275161:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147130.275164:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147130.275166:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147130.275179:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147130.275181:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147130.275201:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310535168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (455us total) trans 21474841294 rc 0/0 00000100:00100000:0.0:1746147130.275207:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13645 00000100:00100000:0.0:1746147130.275446:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310536320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.275466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.275488:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841281 gen 2 00000004:00080000:0.0:1746147130.275493:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0d180, transno 21474841149 00000004:00080000:0.0:1746147130.275499:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0ce00, transno 21474841150 00000004:00080000:0.0:1746147130.275501:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5880, transno 21474841151 00000004:00080000:0.0:1746147130.275504:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0c700, transno 21474841152 00000004:00080000:0.0:1746147130.275506:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0ca80, transno 21474841153 00000004:00080000:0.0:1746147130.275508:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0fb80, transno 21474841154 00000004:00080000:0.0:1746147130.275510:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0dc00, transno 21474841155 00000004:00080000:0.0:1746147130.275512:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0f100, transno 21474841156 00000004:00080000:0.0:1746147130.275515:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72d80, transno 21474841161 00000004:00080000:0.0:1746147130.275518:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73480, transno 21474841162 00000004:00080000:0.0:1746147130.275520:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c71f80, transno 21474841163 00000004:00080000:0.0:1746147130.275522:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72680, transno 21474841164 00000004:00080000:0.0:1746147130.275525:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70380, transno 21474841165 00000004:00080000:0.0:1746147130.275527:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72a00, transno 21474841166 00000004:00080000:0.0:1746147130.275529:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70e00, transno 21474841167 00000004:00080000:0.0:1746147130.275531:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73800, transno 21474841168 00000004:00080000:0.0:1746147130.275533:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97b80, transno 21474841169 00000004:00080000:0.0:1746147130.275536:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d95500, transno 21474841170 00000004:00080000:0.0:1746147130.275538:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486300, transno 21474841171 00000004:00080000:0.0:1746147130.275540:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e484000, transno 21474841172 00000004:00080000:0.0:1746147130.275542:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062680, transno 21474841173 00000004:00080000:0.0:1746147130.275544:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485c00, transno 21474841174 00000004:00080000:0.0:1746147130.275546:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487480, transno 21474841175 00000004:00080000:0.0:1746147130.275548:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485500, transno 21474841176 00000004:00080000:0.0:1746147130.275549:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062d80, transno 21474841177 00000004:00080000:0.0:1746147130.275551:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062300, transno 21474841178 00000004:00080000:0.0:1746147130.275553:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062a00, transno 21474841179 00000004:00080000:0.0:1746147130.275555:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063b80, transno 21474841180 00000004:00080000:0.0:1746147130.275556:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063480, transno 21474841181 00000004:00080000:0.0:1746147130.275558:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095060700, transno 21474841182 00000004:00080000:0.0:1746147130.275560:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095060e00, transno 21474841183 00000004:00080000:0.0:1746147130.275562:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095060000, transno 21474841184 00000004:00080000:0.0:1746147130.275564:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca20700, transno 21474841192 00000004:00080000:0.0:1746147130.275566:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988b480, transno 21474841193 00000004:00080000:0.0:1746147130.275568:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988bb80, transno 21474841194 00000004:00080000:0.0:1746147130.275570:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099889180, transno 21474841195 00000004:00080000:0.0:1746147130.275572:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca20380, transno 21474841196 00000004:00080000:0.0:1746147130.275574:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988b100, transno 21474841197 00000004:00080000:0.0:1746147130.275576:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca20000, transno 21474841198 00000004:00080000:0.0:1746147130.275578:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099888700, transno 21474841199 00000004:00080000:0.0:1746147130.275580:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca20e00, transno 21474841204 00000004:00080000:0.0:1746147130.275582:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21500, transno 21474841205 00000004:00080000:0.0:1746147130.275584:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21180, transno 21474841206 00000004:00080000:0.0:1746147130.275586:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21880, transno 21474841207 00000004:00080000:0.0:1746147130.275588:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21c00, transno 21474841208 00000004:00080000:0.0:1746147130.275590:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca22680, transno 21474841209 00000004:00080000:0.0:1746147130.275592:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21f80, transno 21474841210 00000004:00080000:0.0:1746147130.275594:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca22300, transno 21474841211 00000004:00080000:0.0:1746147130.275596:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0c000, transno 21474841212 00000004:00080000:0.0:1746147130.275599:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930eaa00, transno 21474841213 00000004:00080000:0.0:1746147130.275601:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9880, transno 21474841214 00000004:00080000:0.0:1746147130.275603:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0ea00, transno 21474841215 00000004:00080000:0.0:1746147130.275605:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ebb80, transno 21474841216 00000004:00080000:0.0:1746147130.275607:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9f80, transno 21474841217 00000004:00080000:0.0:1746147130.275609:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ead80, transno 21474841218 00000004:00080000:0.0:1746147130.275611:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0df80, transno 21474841219 00000004:00080000:0.0:1746147130.275613:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8a80, transno 21474841227 00000004:00080000:0.0:1746147130.275615:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8700, transno 21474841228 00000004:00080000:0.0:1746147130.275617:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb100, transno 21474841229 00000004:00080000:0.0:1746147130.275619:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fbb80, transno 21474841230 00000004:00080000:0.0:1746147130.275621:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb480, transno 21474841231 00000004:00080000:0.0:1746147130.275623:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9880, transno 21474841232 00000004:00080000:0.0:1746147130.275625:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa680, transno 21474841233 00000004:00080000:0.0:1746147130.275627:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa300, transno 21474841234 00000004:00080000:0.0:1746147130.275629:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e503480, transno 21474841239 00000004:00080000:0.0:1746147130.275631:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e501c00, transno 21474841240 00000004:00080000:0.0:1746147130.275633:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e501180, transno 21474841241 00000004:00080000:0.0:1746147130.275634:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e503100, transno 21474841242 00000004:00080000:0.0:1746147130.275636:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e500700, transno 21474841243 00000004:00080000:0.0:1746147130.275639:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ce680, transno 21474841244 00000004:00080000:0.0:1746147130.275641:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e500000, transno 21474841245 00000004:00080000:0.0:1746147130.275643:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e503800, transno 21474841246 00000004:00080000:0.0:1746147130.275645:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094572300, transno 21474841247 00000004:00080000:0.0:1746147130.275647:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094571c00, transno 21474841248 00000004:00080000:0.0:1746147130.275649:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094572680, transno 21474841249 00000004:00080000:0.0:1746147130.275651:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094573100, transno 21474841250 00000004:00080000:0.0:1746147130.275653:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094573b80, transno 21474841251 00000004:00080000:0.0:1746147130.275655:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094573480, transno 21474841252 00000004:00080000:0.0:1746147130.275657:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094571f80, transno 21474841253 00000004:00080000:0.0:1746147130.275659:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094571880, transno 21474841254 00000004:00080000:0.0:1746147130.275661:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094571500, transno 21474841258 00000004:00080000:0.0:1746147130.275663:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9c00, transno 21474841259 00000004:00080000:0.0:1746147130.275665:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094572d80, transno 21474841260 00000004:00080000:0.0:1746147130.275667:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8380, transno 21474841261 00000004:00080000:0.0:1746147130.275669:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8e00, transno 21474841262 00000004:00080000:0.0:1746147130.275671:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ea300, transno 21474841263 00000004:00080000:0.0:1746147130.275673:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9180, transno 21474841264 00000004:00080000:0.0:1746147130.275675:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8000, transno 21474841265 00000004:00080000:0.0:1746147130.275677:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a1f80, transno 21474841270 00000004:00080000:0.0:1746147130.275679:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd44380, transno 21474841271 00000004:00080000:0.0:1746147130.275681:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a3480, transno 21474841272 00000004:00080000:0.0:1746147130.275684:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd47b80, transno 21474841273 00000004:00080000:0.0:1746147130.275686:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0700, transno 21474841274 00000004:00080000:0.0:1746147130.275688:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd44700, transno 21474841275 00000004:00080000:0.0:1746147130.275690:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a2300, transno 21474841276 00000004:00080000:0.0:1746147130.275692:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0e00, transno 21474841277 00000004:00080000:0.0:1746147130.275694:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd47480, transno 21474841278 00000004:00080000:0.0:1746147130.275696:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd46680, transno 21474841279 00000004:00080000:0.0:1746147130.275698:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd46300, transno 21474841280 00000004:00080000:0.0:1746147130.275700:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd45180, transno 21474841281 00000100:00100000:0.0:1746147130.275708:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009cd44a80 x1830967310525952/t21474841282(21474841282) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147145 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147130.275718:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013486a300/2, rc 0, transno 21474841293 00000100:00100000:0.0:1746147130.275722:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013486a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310534656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147130.275732:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfb800/2, rc 0, transno 21474841294 00000100:00100000:0.0:1746147130.275734:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.275741:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874018 gen 2 00000004:00080000:0.0:1746147130.275743:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f54a80, transno 17179873872 00000004:00080000:0.0:1746147130.275748:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55c00, transno 17179873873 00000004:00080000:0.0:1746147130.275751:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f56300, transno 17179873874 00000004:00080000:0.0:1746147130.275753:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55f80, transno 17179873875 00000004:00080000:0.0:1746147130.275755:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55180, transno 17179873876 00000004:00080000:0.0:1746147130.275757:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57b80, transno 17179873877 00000004:00080000:0.0:1746147130.275759:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f54380, transno 17179873878 00000004:00080000:0.0:1746147130.275761:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57480, transno 17179873879 00000004:00080000:0.0:1746147130.275763:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098820e00, transno 17179873880 00000004:00080000:0.0:1746147130.275765:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098821180, transno 17179873885 00000004:00080000:0.0:1746147130.275767:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57800, transno 17179873886 00000004:00080000:0.0:1746147130.275769:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098820700, transno 17179873887 00000004:00080000:0.0:1746147130.275771:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098822a00, transno 17179873888 00000004:00080000:0.0:1746147130.275773:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098823480, transno 17179873889 00000004:00080000:0.0:1746147130.275775:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009885a680, transno 17179873890 00000004:00080000:0.0:1746147130.275777:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098821c00, transno 17179873891 00000004:00080000:0.0:1746147130.275779:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321500, transno 17179873892 00000004:00080000:0.0:1746147130.275781:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094537b80, transno 17179873893 00000004:00080000:0.0:1746147130.275784:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8700, transno 17179873894 00000004:00080000:0.0:1746147130.275786:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312eb480, transno 17179873895 00000004:00080000:0.0:1746147130.275788:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5500, transno 17179873896 00000004:00080000:0.0:1746147130.275791:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8e00, transno 17179873897 00000004:00080000:0.0:1746147130.275793:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6680, transno 17179873898 00000004:00080000:0.0:1746147130.275795:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca0ed80, transno 17179873899 00000004:00080000:0.0:1746147130.275797:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6300, transno 17179873900 00000004:00080000:0.0:1746147130.275799:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4380, transno 17179873901 00000004:00080000:0.0:1746147130.275801:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150a80, transno 17179873902 00000004:00080000:0.0:1746147130.275803:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156300, transno 17179873903 00000004:00080000:0.0:1746147130.275805:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094187480, transno 17179873904 00000004:00080000:0.0:1746147130.275807:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157b80, transno 17179873905 00000004:00080000:0.0:1746147130.275809:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155f80, transno 17179873906 00000004:00080000:0.0:1746147130.275811:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099888380, transno 17179873907 00000004:00080000:0.0:1746147130.275813:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157480, transno 17179873908 00000004:00080000:0.0:1746147130.275815:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cdc00, transno 17179873909 00000004:00080000:0.0:1746147130.275817:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156a00, transno 17179873910 00000004:00080000:0.0:1746147130.275819:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154e00, transno 17179873911 00000004:00080000:0.0:1746147130.275821:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094536300, transno 17179873917 00000004:00080000:0.0:1746147130.275823:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397480, transno 17179873918 00000004:00080000:0.0:1746147130.275825:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094534380, transno 17179873919 00000004:00080000:0.0:1746147130.275827:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094535c00, transno 17179873920 00000004:00080000:0.0:1746147130.275829:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099010000, transno 17179873921 00000004:00080000:0.0:1746147130.275831:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11180, transno 17179873922 00000004:00080000:0.0:1746147130.275833:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c30b100, transno 17179873923 00000004:00080000:0.0:1746147130.275836:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cea00, transno 17179873924 00000004:00080000:0.0:1746147130.275838:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c30a680, transno 17179873925 00000004:00080000:0.0:1746147130.275840:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cce00, transno 17179873930 00000004:00080000:0.0:1746147130.275842:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ce300, transno 17179873931 00000004:00080000:0.0:1746147130.275844:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cc380, transno 17179873932 00000004:00080000:0.0:1746147130.275846:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cd500, transno 17179873933 00000004:00080000:0.0:1746147130.275848:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ced80, transno 17179873934 00000004:00080000:0.0:1746147130.275851:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cca80, transno 17179873935 00000004:00080000:0.0:1746147130.275853:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70a80, transno 17179873936 00000004:00080000:0.0:1746147130.275855:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cfb80, transno 17179873937 00000004:00080000:0.0:1746147130.275857:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cd180, transno 17179873938 00000004:00080000:0.0:1746147130.275859:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4999180, transno 17179873939 00000004:00080000:0.0:1746147130.275861:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a499ad80, transno 17179873940 00000004:00080000:0.0:1746147130.275863:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a499bb80, transno 17179873941 00000004:00080000:0.0:1746147130.275865:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a499b800, transno 17179873942 00000004:00080000:0.0:1746147130.275867:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4998e00, transno 17179873943 00000004:00080000:0.0:1746147130.275869:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4998a80, transno 17179873944 00000004:00080000:0.0:1746147130.275871:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4998000, transno 17179873945 00000004:00080000:0.0:1746147130.275873:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4998700, transno 17179873946 00000004:00080000:0.0:1746147130.275875:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a499a300, transno 17179873947 00000004:00080000:0.0:1746147130.275877:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d96d80, transno 17179873956 00000004:00080000:0.0:1746147130.275879:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97480, transno 17179873957 00000004:00080000:0.0:1746147130.275881:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94e00, transno 17179873958 00000004:00080000:0.0:1746147130.275883:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d95f80, transno 17179873959 00000004:00080000:0.0:1746147130.275885:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d97100, transno 17179873960 00000004:00080000:0.0:1746147130.275887:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94000, transno 17179873961 00000004:00080000:0.0:1746147130.275889:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d96300, transno 17179873962 00000004:00080000:0.0:1746147130.275891:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312eb100, transno 17179873963 00000004:00080000:0.0:1746147130.275893:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94700, transno 17179873964 00000004:00080000:0.0:1746147130.275895:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e501f80, transno 17179873969 00000004:00080000:0.0:1746147130.275897:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e502a00, transno 17179873970 00000004:00080000:0.0:1746147130.275898:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486a00, transno 17179873971 00000004:00080000:0.0:1746147130.275900:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487100, transno 17179873972 00000004:00080000:0.0:1746147130.275902:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487800, transno 17179873973 00000004:00080000:0.0:1746147130.275903:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486d80, transno 17179873974 00000004:00080000:0.0:1746147130.275905:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486680, transno 17179873975 00000004:00080000:0.0:1746147130.275907:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e500380, transno 17179873976 00000004:00080000:0.0:1746147130.275910:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801323d7480, transno 17179873977 00000004:00080000:0.0:1746147130.275912:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e320700, transno 17179873978 00000004:00080000:0.0:1746147130.275914:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57100, transno 17179873979 00000004:00080000:0.0:1746147130.275915:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321f80, transno 17179873980 00000004:00080000:0.0:1746147130.275917:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321c00, transno 17179873981 00000004:00080000:0.0:1746147130.275919:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098821f80, transno 17179873982 00000004:00080000:0.0:1746147130.275921:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e323480, transno 17179873983 00000004:00080000:0.0:1746147130.275923:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f56a00, transno 17179873984 00000004:00080000:0.0:1746147130.275924:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e323b80, transno 17179873985 00000004:00080000:0.0:1746147130.275926:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e322d80, transno 17179873986 00000004:00080000:0.0:1746147130.275928:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397800, transno 17179873988 00000004:00080000:0.0:1746147130.275930:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396680, transno 17179873989 00000004:00080000:0.0:1746147130.275931:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396d80, transno 17179873990 00000004:00080000:0.0:1746147130.275933:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395f80, transno 17179873991 00000004:00080000:0.0:1746147130.275935:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395180, transno 17179873992 00000004:00080000:0.0:1746147130.275936:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395c00, transno 17179873993 00000004:00080000:0.0:1746147130.275938:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396300, transno 17179873994 00000004:00080000:0.0:1746147130.275939:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397b80, transno 17179873995 00000004:00080000:0.0:1746147130.275941:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397100, transno 17179873996 00000004:00080000:0.0:1746147130.275943:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094570e00, transno 17179874001 00000004:00080000:0.0:1746147130.275945:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0000, transno 17179874002 00000004:00080000:0.0:1746147130.275947:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a3800, transno 17179874003 00000004:00080000:0.0:1746147130.275949:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a2d80, transno 17179874004 00000004:00080000:0.0:1746147130.275951:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a2a00, transno 17179874005 00000004:00080000:0.0:1746147130.275953:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094570000, transno 17179874006 00000004:00080000:0.0:1746147130.275955:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0380, transno 17179874007 00000004:00080000:0.0:1746147130.275957:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8a80, transno 17179874008 00000004:00080000:0.0:1746147130.275959:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0a80, transno 17179874009 00000004:00080000:0.0:1746147130.275961:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e9c00, transno 17179874010 00000004:00080000:0.0:1746147130.275963:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ebb80, transno 17179874011 00000004:00080000:0.0:1746147130.275965:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e9180, transno 17179874012 00000004:00080000:0.0:1746147130.275967:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098820380, transno 17179874013 00000004:00080000:0.0:1746147130.275969:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098822680, transno 17179874014 00000004:00080000:0.0:1746147130.275971:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098823100, transno 17179874015 00000004:00080000:0.0:1746147130.275973:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098823b80, transno 17179874016 00000004:00080000:0.0:1746147130.275975:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9180, transno 17179874017 00000004:00080000:0.0:1746147130.275977:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098822d80, transno 17179874018 00000100:00100000:0.0:1746147130.275981:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880099888e00 x1830967310535680/t17179874022(17179874022) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147146 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147130.275986:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099888e00/2, rc 0, transno 17179874022 00000100:00100000:0.0:1746147130.275988:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147130.275996:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099889500/2, rc 0, transno 17179874021 00000100:00100000:0.0:1746147130.275998:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147130.276005:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098e10000/2, rc 0, transno 21474841291 00000100:00100000:0.0:1746147130.276007:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310534784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147130.276013:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfb480/2, rc 0, transno 21474841292 00000100:00100000:0.0:1746147130.276015:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310535296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147130.276021:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147130.276025:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310536192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.276042:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.276057:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13652 00000100:00100000:0.0:1746147130.276062:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310536320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147130.276120:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147130.276123:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147130.276124:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147130.276127:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147130.276129:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147130.276149:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310536320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (681us total) trans 17179874024 rc 0/0 00000100:00100000:0.0:1746147130.276154:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13652 00000100:00100000:0.0:1746147130.276164:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13655 00000100:00100000:0.0:1746147130.276182:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967310536448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.276236:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13656 00000100:00100000:1.0:1746147130.276245:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310536192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.276310:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310536192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (266us total) trans 17179874027 rc 0/0 00000100:00100000:1.0:1746147130.276315:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13656 00000004:00010000:1.0:1746147130.276355:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011da9d180 reply state ffff8800930e4400 transno 8589935693 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276372:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276381:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.276384:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147130.276387:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746147130.276450:0:16099:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147130.276461:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31881:x1830967307620608:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 16145us (17333us total) trans 8589935693 rc 0/0 00000100:00100000:1.0:1746147130.276468:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15063 00010000:00010000:1.0:1746147130.276485:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276492:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276498:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276503:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147130.276507:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276513:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276520:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.276522:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147130.276524:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147130.276529:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425053e06 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000004:00080000:0.0:1746147130.278161:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 12 in progress, 0 in flight, 100 done 00000100:00100000:0.0:1746147130.278540:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536576 00000100:00100000:0.0:1746147130.278546:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536576 00000100:00100000:0.0:1746147130.278676:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13657 00000100:00100000:0.0:1746147130.278683:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310536576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.278795:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3766:x1830967310536576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (333us total) trans 17179874029 rc 0/0 00000100:00100000:0.0:1746147130.278801:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13657 00000004:00080000:1.0:1746147130.278856:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094535880/2, rc 0, transno 17179874027 00000100:00100000:1.0:1746147130.278862:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310536192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147130.278878:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094534e00/2, rc 0, transno 17179874024 00000100:00100000:1.0:1746147130.278881:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310536320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.278939:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.281371:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307621376 00000100:00100000:0.0:1746147130.281377:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307621376 00000100:00100000:0.0:1746147130.281425:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15065 00000100:00100000:0.0:1746147130.281432:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31881:x1830967307621376:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147130.281447:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147130.281463:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425053e14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e768d7 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.281543:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7600/0x3139939425053e1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147130.281555:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7600/0x3139939425053e1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147130.281565:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7600/0x3139939425053e1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147130.281592:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147130.281596:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147130.281612:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7600/0x3139939425053e1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147130.281637:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425053e14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768d7 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.281668:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7600/0x3139939425053e1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768d7 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.281675:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.281678:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147130.281681:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7600, rc 0) 00000100:00100000:0.0:1746147130.281728:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:31881:x1830967307621376:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 296us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.282477:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15065 00000100:00100000:0.0:1746147130.283699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.283732:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.283755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.283768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.283779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.283800:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.283888:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307621888 00000100:00100000:1.0:1746147130.283892:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307621888 00000100:00100000:1.0:1746147130.283918:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307622144 00000100:00100000:1.0:1746147130.283920:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307622144 00000100:00100000:1.0:1746147130.284054:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307621760 00000100:00100000:1.0:1746147130.284057:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307621760 00000100:00100000:1.0:1746147130.284179:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13658 00000100:00100000:1.0:1746147130.284186:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307621888:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147130.284202:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.284221:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x3139939425053e22 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e768f3 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147130.284244:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141739, atime: 0x68141739, ctime: 0x68141739, blocks: 0x800 00010000:00010000:1.0:1746147130.284263:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.284265:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.284275:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x3139939425053e22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768f3 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.284289:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x3139939425053e22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768f3 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.284299:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56600, rc 0) 00000100:00100000:0.0:1746147130.284416:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13661 00000100:00100000:0.0:1746147130.284424:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307621504:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147130.284432:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147130.284441:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425053e37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e768de expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147130.284452:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x68141739, atime: 0x68141739, ctime: 0x68141739, blocks: 0x7c8 00010000:00010000:0.0:1746147130.284460:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.284462:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.284466:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425053e37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768de expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147130.284475:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425053e37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768de expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147130.284482:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7000, rc 0) 00000100:00100000:1.0:1746147130.284546:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307621888:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 359us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.284551:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13658 00000100:00100000:1.0:1746147130.284565:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13662 00000100:00100000:1.0:1746147130.284569:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307621760:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147130.284576:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.284584:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x3139939425053e3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e768ec expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147130.284593:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814173a, atime: 0x68141739, ctime: 0x6814173a, blocks: 0x808 00010000:00010000:1.0:1746147130.284600:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.284602:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.284605:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x3139939425053e3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768ec expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.284613:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x3139939425053e3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768ec expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.284619:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57800, rc 0) 00000100:00100000:0.0:1746147130.284679:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307621504:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 255us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.284686:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13661 00000100:00100000:0.0:1746147130.284700:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13663 00000100:00100000:0.0:1746147130.284704:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307622016:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147130.284709:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147130.284717:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425053e45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e768fa expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147130.284726:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141739, atime: 0x68141739, ctime: 0x68141739, blocks: 0x1590 00010000:00010000:0.0:1746147130.284735:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.284736:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.284740:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425053e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768fa expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147130.284748:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425053e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768fa expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147130.284753:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6600, rc 0) 00000100:00100000:0.0:1746147130.284772:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307622016:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 67us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.284776:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13663 00000100:00100000:1.0:1746147130.284859:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307621760:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 288us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.284865:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13662 00000100:00100000:0.0:1746147130.287597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.287634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.287661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.287838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.288039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.288062:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.288119:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307622912 00000100:00100000:0.0:1746147130.288123:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307622912 00000100:00100000:0.0:1746147130.288147:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13665 00000100:00100000:0.0:1746147130.288152:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307622784:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147130.288243:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307622784:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 90us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.288249:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13665 00000100:00100000:0.0:1746147130.288262:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13666 00000100:00100000:0.0:1746147130.288266:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307622400:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147130.288267:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13667 00000100:00100000:1.0:1746147130.288273:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307622656:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147130.288461:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307622656:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 189us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.288461:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307622400:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 193us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.288466:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13667 00000100:00100000:0.0:1746147130.288468:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13666 00000100:00100000:0.0:1746147130.292274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.292314:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.292338:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.292358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.292371:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.292451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.293012:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13675 00000100:00100000:1.0:1746147130.293023:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307623552:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147130.295379:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307623552:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 2349us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.295390:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13675 00000100:00100000:1.0:1746147130.299674:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.302435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.307918:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.307970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.308290:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3085 00000100:00100000:1.0:1746147130.308304:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307624448:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147130.308341:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.308353:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.308354:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.308359:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.308370:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.314574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.314634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.317355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.317388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147130.317494:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317504:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317512:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317520:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147130.317524:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317535:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317552:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317557:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x3139939425053e4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.317605:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307624320:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 9437us (9699us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746147130.317611:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3084 00000100:00100000:0.0:1746147130.317630:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3091 00000100:00100000:0.0:1746147130.317635:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307625984:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147130.317648:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x3139939425053e7d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317653:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.317654:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.317657:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x3139939425053e7d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.317663:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x3139939425053e7d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328368:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328386:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328395:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328404:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147130.328408:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328421:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328442:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.328448:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425053e53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.329067:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307624448:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 20761us (21089us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147130.329078:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3085 00000100:00100000:1.0:1746147130.330321:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147130.330339:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310536704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746147130.330394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.332558:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536704 00000100:00100000:1.0:1746147130.332571:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536704 00000100:00100000:1.0:1746147130.332841:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1746147130.332852:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967310536704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746147130.332880:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1167873088 pending 802816 free 3904991232 avail 3666223104 00000100:00100000:1.0:1746147130.332980:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967310536704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.333030:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310536704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746147130.333077:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1746147130.347843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.349791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.351889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.353805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.355860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.360540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.362621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.364907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.369078:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.371672:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.378539:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.382750:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.387467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.387539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.387560:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.387571:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307628032 00000100:00100000:1.0:1746147130.387578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.387579:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307628032 00000100:00100000:1.0:1746147130.387603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.387619:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307628288 00000100:00100000:0.0:1746147130.387622:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307628288 00000100:00100000:1.0:1746147130.387627:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.387640:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307628544 00000100:00100000:0.0:1746147130.387642:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307628544 00000100:00100000:1.0:1746147130.387648:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307627904 00000100:00100000:1.0:1746147130.387653:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307627904 00000100:00100000:0.0:1746147130.387655:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307628160 00000100:00100000:0.0:1746147130.387657:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307628160 00000100:00100000:0.0:1746147130.387665:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307628416 00000100:00100000:0.0:1746147130.387667:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307628416 00000100:00100000:0.0:1746147130.387680:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13684 00000100:00100000:0.0:1746147130.387687:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307628032:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147130.387803:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147130.387806:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00000100:00100000:1.0:1746147130.387808:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13685 00002000:00010000:0.0:1746147130.387808:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147130.387810:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147130.387812:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147130.387816:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307628288:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:0.0:1746147130.387849:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307628032:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 161us (389us total) trans 21474841300 rc 0/0 00000100:00100000:0.0:1746147130.387856:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13684 00000100:00100000:0.0:1746147130.387869:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13686 00000100:00100000:0.0:1746147130.387874:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307628544:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147130.387913:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147130.387915:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147129 -> 1746147130 00002000:00010000:0.0:1746147130.387917:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147130.387918:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147129 -> 1746147130 00002000:00010000:0.0:1746147130.387920:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:1.0:1746147130.387924:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147130.387927:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147129 -> 1746147130 00002000:00010000:1.0:1746147130.387930:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147130.387932:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147129 -> 1746147130 00002000:00010000:1.0:1746147130.387934:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147130.387935:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307628544:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 60us (373us total) trans 21474841301 rc 0/0 00000100:00100000:0.0:1746147130.387941:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13686 00000100:00100000:0.0:1746147130.387951:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13687 00000100:00100000:1.0:1746147130.387955:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307628288:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 140us (421us total) trans 17179874031 rc 0/0 00000100:00100000:0.0:1746147130.387956:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307628160:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147130.387962:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13685 00000100:00100000:1.0:1746147130.387974:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13688 00000100:00100000:1.0:1746147130.387979:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307627904:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147130.387991:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147130.387993:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147130.387995:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147130.387996:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147130.387998:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746147130.388016:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746147130.388016:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307628160:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 60us (412us total) trans 21474841302 rc 0/0 00002000:00010000:1.0:1746147130.388018:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147129 -> 1746147130 00002000:00010000:1.0:1746147130.388021:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00000100:00100000:0.0:1746147130.388021:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13687 00002000:00010000:1.0:1746147130.388023:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147129 -> 1746147130 00002000:00010000:1.0:1746147130.388025:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147130.388031:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13689 00000100:00100000:0.0:1746147130.388037:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307628416:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147130.388042:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307627904:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 62us (462us total) trans 17179874032 rc 0/0 00000100:00100000:1.0:1746147130.388048:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13688 00002000:00010000:0.0:1746147130.388086:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147130.388114:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147129 -> 1746147130 00002000:00010000:0.0:1746147130.388116:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147130.388118:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147129 -> 1746147130 00002000:00010000:0.0:1746147130.388120:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147130.388139:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307628416:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 101us (511us total) trans 17179874033 rc 0/0 00000100:00100000:0.0:1746147130.388144:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13689 00000100:00100000:0.0:1746147130.389774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.389840:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307628800 00000100:00100000:1.0:1746147130.389848:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307628800 00000100:00100000:1.0:1746147130.390380:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5335 00000100:00100000:1.0:1746147130.390388:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31881:x1830967307628800:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:1.0:1746147130.390446:0:7241:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x2d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425053dce lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768c9 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.390492:0:7241:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147130.390504:0:7241:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425053e0d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768d0 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.390510:0:7241:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147130.390541:0:7241:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425053e0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768d0 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.390554:0:7241:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425053e0d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768d0 expref: 10 pid: 16099 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.390568:0:7241:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7241:1830967310538368:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147130.392373:0:7241:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.395077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.395328:0:7241:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7241:1830967310538368:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.395358:0:7241:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147130.396209:0:7241:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147130.396216:0:7241:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00000040:00080000:0.0:1746147130.396480:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].450, 88 off47648 00000004:00080000:0.0:1746147130.396486:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668386395854ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.396526:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].403, 88 off43512 00000004:00080000:0.0:1746147130.396529:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668386439914ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.396542:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].404, 88 off43600 00000004:00080000:0.0:1746147130.396545:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668386455387ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.396564:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].451, 88 off47736 00000004:00080000:0.0:1746147130.396567:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668386477579ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.396577:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].452, 88 off47824 00000004:00080000:0.0:1746147130.396580:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668386490394ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.396588:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].405, 88 off43688 00000004:00080000:0.0:1746147130.396591:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668386501980ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.396600:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].406, 88 off43776 00000004:00080000:0.0:1746147130.396602:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668386512927ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.400309:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].407, 88 off43864 00000004:00080000:0.0:1746147130.400323:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668390232502ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.400346:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].453, 88 off47912 00000004:00080000:0.0:1746147130.400349:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668390259337ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.400375:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].408, 88 off43952 00000004:00080000:0.0:1746147130.400378:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668390288167ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.400384:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].454, 88 off48000 00000004:00080000:0.0:1746147130.400387:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668390297157ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.400396:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].409, 88 off44040 00000004:00080000:0.0:1746147130.400399:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668390309640ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147130.400405:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].455, 88 off48088 00000004:00080000:0.0:1746147130.400408:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668390318242ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.400415:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].456, 88 off48176 00000004:00080000:0.0:1746147130.400417:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668390327130ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.400422:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].457, 88 off48264 00000004:00080000:0.0:1746147130.400424:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668390334929ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.400430:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].458, 88 off48352 00000004:00080000:0.0:1746147130.400436:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 668390346980ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147130.400443:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].410, 88 off44128 00000004:00080000:0.0:1746147130.400445:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668390355970ns, next at 554081490131ns, rc = 0 00010000:00010000:1.0:1746147130.407824:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147130.407838:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147130.407845:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147130.407851:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092542600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147130.407856:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147130.407863:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147130.407881:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.407884:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147130.407888:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147130.407893:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425053e84 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147130.408072:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310538496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.408160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.408220:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310539008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.408237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.408255:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147130.408259:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310538880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.408274:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.408285:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310539392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.408300:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.408325:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310538496 00000100:00100000:1.0:1746147130.408333:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310538496 00000100:00100000:1.0:1746147130.408365:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539008 00000100:00100000:1.0:1746147130.408367:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539008 00000100:00100000:1.0:1746147130.408378:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310538880 00000100:00100000:1.0:1746147130.408380:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310538880 00000100:00100000:1.0:1746147130.408399:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539392 00000100:00100000:1.0:1746147130.408401:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539392 00000100:00100000:1.0:1746147130.408415:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13690 00000100:00100000:1.0:1746147130.408422:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967310538496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147130.408563:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147130.408566:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00002000:00010000:1.0:1746147130.408568:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147130.408570:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:1.0:1746147130.408572:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147130.408603:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310538496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (443us total) trans 21474841303 rc 0/0 00000100:00100000:1.0:1746147130.408609:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13690 00000100:00100000:1.0:1746147130.408622:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13691 00000100:00100000:1.0:1746147130.408626:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967310539008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.408681:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310539008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (443us total) trans 21474841304 rc 0/0 00000100:00100000:1.0:1746147130.408686:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13691 00000100:00100000:1.0:1746147130.408695:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13692 00000100:00100000:1.0:1746147130.408699:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967310538880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147130.408737:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147130.408740:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147130.408742:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147130.408744:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147130.408745:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147130.408762:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310538880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (486us total) trans 21474841305 rc 0/0 00000100:00100000:1.0:1746147130.408766:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13692 00000100:00100000:1.0:1746147130.408775:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13693 00000100:00100000:1.0:1746147130.408779:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967310539392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.408828:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310539392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (526us total) trans 21474841306 rc 0/0 00000100:00100000:1.0:1746147130.408832:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13693 00000004:00080000:1.0:1746147130.408867:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e320700/2, rc 0, transno 21474841305 00000100:00100000:1.0:1746147130.408872:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310538880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147130.408880:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e323b80/2, rc 0, transno 21474841306 00000100:00100000:1.0:1746147130.408882:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310539392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147130.408888:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305f0380/2, rc 0, transno 21474841303 00000100:00100000:1.0:1746147130.408891:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310538496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147130.408896:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e321f80/2, rc 0, transno 21474841304 00000100:00100000:1.0:1746147130.408898:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310539008:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1746147130.410725:0:7241:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b19d7450 reply state ffff880098285000 transno 8589935695 ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147130.410742:0:7241:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425053eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147130.410754:0:7241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.410756:0:7241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147130.410760:0:7241:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746147130.410766:0:7241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.410768:0:7241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147130.410774:0:7241:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425053dce lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e768c9 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746147130.410861:0:7241:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147130.413944:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:31881:x1830967307628800:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 23552us (24169us total) trans 8589935695 rc 0/0 00000100:00100000:0.0:1746147130.415291:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5335 00000100:00100000:0.0:1746147130.415785:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307629056 00000100:00100000:0.0:1746147130.415794:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307629056 00000100:00100000:0.0:1746147130.415849:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15067 00000100:00100000:0.0:1746147130.415857:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:31881:x1830967307629056:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147130.415881:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147130.415907:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425053ebc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76932 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.415970:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425053ebc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76932 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.415983:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425053ebc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76932 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.415999:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.416002:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147130.416005:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0000, rc 0) 00000100:00100000:0.0:1746147130.416067:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:31881:x1830967307629056:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 210us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.416073:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15067 00000100:00100000:0.0:1746147130.420847:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307629312 00000100:00100000:0.0:1746147130.420857:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307629312 00000100:00100000:0.0:1746147130.420917:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5336 00000100:00100000:0.0:1746147130.420925:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:31881:x1830967307629312:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1746147130.421163:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31881:x1830967307629312:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 238us (467us total) trans 8589935696 rc 0/0 00000100:00100000:0.0:1746147130.421182:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5336 00000100:00100000:0.0:1746147130.439582:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.439645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.440003:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307629824 00000100:00100000:1.0:1746147130.440009:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307629824 00000100:00100000:0.0:1746147130.442943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.443032:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307630080 00000100:00100000:1.0:1746147130.443040:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307630080 00000100:00100000:1.0:1746147130.443081:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15070 00000100:00100000:1.0:1746147130.443106:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:31893:x1830967307630080:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.443129:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.443143:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425053f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76947 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.443240:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425053f10 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147130.443252:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425053f10 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147130.443261:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425053f10 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147130.443271:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147130.443351:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425053f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76947 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.443376:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425053f10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76947 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.443382:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.443384:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147130.443386:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31400, rc 0) 00000100:00100000:1.0:1746147130.444214:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:31893:x1830967307630080:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1124us (1279us total) trans 8589935699 rc 0/0 00000100:00100000:1.0:1746147130.444221:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15070 00000100:00100000:0.0:1746147130.446514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.447362:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.447419:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13708 00000100:00100000:0.0:1746147130.447431:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+7:31893:x1830967307630336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147130.447446:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147130.447460:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76955 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.448454:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147130.448463:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 8 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.448556:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 8 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.448569:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:1.0:1746147130.449275:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:31893:x1830967307630336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1846us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.449283:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13708 00000100:00100000:0.0:1746147130.449941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.450501:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307630592 00000100:00100000:1.0:1746147130.450510:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307630592 00000100:00100000:1.0:1746147130.450553:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15071 00000100:00100000:1.0:1746147130.450564:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:31890:x1830967307630592:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147130.450581:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.450599:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30400/0x3139939425053f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7695c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.450698:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31e00/0x3139939425053f33 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147130.450712:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6a00/0x3139939425053ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76939 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.450719:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7800/0x3139939425053efb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76940 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.450725:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31e00/0x3139939425053f33 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147130.450753:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7800/0x3139939425053efb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76940 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.450777:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7800/0x3139939425053efb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76940 expref: 29 pid: 16099 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.450788:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310540800:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.450857:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6a00/0x3139939425053ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76939 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.450870:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6a00/0x3139939425053ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76939 expref: 10 pid: 16099 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.450877:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310540928:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147130.450896:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.451355:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307630720 00000100:00100000:0.0:1746147130.451360:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307630720 00010000:00010000:0.0:1746147130.451383:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425053e8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76908 expref: 15 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746147130.451431:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5916 00000100:00100000:0.0:1746147130.451440:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307630720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147130.451452:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.451474:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425053e8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76908 expref: 15 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.451486:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425053e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76908 expref: 15 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.451508:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425053e8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76908 expref: 15 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.451541:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.451544:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.451552:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04800/0x3139939425053f1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7694e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.451561:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04800/0x3139939425053f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7694e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.451574:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.451575:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147130.451579:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 7 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.451586:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 7 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147130.451615:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 7 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.451626:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310541056:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147130.452832:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04800/0x3139939425053f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7694e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.452847:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310541184:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147130.453070:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147130.454387:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310540928:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147130.457400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.457667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.457701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.457733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.457892:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310540800:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.457921:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31e00/0x3139939425053f33 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147130.458073:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5918 00000100:00100000:0.0:1746147130.458080:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307630976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147130.458149:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3093 00000100:00100000:1.0:1746147130.458156:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307631488:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147130.458433:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147130.458439:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7800/0x3139939425053efb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76940 expref: 30 pid: 16099 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.458468:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7800/0x3139939425053efb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76940 expref: 30 pid: 16099 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.458481:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7800/0x3139939425053efb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76940 expref: 30 pid: 16099 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746147130.458514:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147130.458517:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147130.458655:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307630976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 575us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.458661:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5918 00000100:00100000:1.0:1746147130.466383:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307631488:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8215us (8637us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147130.466395:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3093 00002000:00100000:1.0:1746147130.466408:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880094572680 x1830967307631488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/440 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.466417:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094572680 with x1830967307631488 ext(0->1048575) 00002000:00010000:1.0:1746147130.466424:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094572680 00000100:00100000:0.0:1746147130.476826:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.481195:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.481265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.481482:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307631744 00000100:00100000:1.0:1746147130.481491:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307631744 00000100:00100000:1.0:1746147130.481535:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13710 00000100:00100000:1.0:1746147130.481542:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:31892:x1830967307631744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.481556:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.481570:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x3139939425053f48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7696a expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.481587:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147130.481591:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x3139939425053f48 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7696a expref: 26 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.481944:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x3139939425053f48 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7696a expref: 26 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.481952:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31800, rc 0) 00000100:00100000:1.0:1746147130.481975:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:31892:x1830967307631744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 434us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.481980:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13710 00000100:00100000:0.0:1746147130.492531:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.505634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.505840:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307632512 00000100:00100000:1.0:1746147130.505852:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307632512 00002000:00100000:1.0:1746147130.505904:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094571880 x1830967307632512/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.505915:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094571880 with x1830967307632512 ext(1048576->2097151) 00002000:00010000:1.0:1746147130.505922:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094571880 00000100:00100000:1.0:1746147130.505955:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3095 00000100:00100000:1.0:1746147130.505967:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307632512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.515240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.515342:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307632640 00000100:00100000:1.0:1746147130.515352:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307632640 00000100:00100000:1.0:1746147130.515412:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13711 00000100:00100000:1.0:1746147130.515421:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:31892:x1830967307632640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.515441:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.515461:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092543400/0x3139939425053f56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76978 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.515493:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094009800/0x3139939425053e99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76916 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.515501:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147130.515503:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147130.515506:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092543400/0x3139939425053f56 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76978 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.515538:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094009800/0x3139939425053e99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76916 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.515551:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094009800/0x3139939425053e99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76916 expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.515563:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310541696:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147130.515666:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.521432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.521970:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310541696:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147130.522008:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092543400/0x3139939425053f56 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76978 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.522026:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543400, rc 0) 00000100:00100000:1.0:1746147130.522075:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:31892:x1830967307632640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6654us (6844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.522083:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13711 00000100:00100000:0.0:1746147130.522949:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.523207:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307632896 00000100:00100000:1.0:1746147130.523211:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307632896 00000100:00100000:1.0:1746147130.523801:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13712 00000100:00100000:1.0:1746147130.523808:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:31893:x1830967307632896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.523823:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.523839:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7697f expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.523857:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.523859:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.523865:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7697f expref: 11 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.523877:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7697f expref: 11 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.523886:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182400, rc 0) 00000100:00100000:1.0:1746147130.523940:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+11:31893:x1830967307632896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 132us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.523945:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13712 00000100:00100000:0.0:1746147130.531681:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307633152 00000100:00100000:0.0:1746147130.531690:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307633152 00002000:00100000:0.0:1746147130.531736:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009988b480 x1830967307633152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.531746:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b480 with x1830967307633152 ext(1048576->2097151) 00002000:00010000:0.0:1746147130.531751:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009988b480 00000100:00100000:0.0:1746147130.531785:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3096 00000100:00100000:0.0:1746147130.531793:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307633152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.553785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.559887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.567047:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.569975:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.570347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.576005:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.576038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.576071:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.576207:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307634688 00000100:00100000:1.0:1746147130.576218:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307634688 00000100:00100000:1.0:1746147130.576947:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15074 00000100:00100000:1.0:1746147130.576958:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:31893:x1830967307634688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.576979:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.576998:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182000/0x3139939425053f80 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7699b expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.579510:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425053f79 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147130.579526:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094182000/0x3139939425053f80 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7699b expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.579545:0:6215:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425053f79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147130.579558:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182000/0x3139939425053f80 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7699b expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.579572:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147130.579575:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147130.579578:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094182000/0x3139939425053f80 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7699b expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.579585:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182000, rc 0) 00000100:00100000:1.0:1746147130.580253:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:31893:x1830967307634688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3132us (4014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.580263:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15074 00000100:00100000:1.0:1746147130.582832:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310542720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.582867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.582879:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310543232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.582894:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.583190:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310543744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.583209:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.583861:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13717 00000100:00100000:0.0:1746147130.583869:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310543232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.583912:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310544256:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147130.583916:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147130.583918:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147130.583920:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147130.583922:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147130.583924:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147130.583929:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.583946:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310543232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1051us total) trans 17179874045 rc 0/0 00000100:00100000:0.0:1746147130.583951:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13717 00000004:00080000:1.0:1746147130.583954:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897ce00/2, rc 0, transno 17179874045 00000100:00100000:1.0:1746147130.583960:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310543232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147130.583965:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310543744 00000100:00100000:0.0:1746147130.583967:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310543744 00000100:00100000:1.0:1746147130.583975:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310544256 00000100:00100000:1.0:1746147130.583977:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310544256 00000100:00100000:0.0:1746147130.583984:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13718 00000100:00100000:0.0:1746147130.583988:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967310542592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.583990:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13719 00000100:00100000:1.0:1746147130.583993:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3764:x1830967310543744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147130.584024:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147130.584027:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147130.584029:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147130.584031:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147130.584032:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746147130.584047:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147130.584049:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00000100:00100000:0.0:1746147130.584049:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967310542592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (997us total) trans 17179874046 rc 0/0 00002000:00010000:1.0:1746147130.584051:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147130.584053:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:1.0:1746147130.584054:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147130.584054:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13718 00000100:00100000:0.0:1746147130.584063:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13720 00000100:00100000:0.0:1746147130.584067:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310544256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.584071:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310543744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (861us total) trans 21474841311 rc 0/0 00000100:00100000:1.0:1746147130.584076:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13719 00000100:00100000:0.0:1746147130.584132:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310544256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (202us total) trans 21474841312 rc 0/0 00000100:00100000:0.0:1746147130.584137:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13720 00000004:00080000:1.0:1746147130.584141:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e8380/2, rc 0, transno 21474841311 00000100:00100000:1.0:1746147130.584144:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310543744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147130.584149:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e8000/2, rc 0, transno 21474841312 00000100:00100000:1.0:1746147130.584153:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310544256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147130.585209:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13730 00000100:00100000:1.0:1746147130.585215:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967310544640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.585268:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3767:x1830967310544640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (847us total) trans 17179874050 rc 0/0 00000100:00100000:1.0:1746147130.585273:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13730 00000004:00080000:1.0:1746147130.585749:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897c000/2, rc 0, transno 17179874044 00000100:00100000:1.0:1746147130.585752:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310542720:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147130.586175:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897c700/2, rc 0, transno 17179874051 00000100:00100000:0.0:1746147130.586179:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310542976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147130.586200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.586981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.587023:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307634944 00000100:00100000:0.0:1746147130.587027:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307634944 00000100:00100000:0.0:1746147130.587062:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5337 00000100:00100000:0.0:1746147130.587067:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:31893:x1830967307634944:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147130.587182:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:31893:x1830967307634944:12345-192.168.204.25@tcp:49:cat.0 Request processed in 114us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.587188:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5337 00000100:00100000:0.0:1746147130.588140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.591990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.593756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.597513:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.598174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.598216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.598294:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307635712 00000100:00100000:1.0:1746147130.598301:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307635712 00010000:00010000:1.0:1746147130.598334:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425053eae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7692b expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.598366:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5924 00000100:00100000:1.0:1746147130.598374:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307635712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.598388:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.598408:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425053eae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7692b expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.598421:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425053eae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7692b expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.598446:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425053eae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7692b expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.598471:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.598474:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.598481:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4c00/0x3139939425053f95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769b0 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.598490:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4c00/0x3139939425053f95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769b0 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.598719:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4c00/0x3139939425053f95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769b0 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.598732:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310544896:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147130.598814:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147130.599288:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.601804:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.601824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.601825:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310544896:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147130.601839:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.601872:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307635712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3497us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.601883:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5924 00000100:00100000:1.0:1746147130.601905:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307636096 00000100:00100000:1.0:1746147130.601909:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307636096 00010000:00010000:1.0:1746147130.601929:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7697f expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.601958:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307636224 00000100:00100000:1.0:1746147130.601961:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307636224 00010000:00010000:1.0:1746147130.601971:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092543400/0x3139939425053f56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76978 expref: 28 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.601987:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5925 00000100:00100000:1.0:1746147130.601993:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307636096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.602003:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.602021:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7697f expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.602030:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7697f expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.602151:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094182400/0x3139939425053f5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7697f expref: 12 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.602174:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.602176:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.602183:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425053f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769b7 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.602191:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425053f9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769b7 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.602218:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425053f9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769b7 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.602228:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310545408:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147130.602283:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.602431:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.602779:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307636352 00000100:00100000:1.0:1746147130.602783:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307636352 00010000:00010000:1.0:1746147130.602797:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094009400/0x3139939425053ea7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76924 expref: 13 pid: 1398 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.602825:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5927 00000100:00100000:1.0:1746147130.602830:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307636352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.602839:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.603113:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094009400/0x3139939425053ea7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76924 expref: 13 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.603123:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094009400/0x3139939425053ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76924 expref: 13 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.603137:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094009400/0x3139939425053ea7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76924 expref: 13 pid: 1398 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.603146:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.603147:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.603151:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.603158:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.603185:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.603194:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310545536:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147130.603243:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147130.605203:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310545408:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147130.605220:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.605241:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307636096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3248us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.605248:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5925 00000100:00100000:1.0:1746147130.605275:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310545536:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147130.605283:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.605296:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307636352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2466us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.605301:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5927 00000100:00100000:0.0:1746147130.605843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.608386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.608871:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.608942:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307636736 00000100:00100000:1.0:1746147130.608951:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307636736 00002000:00100000:1.0:1746147130.608998:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1765376->1769471) req@ffff880098c71c00 x1830967307636736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.609008:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71c00 with x1830967307636736 ext(1765376->1769471) 00002000:00010000:1.0:1746147130.609014:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c71c00 00000100:00100000:1.0:1746147130.609036:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307636992 00000100:00100000:1.0:1746147130.609039:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307636992 00002000:00100000:1.0:1746147130.609054:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800909f8a80 x1830967307636992/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.609061:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8a80 with x1830967307636992 ext(2097152->3145727) 00010000:00010000:1.0:1746147130.609264:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 27 pid: 12225 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.609280:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 27 pid: 12225 timeout: 768 lvb_type: 0 00002000:00010000:1.0:1746147130.609289:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800909f8a80 00000100:00100000:0.0:1746147130.615887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.617731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.618019:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13736 00000100:00100000:1.0:1746147130.618030:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:31893:x1830967307637120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.618170:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.618180:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f800/0x3139939425053fb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e769cc expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.618192:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.618194:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.618200:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f800/0x3139939425053fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769cc expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.618212:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f800/0x3139939425053fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769cc expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.618221:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f800, rc 0) 00000100:00100000:1.0:1746147130.618242:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:31893:x1830967307637120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 214us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.618247:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13736 00000100:00100000:0.0:1746147130.622220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.622268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.622349:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307637504 00000100:00100000:1.0:1746147130.622358:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307637504 00010000:00010000:1.0:1746147130.622389:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 29 pid: 12225 timeout: 768 lvb_type: 0 00000100:00100000:1.0:1746147130.622416:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5928 00000100:00100000:1.0:1746147130.622425:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307637504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147130.622437:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147130.622455:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 29 pid: 12225 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.622464:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 29 pid: 12225 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.622485:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425053fa3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769be expref: 29 pid: 12225 timeout: 768 lvb_type: 0 00010000:00010000:1.0:1746147130.622506:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.622508:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147130.622516:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425053faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769c5 expref: 10 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.622523:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425053faa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769c5 expref: 10 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147130.622565:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4800/0x3139939425053faa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769c5 expref: 10 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.622575:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310546048:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147130.622619:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.625343:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.625807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.625867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.625902:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.626083:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310546048:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147130.626115:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147130.626137:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307637504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3713us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.626145:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5928 00000100:00100000:1.0:1746147130.626211:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 990 00000100:00100000:1.0:1746147130.626217:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307637888:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147130.632583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.635109:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.643572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.643623:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.643676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.644239:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307639040 00000100:00100000:1.0:1746147130.644243:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307639040 00000100:00100000:1.0:1746147130.644270:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5338 00000100:00100000:1.0:1746147130.644275:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:31888:x1830967307639040:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147130.644445:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:31888:x1830967307639040:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 169us (821us total) trans 8589935702 rc 0/0 00000100:00100000:1.0:1746147130.644451:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5338 00000100:00100000:1.0:1746147130.657751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.658405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.658439:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.658497:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307639680 00000100:00100000:1.0:1746147130.658501:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307639680 00002000:00100000:1.0:1746147130.658521:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e500380 x1830967307639680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.658528:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500380 with x1830967307639680 ext(2097152->4194303) 00002000:00010000:1.0:1746147130.658532:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e500380 00000100:00100000:1.0:1746147130.658543:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307639936 00000100:00100000:1.0:1746147130.658545:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307639936 00002000:00100000:1.0:1746147130.658556:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011e503480 x1830967307639936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.658567:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503480 with x1830967307639936 ext(3145728->4194303) 00002000:00010000:1.0:1746147130.658570:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e503480 00000100:00100000:1.0:1746147130.658580:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3105 00000100:00100000:1.0:1746147130.658585:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307639680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.659414:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3106 00000100:00100000:0.0:1746147130.659422:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307639936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.673027:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307639936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13594us (14574us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147130.673039:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3106 00002000:00100000:0.0:1746147130.673051:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011e503480 x1830967307639936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/440 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.673061:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503480 with x1830967307639936 ext(3145728->4194303) 00002000:00010000:0.0:1746147130.673067:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e503480 00000100:00100000:0.0:1746147130.677487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.679248:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307639680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20657us (20840us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147130.679257:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3105 00002000:00100000:1.0:1746147130.679266:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e500380 x1830967307639680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/440 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.679275:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500380 with x1830967307639680 ext(2097152->4194303) 00002000:00010000:1.0:1746147130.679279:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e500380 00000100:00100000:0.0:1746147130.684160:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.684223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.684311:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307640448 00000100:00100000:1.0:1746147130.684321:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307640448 00002000:00100000:1.0:1746147130.684369:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011e501180 x1830967307640448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147130.684378:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501180 with x1830967307640448 ext(3145728->4194303) 00002000:00010000:1.0:1746147130.684383:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e501180 00000100:00100000:1.0:1746147130.684537:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3107 00000100:00100000:1.0:1746147130.684547:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307640448:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.686556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.686587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.686617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.686660:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13742 00000100:00100000:0.0:1746147130.686666:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307640832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147130.686674:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147130.686693:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64be00/0x3139939425053fd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e769f6 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147130.686734:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310546688:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147130.686805:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.697595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.702484:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.704412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.704441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.704458:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.704612:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13746 00000100:00100000:1.0:1746147130.704621:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307641728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.704629:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.704640:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504e600/0x3139939425053ff7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76a19 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.704667:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310547328:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147130.705042:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.705720:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.710227:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310547328:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147130.710246:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504e600/0x3139939425053ff7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a19 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.710255:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504e600/0x3139939425053ff7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a19 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147130.710270:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e600, rc 0) 00000100:00100000:1.0:1746147130.710293:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307641728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5674us (5852us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147130.710298:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13746 00000100:00100000:0.0:1746147130.710357:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.714887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.721430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.724495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.724570:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.725535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.733829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.733854:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307643008 00000100:00100000:0.0:1746147130.733862:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307643008 00002000:00100000:0.0:1746147130.733906:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff8800a5576a00 x1830967307643008/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.733915:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576a00 with x1830967307643008 ext(4915200->4919295) 00002000:00010000:0.0:1746147130.733921:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576a00 00000100:00100000:0.0:1746147130.733949:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3111 00000100:00100000:0.0:1746147130.733956:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307643008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.734776:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307643008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 818us (956us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147130.734782:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3111 00002000:00100000:0.0:1746147130.734786:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff8800a5576a00 x1830967307643008/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.734792:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576a00 with x1830967307643008 ext(4915200->4919295) 00002000:00010000:0.0:1746147130.734795:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576a00 00000100:00100000:0.0:1746147130.739656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.740704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.740746:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307643520 00000100:00100000:1.0:1746147130.740750:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307643520 00000100:00100000:1.0:1746147130.740780:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5340 00000100:00100000:1.0:1746147130.740785:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:31892:x1830967307643520:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147130.740866:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:31892:x1830967307643520:12345-192.168.204.25@tcp:35:cat.0 Request processed in 81us (162us total) trans 8589935704 rc 0/0 00000100:00100000:1.0:1746147130.740871:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5340 00000100:00100000:0.0:1746147130.863022:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.870218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.876726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.877974:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.879444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.898435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.898454:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307645568 00000100:00100000:0.0:1746147130.898461:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307645568 00002000:00100000:0.0:1746147130.898493:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1765375) req@ffff8800a5574700 x1830967307645568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/0 e 0 to 0 dl 1746147141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.898501:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967307645568 ext(1048576->1765375) 00002000:00010000:0.0:1746147130.898507:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5574700 00000100:00100000:0.0:1746147130.898526:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3115 00000100:00100000:0.0:1746147130.898531:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307645568:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147130.906186:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307645312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13317us (14482us total) trans 0 rc 671744/671744 00000100:00100000:0.0:1746147130.906200:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3113 00002000:00100000:0.0:1746147130.906212:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1425408->2097151) req@ffff88009c309f80 x1830967307645312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:506/0 lens 488/440 e 0 to 0 dl 1746147141 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147130.906222:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309f80 with x1830967307645312 ext(1425408->2097151) 00002000:00010000:0.0:1746147130.906228:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c309f80 00000100:00100000:0.0:1746147130.916419:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.921349:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147130.921371:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3766:1830967310548480:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.921443:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.921939:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310548864:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.921964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.921976:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3766:1830967310549376:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922573:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.922595:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147130.922600:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3766:1830967310548992:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922617:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.922627:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310549504:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922646:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147130.922663:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548736 00000100:00100000:0.0:1746147130.922672:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548736 00000100:00100000:1.0:1746147130.922690:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310548608:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922708:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.922720:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3764:1830967310549120:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922733:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.922745:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967310549632:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922758:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.922779:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549504 00000100:00100000:1.0:1746147130.922782:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549504 00000100:00100000:1.0:1746147130.922806:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548608 00000100:00100000:1.0:1746147130.922808:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548608 00000100:00100000:1.0:1746147130.922819:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1746147130.922826:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310549504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922867:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310549504:12345-0@lo:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.922873:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1746147130.922886:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1746147130.922890:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967310548608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.922906:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967310548608:12345-0@lo:400:kworker.0 Request processed in 16us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.922911:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1746147130.922920:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549376 00000100:00100000:1.0:1746147130.922922:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549376 00000100:00100000:0.0:1746147130.923190:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549248 00000100:00100000:0.0:1746147130.923193:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549248 00000100:00100000:0.0:1746147130.923221:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1746147130.923228:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3764:x1830967310549632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.923263:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3764:x1830967310549632:12345-0@lo:400:kworker.0 Request processed in 36us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147130.923268:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1746147130.923308:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310548608:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.923317:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967310549632:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.923346:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3766:1830967310548992:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.923354:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310549504:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.923362:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310548864:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.923371:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3766:1830967310548480:0@lo:400:kworker.0 00000100:00100000:1.0:1746147130.923643:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3766:1830967310549376:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.924367:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3764:1830967310549120:0@lo:400:kworker.0 00000100:00100000:0.0:1746147130.928727:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.928776:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.935594:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.937396:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147130.937409:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310550016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746147130.937454:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147130.937486:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550016 00000100:00100000:1.0:1746147130.937490:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550016 00000100:00100000:1.0:1746147130.937516:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1746147130.937522:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967310550016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746147130.937548:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445679104 avail 1316216832 00000100:00100000:1.0:1746147130.937574:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967310550016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.937579:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1746147130.937611:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310550016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746147130.937819:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549888 00000100:00100000:1.0:1746147130.937822:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549888 00000100:00100000:1.0:1746147130.937840:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1746147130.937849:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310549888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746147130.937867:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:1.0:1746147130.938249:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310549888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 398us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147130.938254:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1746147130.940952:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.941024:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307646848 00000100:00100000:1.0:1746147130.941035:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307646848 00000100:00100000:0.0:1746147130.944403:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.955339:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.961534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.963063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.964922:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.964953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.964996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147130.965468:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307647616 00000100:00100000:1.0:1746147130.965472:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307647616 00000100:00100000:1.0:1746147130.965493:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307647744 00000100:00100000:1.0:1746147130.965494:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307647744 00000100:00100000:1.0:1746147130.965507:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13756 00000100:00100000:1.0:1746147130.965512:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307647616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147130.965524:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147130.965537:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0400/0x31399394250540c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76a74 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147130.965575:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e323800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310550528:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147130.965614:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147130.968784:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e323800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310550528:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147130.968802:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0400/0x31399394250540c9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a74 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147130.968811:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0400/0x31399394250540c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a74 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147130.968834:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0400, rc 0) 00000100:00100000:0.0:1746147130.968855:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307647616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3342us (3938us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147130.968861:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13756 00000100:00100000:0.0:1746147130.972702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147130.982530:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3119 00000100:00100000:0.0:1746147130.982539:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307648640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147131.001601:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147131.001616:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310550784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147131.001650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147131.001716:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550784 00000100:00100000:1.0:1746147131.001724:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550784 00000100:00100000:1.0:1746147131.001777:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1746147131.001785:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+33:3766:x1830967310550784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746147131.001808:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 897024 granted 1219408960 pending 2142208 free 3909718016 avail 3678195712 00000100:00100000:1.0:1746147131.001994:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+33:3766:x1830967310550784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.002001:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1746147131.002007:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550912 00000100:00100000:0.0:1746147131.002011:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550912 00000100:00100000:0.0:1746147131.002035:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1746147131.002041:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310550912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147131.002052:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 401408 granted 1168360512 pending 1290240 free 3904991232 avail 3666223104 00000100:00100000:0.0:1746147131.002081:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310550912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.002101:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1746147131.006678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.012655:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.013245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.017902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.018022:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307649152 00000100:00100000:1.0:1746147131.018031:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307649152 00002000:00100000:1.0:1746147131.018072:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1409024->1925119) req@ffff88012ca12a00 x1830967307649152/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.018082:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967307649152 ext(1409024->1925119) 00010000:00010000:1.0:1746147131.018119:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 14 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.018133:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 14 pid: 17600 timeout: 769 lvb_type: 0 00002000:00010000:1.0:1746147131.018140:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca12a00 00000100:00100000:1.0:1746147131.018174:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 993 00000100:00100000:1.0:1746147131.018181:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307649152:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147131.023537:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307649152:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5344us (5634us total) trans 21474841321 rc 0/0 00000100:00100000:1.0:1746147131.023551:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 993 00002000:00100000:1.0:1746147131.023564:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1409024->1925119) req@ffff88012ca12a00 x1830967307649152/t21474841321(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/448 e 0 to 0 dl 1746147142 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.023573:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967307649152 ext(1409024->1925119) 00010000:00010000:1.0:1746147131.023584:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 16 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.023602:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 16 pid: 17600 timeout: 769 lvb_type: 0 00002000:00010000:1.0:1746147131.023609:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca12a00 00000100:00100000:0.0:1746147131.025035:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.028342:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307649408 00000100:00100000:0.0:1746147131.028350:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307649408 00010000:00010000:0.0:1746147131.028445:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 16 pid: 17600 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.028492:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5936 00000100:00100000:0.0:1746147131.028500:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307649408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.028513:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.028569:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 16 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.028597:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 16 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.028627:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x313993942505408a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a51 expref: 16 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.028654:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.028656:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.028662:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.028671:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.028700:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.028711:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310551424:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147131.028802:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.030324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.030438:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307649664 00000100:00100000:1.0:1746147131.030445:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307649664 00002000:00100000:1.0:1746147131.030480:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88012ca11f80 x1830967307649664/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.030491:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11f80 with x1830967307649664 ext(1048576->2097151) 00002000:00010000:1.0:1746147131.030496:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca11f80 00000100:00100000:1.0:1746147131.030526:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3120 00000100:00100000:1.0:1746147131.030532:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307649664:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147131.036933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.037120:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307649664:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6586us (6796us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147131.037128:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3120 00002000:00100000:1.0:1746147131.037134:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88012ca11f80 x1830967307649664/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/440 e 0 to 0 dl 1746147142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.037142:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11f80 with x1830967307649664 ext(1048576->2097151) 00002000:00010000:1.0:1746147131.037146:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca11f80 00000100:00100000:0.0:1746147131.039432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.041141:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.042771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.044949:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.055288:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.061223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.076488:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.076534:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.076566:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307651200 00000100:00100000:0.0:1746147131.076575:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307651200 00000100:00100000:0.0:1746147131.076612:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307651328 00000100:00100000:0.0:1746147131.076614:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307651328 00000100:00100000:0.0:1746147131.076628:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13762 00000100:00100000:0.0:1746147131.076635:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307651200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.076659:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.076678:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c86e00/0x31399394250540f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76a9e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.076735:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310552064:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.076805:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13763 00000100:00100000:0.0:1746147131.076811:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967307651328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.076818:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.076824:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d91200/0x31399394250540fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76aa5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.076845:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310552192:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.077829:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.077891:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.078213:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310552192:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147131.078238:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d91200/0x31399394250540fa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76aa5 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.078250:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d91200/0x31399394250540fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76aa5 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147131.078305:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310552064:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147131.078318:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c86e00/0x31399394250540f3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a9e expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147131.078326:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c86e00/0x31399394250540f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a9e expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147131.078339:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c86e00, rc 0) 00000100:00100000:1.0:1746147131.078370:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307651200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1735us (1893us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147131.078513:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13762 00010000:00010000:0.0:1746147131.079606:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91200, rc 0) 00000100:00100000:0.0:1746147131.079638:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307651328:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2825us (3102us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147131.079644:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13763 00000100:00100000:0.0:1746147131.084291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.099797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.100148:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.100177:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307651712 00000100:00100000:0.0:1746147131.100181:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307651712 00000100:00100000:0.0:1746147131.100714:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13764 00000100:00100000:0.0:1746147131.100723:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307651712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.100742:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.100761:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425054101 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76aac expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.100811:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310552320:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.100889:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.100924:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.105699:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310552320:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147131.105735:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425054101 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76aac expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.105749:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425054101 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76aac expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.105780:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7200, rc 0) 00000100:00100000:0.0:1746147131.105834:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307651712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5110us (5685us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147131.105842:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13764 00000100:00100000:0.0:1746147131.106358:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310552448:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147131.106375:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x313993942505411d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ab3 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.106384:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x313993942505411d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ab3 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.106391:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c600, rc 0) 00000100:00100000:0.0:1746147131.106422:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307651840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5447us (5498us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147131.106428:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13765 00000100:00100000:0.0:1746147131.109278:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.109315:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.109337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.109356:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307652480 00000100:00100000:0.0:1746147131.109364:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307652480 00000100:00100000:0.0:1746147131.109395:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307652352 00000100:00100000:0.0:1746147131.109397:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307652352 00000100:00100000:0.0:1746147131.109410:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13766 00000100:00100000:0.0:1746147131.109417:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307652480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.109433:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.109452:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b6e00/0x3139939425054132 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ac8 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.109496:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310552576:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.109559:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.109576:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13767 00000100:00100000:0.0:1746147131.109580:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307652352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.109585:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.109591:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b7800/0x3139939425054139 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ac1 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.109611:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310552704:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.109625:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.109656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.109667:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307652608 00000100:00100000:0.0:1746147131.109669:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307652608 00000100:00100000:0.0:1746147131.109687:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13768 00000100:00100000:0.0:1746147131.109690:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307652608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.109697:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.109707:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76acf expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.109718:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.109720:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.109727:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76acf expref: 30 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.109745:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76acf expref: 30 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.109754:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91000, rc 0) 00000100:00100000:0.0:1746147131.109772:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307652608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.109777:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13768 00000100:00100000:1.0:1746147131.111430:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310552704:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147131.111457:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7800/0x3139939425054139 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ac1 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147131.111466:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7800/0x3139939425054139 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ac1 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147131.111491:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7800, rc 0) 00000100:00100000:1.0:1746147131.111518:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307652352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1936us (2178us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147131.111523:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13767 00000100:00100000:0.0:1746147131.114862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.118632:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.118743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.118815:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.145036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.145059:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307653760 00000100:00100000:0.0:1746147131.145066:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307653760 00000100:00100000:0.0:1746147131.145130:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15082 00000100:00100000:0.0:1746147131.145137:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:31916:x1830967307653760:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147131.145169:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.145188:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425054147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ad6 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.145246:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x313993942505414e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145260:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x313993942505414e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145271:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x313993942505414e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145284:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x3139939425054155 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145291:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x3139939425054155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145296:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x3139939425054155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145374:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505415c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145384:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31e00/0x3139939425053f33 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7695c expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.145390:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505415c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.145421:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31e00/0x3139939425053f33 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7695c expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.145464:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31e00/0x3139939425053f33 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7695c expref: 35 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.145477:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310552832:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147131.145539:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.151465:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.153210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.157856:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.157970:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307654400 00000100:00100000:1.0:1746147131.157980:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307654400 00000100:00100000:0.0:1746147131.159538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.159588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.159607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.160442:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.160459:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307654784 00000100:00100000:0.0:1746147131.160463:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307654784 00000100:00100000:0.0:1746147131.160483:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13770 00000100:00100000:0.0:1746147131.160488:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307654656:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147131.160497:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.160507:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425054178 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ae4 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.160546:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310552960:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147131.161354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.161385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.161903:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.163594:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.169665:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.169728:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307655680 00000100:00100000:1.0:1746147131.169737:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307655680 00000100:00100000:1.0:1746147131.169791:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15084 00000100:00100000:1.0:1746147131.169804:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ccf9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:31916:x1830967307655680:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147131.169823:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.169843:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x31399394250541b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76b0e expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.170844:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.170860:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505415c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ad6 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.170867:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505418d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b07 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.170873:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.170904:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505418d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b07 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.170915:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505418d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b07 expref: 16 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.170927:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310553216:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147131.171037:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505415c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ad6 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.171044:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505415c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ad6 expref: 8 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.171051:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310553344:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147131.171312:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.173740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147131.174295:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505418d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b07 expref: 16 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.174312:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310553216:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147131.174321:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505415c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ad6 expref: 8 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.174333:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310553344:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147131.174349:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.174356:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.174361:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147131.174370:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147131.174442:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x31399394250541b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.174452:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.174458:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.174460:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147131.174462:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9a00, rc 0) 00000100:00100000:1.0:1746147131.174491:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ccf9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31916:x1830967307655680:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4693us (4837us total) trans 8589935717 rc 0/0 00000100:00100000:1.0:1746147131.174496:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15084 00000100:00100000:0.0:1746147131.178981:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307656320 00000100:00100000:0.0:1746147131.178992:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307656320 00000100:00100000:0.0:1746147131.179052:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15086 00000100:00100000:0.0:1746147131.179059:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31916:x1830967307656320:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147131.179084:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.179137:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af400/0x31399394250541e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76b1c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.179239:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x31399394250541ef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.179255:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.179261:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x31399394250541ef lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.179294:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.179308:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 9 pid: 16099 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.179319:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310553472:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147131.179406:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.182624:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310553472:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147131.182650:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x31399394250541ef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147131.182837:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307656576 00000100:00100000:0.0:1746147131.182843:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307656576 00010000:00010000:0.0:1746147131.182873:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 10 pid: 16099 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.182895:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307656448 00000100:00100000:0.0:1746147131.182898:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307656448 00000100:00100000:0.0:1746147131.183339:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5942 00000100:00100000:0.0:1746147131.183346:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307656576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.183359:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.183364:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 10 pid: 16099 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.183375:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 10 pid: 16099 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.183400:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x31399394250541b7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b0e expref: 10 pid: 16099 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.183715:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147131.183718:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.183737:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307656576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 391us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.183742:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5942 00000100:00100000:0.0:1746147131.187204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.187247:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.202694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.210275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.269538:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.283672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.283715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.283763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.283789:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307657856 00000100:00100000:0.0:1746147131.283793:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307657856 00010000:00010000:0.0:1746147131.283811:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x3139939425053fbf lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769da expref: 30 pid: 12225 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.283836:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5943 00000100:00100000:0.0:1746147131.283845:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307657600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.283859:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.283881:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x31399394250541a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b00 expref: 12 pid: 10340 timeout: 769 lvb_type: 1 00000100:00100000:1.0:1746147131.283934:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5945 00000100:00100000:1.0:1746147131.283944:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307657728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.283952:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.284342:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x31399394250541a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b00 expref: 12 pid: 10340 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.284365:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x31399394250541a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b00 expref: 12 pid: 10340 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.284387:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.284429:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307657600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 586us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.284436:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5943 00010000:00010000:1.0:1746147131.284633:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a1fc00/0x3139939425053fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769e1 expref: 16 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.284646:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a1fc00/0x3139939425053fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769e1 expref: 16 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.284660:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a1fc00/0x3139939425053fc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769e1 expref: 16 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.284674:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.284676:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.284682:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fc00/0x3139939425054212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b38 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.284690:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c7fc00/0x3139939425054212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b38 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.284721:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c7fc00/0x3139939425054212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b38 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.284733:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310554240:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.284778:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.287786:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.294668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.294846:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310554240:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147131.294965:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.295062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.295081:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307658368 00000100:00100000:0.0:1746147131.295084:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307658368 00000100:00100000:0.0:1746147131.295139:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307658624 00000100:00100000:0.0:1746147131.295141:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307658624 00000100:00100000:0.0:1746147131.295170:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13778 00000100:00100000:0.0:1746147131.295177:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307658368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.295197:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.295217:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0af400/0x313993942505423c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76b46 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.295267:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310554368:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.295338:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147131.295492:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.295522:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307657728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11579us (11757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.295530:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5945 00000100:00100000:0.0:1746147131.299513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.299833:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307658752 00000100:00100000:1.0:1746147131.299840:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307658752 00010000:00010000:1.0:1746147131.299867:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505419b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76af2 expref: 15 pid: 10340 timeout: 769 lvb_type: 1 00000100:00100000:1.0:1746147131.299891:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5946 00000100:00100000:1.0:1746147131.299898:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307658752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.299910:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.299922:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505419b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76af2 expref: 15 pid: 10340 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.299932:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505419b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76af2 expref: 15 pid: 10340 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.299950:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x313993942505419b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76af2 expref: 15 pid: 10340 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.299967:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.299986:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307658752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 89us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.299991:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5946 00000100:00100000:0.0:1746147131.304680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.304700:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.304785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.305354:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307659008 00000100:00100000:1.0:1746147131.305359:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307659008 00010000:00010000:1.0:1746147131.305383:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76acf expref: 31 pid: 17600 timeout: 769 lvb_type: 1 00000100:00100000:1.0:1746147131.305402:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307658880 00000100:00100000:1.0:1746147131.305404:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307658880 00010000:00010000:1.0:1746147131.305413:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250540ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a97 expref: 13 pid: 12225 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.305427:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5947 00000100:00100000:1.0:1746147131.305432:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307659008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.305441:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.305456:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76acf expref: 31 pid: 17600 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.305465:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76acf expref: 31 pid: 17600 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.305485:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d91000/0x3139939425054140 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76acf expref: 31 pid: 17600 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.305510:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.305532:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307659008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.305537:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5947 00000100:00100000:1.0:1746147131.305547:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5948 00000100:00100000:1.0:1746147131.305551:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307658880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.305556:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.305562:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250540ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a97 expref: 13 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.305570:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250540ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a97 expref: 13 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.305581:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250540ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a97 expref: 13 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.305591:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.305592:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.305599:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.305606:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.305634:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.305646:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310554880:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.305697:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.307755:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310554880:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.307774:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.307822:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307658880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2268us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.307831:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5948 00000100:00100000:0.0:1746147131.311248:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.318167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.326562:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.326659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.326738:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307660032 00000100:00100000:1.0:1746147131.326746:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307660032 00000100:00100000:1.0:1746147131.326858:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5349 00000100:00100000:1.0:1746147131.326867:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:31921:x1830967307660032:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147131.327048:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:31921:x1830967307660032:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 182us (492us total) trans 8589935722 rc 0/0 00000100:00100000:1.0:1746147131.327055:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5349 00000100:00100000:0.0:1746147131.338221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.342834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.351897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.359466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.359499:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.359768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.359900:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.362242:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307661440 00000100:00100000:1.0:1746147131.362247:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307661440 00010000:00010000:1.0:1746147131.362269:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c7fc00/0x3139939425054212 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b38 expref: 22 pid: 9584 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.362291:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5949 00000100:00100000:1.0:1746147131.362369:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307661440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.362378:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.362396:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c7fc00/0x3139939425054212 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b38 expref: 22 pid: 9584 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.362407:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c7fc00/0x3139939425054212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b38 expref: 22 pid: 9584 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.362425:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.362426:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.362433:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.362441:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.362463:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.362471:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310555648:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.362526:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5510000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.364789:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310555648:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.364802:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.364820:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307661440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2453us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.364828:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5949 00000100:00100000:0.0:1746147131.368341:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.376312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.380861:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.380882:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307661952 00000100:00100000:0.0:1746147131.380889:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307661952 00002000:00100000:0.0:1746147131.380922:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1986560->2097151) req@ffff88009cd44700 x1830967307661952/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147131.380930:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44700 with x1830967307661952 ext(1986560->2097151) 00010000:00010000:0.0:1746147131.380938:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 30 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.380952:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 30 pid: 12225 timeout: 769 lvb_type: 0 00002000:00010000:0.0:1746147131.380964:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd44700 00000100:00100000:0.0:1746147131.388375:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.390787:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.390954:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307662208 00000100:00100000:1.0:1746147131.390960:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307662208 00010000:00010000:1.0:1746147131.391242:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.391274:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5950 00000100:00100000:1.0:1746147131.391282:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307662208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.391294:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.391303:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.391313:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.391337:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6200/0x31399394250540de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a89 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.391479:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.391482:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.391490:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097035a00/0x3139939425054290 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b7e expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.391499:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097035a00/0x3139939425054290 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b7e expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.391530:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097035a00/0x3139939425054290 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b7e expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.391541:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310556032:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.391645:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5510000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.395520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.395641:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310556032:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.395665:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.395942:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.395972:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967307662208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4690us (5190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.395980:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5950 00000100:00100000:0.0:1746147131.403504:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.411443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.415464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.427726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.427828:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307663232 00000100:00100000:1.0:1746147131.427837:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307663232 00010000:00010000:1.0:1746147131.427874:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x31399394250540e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a90 expref: 34 pid: 12225 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.427917:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5951 00000100:00100000:1.0:1746147131.427926:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307663232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.427940:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.427960:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x31399394250540e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a90 expref: 34 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.427971:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x31399394250540e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1818623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a90 expref: 34 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.427995:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x31399394250540e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1818623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a90 expref: 34 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.428029:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.428031:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.428039:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x31399394250542a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b93 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.428046:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x31399394250542a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b93 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.428081:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x31399394250542a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b93 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.428122:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310556288:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.428220:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5510000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.431441:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310556288:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.431467:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.431523:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307663232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3596us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.431533:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5951 00000100:00100000:0.0:1746147131.432713:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.444229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.450111:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.456892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.464017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.464053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.464081:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.464129:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307664128 00000100:00100000:1.0:1746147131.464138:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307664128 00000100:00100000:0.0:1746147131.464170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147131.464186:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.464201:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307664256 00000100:00100000:0.0:1746147131.464204:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307664256 00000100:00100000:1.0:1746147131.464213:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307664384 00000100:00100000:1.0:1746147131.464215:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307664384 00010000:00010000:0.0:1746147131.464222:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054266 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b5b expref: 19 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.464225:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x31399394250541ef lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b1c expref: 9 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.464240:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307664512 00000100:00100000:0.0:1746147131.464242:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307664512 00010000:00010000:0.0:1746147131.464251:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x313993942505422e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b3f expref: 44 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.464252:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5952 00000100:00100000:1.0:1746147131.464260:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307664128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147131.464267:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5953 00000100:00100000:0.0:1746147131.464272:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307664256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.464273:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.464279:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.464284:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054266 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b5b expref: 19 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.464294:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054266 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b5b expref: 19 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.464295:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.464303:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.464317:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.464318:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425054243 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b4d expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.464321:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.464330:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.464334:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147131.464336:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.464339:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147131.464369:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307664256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.464375:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5953 00000100:00100000:0.0:1746147131.464387:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5954 00000100:00100000:0.0:1746147131.464391:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307664384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.464396:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.464399:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x31399394250541ef lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b1c expref: 9 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.464410:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x31399394250541ef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b1c expref: 9 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.464418:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147131.464421:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.464426:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.464430:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.464440:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307664384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.464445:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5954 00000100:00100000:0.0:1746147131.464454:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5955 00000100:00100000:0.0:1746147131.464458:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307664512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.464464:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.464465:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x31399394250542ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b9a expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.464468:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x313993942505422e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b3f expref: 44 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.464473:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x31399394250542ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b9a expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.464476:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x313993942505422e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b3f expref: 44 pid: 7238 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.464484:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147131.464487:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.464493:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.464499:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097034a00/0x31399394250542ba lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.464506:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x31399394250542ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b9a expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.464511:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.464519:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310556928:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147131.464521:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307664512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.464525:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5955 00000100:00100000:1.0:1746147131.465671:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5510000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.466435:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310556928:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.466455:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.466501:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307664128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2240us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.466509:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5952 00000100:00100000:0.0:1746147131.471466:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.478858:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.485473:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.485567:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307665024 00000100:00100000:1.0:1746147131.485575:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307665024 00010000:00010000:1.0:1746147131.485609:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 34 pid: 17600 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.485650:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5956 00000100:00100000:1.0:1746147131.485657:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307665024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.485670:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.485690:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 34 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.485707:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 34 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.485730:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505424a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b54 expref: 34 pid: 17600 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.485761:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.485762:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.485770:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.485778:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.485810:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.485822:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310557184:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.485903:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.492337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.492474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.492481:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310557184:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.492505:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.492554:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307665024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6897us (7083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.492566:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5956 00000100:00100000:0.0:1746147131.500826:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.506809:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.519349:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.519408:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307666048 00000100:00100000:1.0:1746147131.519417:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307666048 00010000:00010000:1.0:1746147131.519449:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 35 pid: 1854 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.519489:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5957 00000100:00100000:1.0:1746147131.519496:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307666048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.519510:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.519530:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 35 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.519541:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 35 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.519564:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x31399394250542c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3592191) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ba8 expref: 35 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.519596:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.519597:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.519605:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.519613:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.519647:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.519665:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310557440:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.519763:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.521726:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310557440:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147131.521748:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.521798:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967307666048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2301us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.521808:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5957 00000100:00100000:0.0:1746147131.529550:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.535632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.541680:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.541744:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307666944 00000100:00100000:1.0:1746147131.541751:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307666944 00000100:00100000:1.0:1746147131.541794:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15092 00000100:00100000:1.0:1746147131.541802:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:31937:x1830967307666944:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147131.541826:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.541843:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x31399394250542f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76bbd expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.541923:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.541935:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.541944:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.541953:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.541958:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.541963:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542068:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054307 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542077:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542122:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147131.542132:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147131.542219:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542226:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542231:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542236:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.542239:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542244:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542254:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147131.542256:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.542260:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542264:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250542f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542282:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542286:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542290:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542293:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.542295:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542299:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147131.542300:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147131.542304:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094fbdf00) 00010000:00010000:1.0:1746147131.542306:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.542309:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.542313:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054300 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147131.542324:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307666688 00000100:00100000:0.0:1746147131.542327:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307666688 00010000:00010000:1.0:1746147131.542343:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x31399394250542f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bbd expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.542351:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5351 00010000:00010000:1.0:1746147131.542353:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054307 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bbd expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.542356:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:8487:x1830967307666688:12345-192.168.204.25@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746147131.542358:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.542361:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147131.542363:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x31399394250542eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.542369:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x31399394250542eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.542373:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844bc00, rc 0) 00000100:00100000:1.0:1746147131.542406:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:31937:x1830967307666944:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 605us (729us total) trans 8589935726 rc 0/0 00000100:00100000:1.0:1746147131.542412:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15092 00000100:00100000:1.0:1746147131.548281:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307667200 00000100:00100000:1.0:1746147131.548291:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307667200 00000100:00100000:1.0:1746147131.548354:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 770 00000100:00100000:1.0:1746147131.548363:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967307667200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.548378:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.548406:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054307 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bbd expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.548431:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.548436:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x31399394250542eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.548444:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x31399394250542eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.548449:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097035600/0x31399394250542eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.548453:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.548456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.548496:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967307667200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.548503:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 770 00000100:00100000:0.0:1746147131.562484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.562522:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.562544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.562567:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.562597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.562639:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307667840 00000100:00100000:0.0:1746147131.562643:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307667840 00000100:00100000:0.0:1746147131.562662:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307667968 00000100:00100000:0.0:1746147131.562663:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307667968 00000100:00100000:0.0:1746147131.562676:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13792 00000100:00100000:0.0:1746147131.562683:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307667584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147131.562703:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.562722:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76bc4 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.562745:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.562747:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.562756:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bc4 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.562771:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bc4 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.562781:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0400, rc 0) 00000100:00100000:1.0:1746147131.562814:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13793 00000100:00100000:0.0:1746147131.562818:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307667584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 136us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.562823:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307667712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147131.562830:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.562838:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844bc00/0x313993942505431c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76bcb expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.562849:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.562851:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.562855:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844bc00/0x313993942505431c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bcb expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147131.562856:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13792 00010000:00010000:1.0:1746147131.562865:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844bc00/0x313993942505431c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bcb expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147131.562869:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13795 00010000:00010000:1.0:1746147131.562872:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844bc00, rc 0) 00000100:00100000:0.0:1746147131.562873:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307667968:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147131.562879:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.562886:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x313993942505432a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76bd9 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147131.562891:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307667712:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 70us (345us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147131.562894:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147131.562896:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13793 00010000:00010000:0.0:1746147131.562896:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.562899:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x313993942505432a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bd9 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.562906:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x313993942505432a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bd9 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.562912:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0a00, rc 0) 00000100:00100000:0.0:1746147131.562923:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307667968:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 49us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.562928:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13795 00000100:00100000:0.0:1746147131.562952:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307667456 00000100:00100000:0.0:1746147131.562954:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307667456 00000100:00100000:0.0:1746147131.562978:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5352 00000100:00100000:0.0:1746147131.562982:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:31930:x1830967307667456:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147131.563203:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:31930:x1830967307667456:12345-192.168.204.25@tcp:35:cat.0 Request processed in 220us (729us total) trans 8589935728 rc 0/0 00000100:00100000:1.0:1746147131.563209:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5352 00000100:00100000:0.0:1746147131.570907:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.578057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.580372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.585127:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147131.586195:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.586202:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147131.586255:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147131.586260:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147131.586277:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147131.586308:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x3139939425054346 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76be7 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.586335:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76be7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.586341:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147131.586344:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147131.586347:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034600, rc 0) 00000100:00100000:0.0:1746147131.586373:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31938:x1830967307668480:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4830us (6007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.586380:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15094 00000100:00100000:0.0:1746147131.591048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.591137:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.591279:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307668992 00000100:00100000:1.0:1746147131.591288:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307668992 00000100:00100000:1.0:1746147131.591347:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15095 00000100:00100000:1.0:1746147131.591358:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31938:x1830967307668992:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147131.591381:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.591403:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054354 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76bf5 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.591506:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591530:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591541:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591553:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591559:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591564:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591569:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.591572:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591578:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591589:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.591591:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147131.591595:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591600:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505435b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.591633:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054354 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bf5 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.591640:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054354 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bf5 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.591648:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a600, rc 0) 00000100:00100000:1.0:1746147131.591694:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31938:x1830967307668992:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 338us (556us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147131.591700:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15095 00000100:00100000:0.0:1746147131.594314:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.594456:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307669248 00000100:00100000:1.0:1746147131.594462:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307669248 00000100:00100000:1.0:1746147131.594498:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5353 00000100:00100000:1.0:1746147131.594505:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880070cd7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:31938:x1830967307669248:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147131.594672:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880070cd7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:31938:x1830967307669248:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 166us (360us total) trans 8589935730 rc 0/0 00000100:00100000:1.0:1746147131.594678:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5353 00000100:00100000:0.0:1746147131.595626:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307669504 00000100:00100000:0.0:1746147131.595630:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307669504 00010000:00010000:0.0:1746147131.595654:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bc4 expref: 14 pid: 9584 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746147131.595672:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307669376 00000100:00100000:0.0:1746147131.595673:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307669376 00010000:00010000:0.0:1746147131.595682:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x313993942505429e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b8c expref: 34 pid: 12225 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746147131.595694:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5961 00000100:00100000:0.0:1746147131.595699:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307669504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.595707:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.595724:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bc4 expref: 14 pid: 9584 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.595733:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bc4 expref: 14 pid: 9584 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.595755:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x3139939425054315 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bc4 expref: 14 pid: 9584 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.595769:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.595785:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307669504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.595791:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5961 00000100:00100000:0.0:1746147131.598001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147131.601331:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147131.602585:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.607514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.611874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.614163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.622563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.627769:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.628375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.628983:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307670912 00000100:00100000:1.0:1746147131.628988:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307670912 00000100:00100000:1.0:1746147131.629021:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15096 00000100:00100000:1.0:1746147131.629027:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:31943:x1830967307670912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147131.629040:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.629059:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c03 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.629158:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629172:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629182:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629192:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629197:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629201:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629272:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629281:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629286:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147131.629293:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147131.629329:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629335:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629345:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629350:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.629354:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629360:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629371:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147131.629373:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.629377:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629383:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x3139939425054377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629395:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629401:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629406:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629409:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.629411:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629415:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629424:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4600) 00010000:00010000:1.0:1746147131.629426:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.629428:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629432:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x313993942505437e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147131.629463:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c03 expref: 46 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.629473:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c03 expref: 45 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.629480:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.629482:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147131.629485:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b400, rc 0) 00000100:00100000:1.0:1746147131.629510:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:31943:x1830967307670912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 482us (1752us total) trans 8589935732 rc 0/0 00000100:00100000:1.0:1746147131.629515:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15096 00000100:00100000:0.0:1746147131.631535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.633989:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307671296 00000100:00100000:0.0:1746147131.633997:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307671296 00000100:00100000:0.0:1746147131.634037:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13799 00000100:00100000:0.0:1746147131.634044:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307671296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.634060:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.634076:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x313993942505439a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c11 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.634133:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310558976:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.634979:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.639269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.642055:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.642267:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307671808 00000100:00100000:1.0:1746147131.642274:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307671808 00002000:00100000:1.0:1746147131.642316:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1875968->2097151) req@ffff8800909fb100 x1830967307671808/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.642326:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb100 with x1830967307671808 ext(1875968->2097151) 00010000:00010000:1.0:1746147131.642332:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425054362 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bee expref: 18 pid: 1853 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.642364:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425054362 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bee expref: 18 pid: 1853 timeout: 769 lvb_type: 0 00002000:00010000:1.0:1746147131.642370:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909fb100 00000100:00100000:1.0:1746147131.642444:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1001 00000100:00100000:1.0:1746147131.642451:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307671808:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147131.644416:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307671808:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 1956us (2352us total) trans 21474841326 rc 0/0 00000100:00100000:1.0:1746147131.644426:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1001 00002000:00100000:1.0:1746147131.644435:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1875968->2097151) req@ffff8800909fb100 x1830967307671808/t21474841326(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/448 e 0 to 0 dl 1746147142 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.644443:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb100 with x1830967307671808 ext(1875968->2097151) 00010000:00010000:1.0:1746147131.644452:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425054362 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bee expref: 20 pid: 1853 timeout: 769 lvb_type: 0 00010000:00010000:1.0:1746147131.644465:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425054362 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bee expref: 20 pid: 1853 timeout: 769 lvb_type: 0 00002000:00010000:1.0:1746147131.644473:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909fb100 00000100:00100000:0.0:1746147131.646994:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.653258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.653369:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307672192 00000100:00100000:1.0:1746147131.653379:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307672192 00002000:00100000:1.0:1746147131.653426:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800909fbb80 x1830967307672192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.653437:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fbb80 with x1830967307672192 ext(1048576->2097151) 00002000:00010000:1.0:1746147131.653443:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fbb80 00000100:00100000:1.0:1746147131.653481:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3140 00000100:00100000:1.0:1746147131.653489:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307672192:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147131.661342:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307672192:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7838us (8081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147131.661355:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3140 00002000:00100000:1.0:1746147131.661368:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800909fbb80 x1830967307672192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:507/0 lens 488/440 e 0 to 0 dl 1746147142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147131.661377:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fbb80 with x1830967307672192 ext(1048576->2097151) 00002000:00010000:1.0:1746147131.661383:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fbb80 00000100:00100000:0.0:1746147131.665079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.667522:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.669751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.678082:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.678277:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5967 00000100:00100000:0.0:1746147131.678287:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307672576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.678301:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.678323:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x3139939425054369 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bfc expref: 21 pid: 1853 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.678336:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x3139939425054369 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bfc expref: 21 pid: 1853 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.678364:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x3139939425054369 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bfc expref: 21 pid: 1853 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.678383:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.678385:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.678392:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097035e00/0x31399394250543b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c2d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.678399:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097035e00/0x31399394250543b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c2d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.678431:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097035e00/0x31399394250543b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c2d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.678443:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310559488:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147131.678531:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.684651:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.684705:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:0.0:1746147131.685479:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a4394380 x1830967307673088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147131.685488:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394380 with x1830967307673088 ext(1048576->2097151) 00002000:00010000:0.0:1746147131.685491:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394380 00000100:00100000:0.0:1746147131.685513:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3142 00000100:00100000:0.0:1746147131.685519:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307673088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147131.689103:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307673344 00000100:00100000:1.0:1746147131.689113:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307673344 00000100:00100000:1.0:1746147131.689173:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15097 00000100:00100000:1.0:1746147131.689181:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+21:31947:x1830967307673344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147131.689210:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.689229:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c34 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.689310:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689323:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689334:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689346:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689352:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689358:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689459:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689469:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689475:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147131.689485:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147131.689569:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689575:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689581:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689586:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689592:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.689595:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689602:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689617:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147131.689620:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.689624:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689628:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250543c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689656:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689661:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689665:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689669:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ba00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.689671:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689675:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689680:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4300) 00010000:00010000:1.0:1746147131.689682:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.689684:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689688:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x31399394250543cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.689724:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c34 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.689736:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c34 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.689742:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.689744:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147131.689746:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b000, rc 0) 00000100:00100000:1.0:1746147131.689795:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:31947:x1830967307673344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 614us (817us total) trans 8589935733 rc 0/0 00000100:00100000:1.0:1746147131.689801:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15097 00000100:00100000:0.0:1746147131.701860:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.702200:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.716577:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.729011:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307674624 00000100:00100000:1.0:1746147131.729015:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307674624 00000100:00100000:1.0:1746147131.729049:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15098 00000100:00100000:1.0:1746147131.729055:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:31949:x1830967307674624:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147131.729075:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.729105:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250543ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c49 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729210:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.729225:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76be7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729232:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c03 expref: 46 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729238:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c34 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729245:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543f5 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.729273:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c34 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729283:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250543d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c34 expref: 22 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.729294:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310559616:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147131.729379:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c03 expref: 46 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729385:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c03 expref: 46 pid: 16099 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.729391:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310559744:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147131.729421:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76be7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.729428:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034600/0x313993942505434d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76be7 expref: 10 pid: 7238 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.729435:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310559872:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147131.729449:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147131.737922:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310559616:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147131.737923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.739086:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.739140:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310559744:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147131.739161:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310559872:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147131.739193:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147131.740561:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147131.740982:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.740989:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147131.741010:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147131.741176:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250543ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c49 expref: 47 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.741202:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250543f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c49 expref: 46 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.741209:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.741211:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147131.741213:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ac00, rc 0) 00000100:00100000:1.0:1746147131.741238:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:31949:x1830967307674624:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12183us (13362us total) trans 8589935734 rc 0/0 00000100:00100000:1.0:1746147131.741244:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15098 00000100:00100000:0.0:1746147131.743762:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307674240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13612us (15108us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147131.743774:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3144 00002000:00100000:0.0:1746147131.743786:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a5575180 x1830967307674240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:507/0 lens 488/440 e 0 to 0 dl 1746147142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147131.743796:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575180 with x1830967307674240 ext(1048576->2097151) 00002000:00010000:0.0:1746147131.743802:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5575180 00000100:00100000:0.0:1746147131.751583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.757346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.758928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.763730:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.763772:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.763807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.763834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.764519:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5973 00000100:00100000:0.0:1746147131.764526:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307675904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.764533:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147131.764542:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425054005 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a20 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.764555:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425054005 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a20 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.764568:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425054005 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76a20 expref: 32 pid: 12225 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.764581:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.764597:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307675904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.764602:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5973 00000100:00100000:0.0:1746147131.766549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.766596:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307676288 00000100:00100000:1.0:1746147131.766602:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307676288 00000100:00100000:1.0:1746147131.766650:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15099 00000100:00100000:1.0:1746147131.766657:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:31951:x1830967307676288:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147131.766681:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147131.766700:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942505440a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c57 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.766773:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766786:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766795:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766807:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766813:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766819:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766916:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x313993942505441f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766926:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x313993942505441f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.766932:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x313993942505441f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147131.766940:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147131.767020:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767030:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767036:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767041:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767047:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b80800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.767051:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767057:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767067:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147131.767070:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.767073:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767077:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80800/0x3139939425054411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767123:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767128:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767132:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767137:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b80600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147131.767139:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767152:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767159:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4400) 00010000:00010000:1.0:1746147131.767162:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147131.767164:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767168:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x3139939425054418 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147131.767204:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942505440a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c57 expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.767216:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x313993942505441f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c57 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.767222:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147131.767224:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147131.767226:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:1.0:1746147131.767248:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:31951:x1830967307676288:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 592us (704us total) trans 8589935736 rc 0/0 00000100:00100000:1.0:1746147131.767253:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15099 00000100:00100000:0.0:1746147131.768730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.770989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.775630:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307677056 00000100:00100000:0.0:1746147131.775637:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307677056 00002000:00100000:0.0:1746147131.775673:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4157440->4161535) req@ffff8801305f1c00 x1830967307677056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:507/0 lens 488/0 e 0 to 0 dl 1746147142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147131.775682:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1c00 with x1830967307677056 ext(4157440->4161535) 00010000:00010000:0.0:1746147131.775688:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 31 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.775700:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 31 pid: 1854 timeout: 769 lvb_type: 0 00002000:00010000:0.0:1746147131.775706:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f1c00 00000100:00100000:0.0:1746147131.775730:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1004 00000100:00100000:0.0:1746147131.775737:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307677056:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147131.775859:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307677056:12345-192.168.204.25@tcp:3:cat.0 Request processed in 122us (846us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147131.775865:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1004 00002000:00100000:0.0:1746147131.775869:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4157440->4161535) req@ffff8801305f1c00 x1830967307677056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:507/0 lens 488/4536 e 0 to 0 dl 1746147142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147131.775876:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1c00 with x1830967307677056 ext(4157440->4161535) 00010000:00010000:0.0:1746147131.775880:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 31 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.775889:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 31 pid: 1854 timeout: 769 lvb_type: 0 00002000:00010000:0.0:1746147131.775894:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f1c00 00000100:00100000:0.0:1746147131.779691:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.789245:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307677440 00000100:00100000:0.0:1746147131.789254:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307677440 00010000:00010000:0.0:1746147131.789290:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 33 pid: 1854 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746147131.789462:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5976 00000100:00100000:0.0:1746147131.789470:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307677440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.789485:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147131.789501:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147130 -> 1746147131 00002000:00010000:0.0:1746147131.789504:0:4349:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147130 -> 1746147131 00010000:00010000:0.0:1746147131.789509:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 33 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.789522:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 33 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.789543:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x3139939425054403 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4161535) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c50 expref: 33 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.789561:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.789563:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.789571:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x313993942505442d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c5e expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.789578:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x313993942505442d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c5e expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.789610:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x313993942505442d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c5e expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.789621:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310560896:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147131.789712:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.797893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.834253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.849591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.910987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.916057:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.916130:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.916239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.916261:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307678976 00000100:00100000:0.0:1746147131.916264:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307678976 00000100:00100000:0.0:1746147131.916292:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5357 00000100:00100000:0.0:1746147131.916298:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:31956:x1830967307678976:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147131.916478:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:31956:x1830967307678976:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 179us (238us total) trans 8589935739 rc 0/0 00000100:00100000:0.0:1746147131.916485:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5357 00000100:00100000:0.0:1746147131.922510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.924789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.924867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.924898:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307679232 00000100:00100000:1.0:1746147131.924903:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307679232 00010000:00010000:1.0:1746147131.924929:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x31399394250543a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c1f expref: 36 pid: 1136 timeout: 769 lvb_type: 1 00000100:00100000:1.0:1746147131.924950:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307679360 00000100:00100000:1.0:1746147131.924952:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307679360 00010000:00010000:1.0:1746147131.924971:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 23 pid: 1854 timeout: 769 lvb_type: 0 00000100:00100000:1.0:1746147131.924985:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5978 00000100:00100000:1.0:1746147131.924992:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307679232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.925002:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.925017:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x31399394250543a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c1f expref: 36 pid: 1136 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746147131.925019:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5979 00000100:00100000:0.0:1746147131.925026:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:2001:x1830967307679360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147131.925027:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x31399394250543a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c1f expref: 36 pid: 1136 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.925034:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.925053:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x31399394250543a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c1f expref: 36 pid: 1136 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.925108:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 23 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.925118:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 23 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.925131:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x31399394250542cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76baf expref: 23 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746147131.925151:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.925153:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.925159:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.925171:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.925197:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.925207:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310561408:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147131.925256:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00010000:00010000:1.0:1746147131.925324:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147131.925354:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307679232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 362us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147131.925361:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5978 00000100:00100000:0.0:1746147131.928464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.937421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.941861:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.951864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.959195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.990025:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.991179:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.993441:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.994587:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.994761:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.994777:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.994802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147131.994821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147131.994828:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307681152 00000100:00100000:1.0:1746147131.994834:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307681152 00000100:00100000:0.0:1746147131.994846:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307681024 00000100:00100000:0.0:1746147131.994849:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307681024 00000100:00100000:1.0:1746147131.994861:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307681280 00000100:00100000:1.0:1746147131.994863:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307681280 00000100:00100000:0.0:1746147131.994869:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307681408 00000100:00100000:0.0:1746147131.994871:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307681408 00000100:00100000:1.0:1746147131.994875:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307681536 00000100:00100000:1.0:1746147131.994878:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307681536 00010000:00010000:0.0:1746147131.994880:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250543e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c3b expref: 22 pid: 1854 timeout: 769 lvb_type: 1 00000100:00100000:1.0:1746147131.994892:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13811 00000100:00100000:0.0:1746147131.994895:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5982 00000100:00100000:1.0:1746147131.994899:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307681152:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147131.994900:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307681408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147131.994907:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147131.994914:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.994918:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250543e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c3b expref: 22 pid: 1854 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.994927:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844b400/0x313993942505448f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c88 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.994927:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250543e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c3b expref: 22 pid: 1854 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746147131.994941:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250543e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c3b expref: 22 pid: 1854 timeout: 769 lvb_type: 1 00010000:00010000:1.0:1746147131.994943:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147131.994951:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844b400/0x313993942505448f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c88 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.994952:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.994954:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147131.994960:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x3139939425054465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c7a expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147131.994967:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x3139939425054465 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c7a expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.994978:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844b400/0x313993942505448f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c88 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147131.994985:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x3139939425054465 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c7a expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147131.994991:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b400, rc 0) 00000100:00100000:0.0:1746147131.994992:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310562176:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147131.995014:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307681152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 115us (251us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147131.995019:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13811 00000100:00100000:0.0:1746147131.995031:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13813 00000100:00100000:0.0:1746147131.995037:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307681536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147131.995043:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147131.995049:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x313993942505449d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c96 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147131.995069:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310562304:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147131.995084:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.995123:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147131.998524:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310562176:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147131.998560:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147131.998584:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967307681408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3683us (3781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147131.998592:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5982 00000100:00100000:1.0:1746147131.998795:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310562304:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147131.998830:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x313993942505449d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c96 expref: 37 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147131.998841:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x313993942505449d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c96 expref: 37 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147131.998853:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffaa00, rc 0) 00000100:00100000:1.0:1746147131.998913:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307681536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3873us (4088us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147131.998921:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13813 00000100:00100000:0.0:1746147132.006532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.006599:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307682304 00000100:00100000:1.0:1746147132.006605:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307682304 00002000:00100000:1.0:1746147132.006629:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (2076672->2080767) req@ffff88011e484000 x1830967307682304/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.006636:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e484000 with x1830967307682304 ext(2076672->2080767) 00002000:00010000:1.0:1746147132.006640:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e484000 00000100:00100000:1.0:1746147132.007504:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3152 00000100:00100000:1.0:1746147132.007513:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307682304:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147132.007611:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307682304:12345-192.168.204.25@tcp:3:cat.0 Request processed in 100us (1087us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147132.007618:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3152 00002000:00100000:1.0:1746147132.007624:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (2076672->2080767) req@ffff88011e484000 x1830967307682304/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.007631:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e484000 with x1830967307682304 ext(2076672->2080767) 00002000:00010000:1.0:1746147132.007634:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e484000 00000100:00100000:0.0:1746147132.019792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.028083:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.028178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.028310:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307682688 00000100:00100000:1.0:1746147132.028324:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307682688 00000100:00100000:1.0:1746147132.028815:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13815 00000100:00100000:1.0:1746147132.028822:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307682688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.028830:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.028840:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x31399394250544ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76c9d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.028869:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310562560:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147132.030072:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.033113:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310562560:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147132.033160:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x31399394250544ab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c9d expref: 33 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.033174:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x31399394250544ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c9d expref: 33 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.033189:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b000, rc 0) 00000100:00100000:1.0:1746147132.033236:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307682688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4413us (5162us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147132.033245:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13815 00000100:00100000:0.0:1746147132.039937:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307682944 00000100:00100000:0.0:1746147132.039947:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307682944 00000100:00100000:0.0:1746147132.040888:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13816 00000100:00100000:0.0:1746147132.040899:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:31961:x1830967307682944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.040921:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.040947:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffbc00/0x31399394250544b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cab expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.040981:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x313993942505445e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c73 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.040990:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147132.040993:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147132.040996:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffbc00/0x31399394250544b2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cab expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.041026:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x313993942505445e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c73 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.041044:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x313993942505445e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c73 expref: 11 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.041058:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310562688:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.041189:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.046484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147132.047495:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147132.063839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.075015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.076226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147132.077225:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147132.089491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.089542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.090593:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.090649:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307684096 00000100:00100000:1.0:1746147132.090653:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307684096 00000100:00100000:1.0:1746147132.090677:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13817 00000100:00100000:1.0:1746147132.090682:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307684096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.090694:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.090706:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cc0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.090721:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.090723:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.090729:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc0 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.090746:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc0 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.090755:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844bc00, rc 0) 00000100:00100000:1.0:1746147132.090779:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307684096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.090784:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13817 00000100:00080000:0.0:1746147132.092417:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147132.093036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.093111:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307684352 00000100:00100000:1.0:1746147132.093117:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307684352 00000100:00100000:1.0:1746147132.093165:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15103 00000100:00100000:1.0:1746147132.093171:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:31967:x1830967307684352:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147132.093184:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.093195:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x31399394250544ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cc7 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.093250:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093517:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093528:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093540:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093546:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093551:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093633:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x31399394250544ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093682:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x31399394250544ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093688:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x31399394250544ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147132.093696:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147132.093753:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093758:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093763:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093767:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093772:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147132.093775:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093780:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093789:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147132.093791:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147132.093795:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.093799:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x31399394250544f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094124:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094130:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094134:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094146:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844aa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147132.094149:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094153:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094160:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4500) 00010000:00010000:1.0:1746147132.094162:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147132.094164:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094168:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250544f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.094199:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x31399394250544ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc7 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.094207:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x31399394250544ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc7 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.094213:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.094215:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147132.094217:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f588c00, rc 0) 00000100:00100000:1.0:1746147132.094695:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:31967:x1830967307684352:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1523us (1657us total) trans 8589935743 rc 0/0 00000100:00100000:1.0:1746147132.094702:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15103 00000100:00100000:0.0:1746147132.094851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.094990:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307684480 00000100:00100000:1.0:1746147132.094995:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307684480 00000100:00100000:1.0:1746147132.095020:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13819 00000100:00100000:1.0:1746147132.095025:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:31961:x1830967307684480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.095035:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.095046:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cce expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.095064:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.095071:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.095073:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.095076:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 36 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.095116:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.095128:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 22 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.095149:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310563072:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.095204:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.097719:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.098152:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310563072:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147132.098177:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 36 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.098190:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f391800, rc 0) 00000100:00100000:1.0:1746147132.098209:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:31961:x1830967307684480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3184us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.098215:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13819 00000100:00100000:0.0:1746147132.098938:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.099778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.099868:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307684864 00000100:00100000:1.0:1746147132.099872:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307684864 00000100:00100000:1.0:1746147132.099905:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13820 00000100:00100000:1.0:1746147132.099911:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:31967:x1830967307684864:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147132.099919:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.099932:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f390000/0x3139939425054514 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cd5 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.099948:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.099952:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.099958:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147132.099961:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f390000/0x3139939425054514 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cd5 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.099992:0:17600:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.100002:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f390000/0x3139939425054514 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cd5 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.100010:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f390000, rc 0) 00000100:00100000:1.0:1746147132.100033:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:31967:x1830967307684864:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 123us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.100038:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13820 00000100:00100000:0.0:1746147132.105964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.111312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.112349:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307685248 00000100:00100000:0.0:1746147132.112356:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307685248 00010000:00010000:0.0:1746147132.112409:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 25 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.112932:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5984 00000100:00100000:0.0:1746147132.112941:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967307685248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147132.112953:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.112967:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 25 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.112977:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 25 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.112996:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe400/0x3139939425054457 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2719744->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c6c expref: 25 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.113023:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.113025:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.113031:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 38 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.113038:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 38 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.113070:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 38 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.113080:0:4349:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f391800/0x313993942505450d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cce expref: 38 pid: 17600 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.113107:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310563456:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147132.113194:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.116757:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.120928:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.120961:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.127081:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.152843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.153302:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307686400 00000100:00100000:1.0:1746147132.153310:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307686400 00000100:00100000:1.0:1746147132.153365:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15104 00000100:00100000:1.0:1746147132.153372:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:31969:x1830967307686400:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147132.153394:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.153408:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391e00/0x3139939425054522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ce3 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.153471:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153482:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153490:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153501:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153507:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153513:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153595:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391a00/0x3139939425054537 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153604:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391a00/0x3139939425054537 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153610:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391a00/0x3139939425054537 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147132.153617:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147132.153671:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153677:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153682:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153688:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153692:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f390c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147132.153696:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153702:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153714:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147132.153717:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147132.153720:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153724:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f390c00/0x3139939425054529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153757:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153762:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153766:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153770:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f391000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147132.153772:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153776:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153782:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4100) 00010000:00010000:1.0:1746147132.153784:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147132.153786:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153790:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391000/0x3139939425054530 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147132.153820:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391e00/0x3139939425054522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ce3 expref: 53 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.153831:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391a00/0x3139939425054537 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ce3 expref: 52 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.153836:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.153838:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147132.153840:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f391a00, rc 0) 00000100:00100000:1.0:1746147132.153880:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:31969:x1830967307686400:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 508us (1044us total) trans 8589935744 rc 0/0 00000100:00100000:1.0:1746147132.153886:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15104 00000100:00080000:0.0:1746147132.154232:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147132.155826:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.156643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.159624:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.159706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.165478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.165738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.165899:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307687424 00000100:00100000:1.0:1746147132.165907:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307687424 00000100:00100000:1.0:1746147132.165944:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13823 00000100:00100000:1.0:1746147132.165952:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:31961:x1830967307687424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.165969:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.165985:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x313993942505454c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cf1 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.166007:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.166009:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.166016:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x313993942505454c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cf1 expref: 40 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.166029:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x313993942505454c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cf1 expref: 40 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.166040:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563000, rc 0) 00000100:00100000:1.0:1746147132.166078:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:31961:x1830967307687424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.166084:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13823 00000100:00100000:0.0:1746147132.172116:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.172728:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.172746:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.176234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.185412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.193369:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.193402:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.193819:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13825 00000100:00100000:1.0:1746147132.193826:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:31966:x1830967307688704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.193833:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.193842:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x313993942505455a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76cff expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.193857:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f390000/0x3139939425054514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cd5 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.193862:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.193863:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.193865:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x313993942505455a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cff expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.193880:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f390000/0x3139939425054514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cd5 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.193888:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f390000/0x3139939425054514 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cd5 expref: 24 pid: 17600 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.193895:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310564352:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.193987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.194075:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307688960 00000100:00100000:0.0:1746147132.194079:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307688960 00002000:00100000:0.0:1746147132.194121:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1429504->1433599) req@ffff880097095180 x1830967307688960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.194129:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095180 with x1830967307688960 ext(1429504->1433599) 00002000:00010000:0.0:1746147132.194144:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097095180 00000100:00100000:0.0:1746147132.194157:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3161 00000100:00100000:0.0:1746147132.194163:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307688960:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147132.194249:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307688960:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 86us (261us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147132.194255:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3161 00002000:00100000:0.0:1746147132.194260:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1429504->1433599) req@ffff880097095180 x1830967307688960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.194267:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095180 with x1830967307688960 ext(1429504->1433599) 00002000:00010000:0.0:1746147132.194269:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097095180 00000100:00100000:0.0:1746147132.194561:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.199025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.199059:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.199082:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307689216 00000100:00100000:1.0:1746147132.199085:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307689088 00000100:00100000:0.0:1746147132.199111:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307689216 00000100:00100000:0.0:1746147132.199169:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13826 00000100:00100000:0.0:1746147132.199177:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307689216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.199196:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.199213:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425054561 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d0d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.199219:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307689088 00010000:00010000:0.0:1746147132.199248:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425054561 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d0d expref: 39 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.199259:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425054561 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d0d expref: 39 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.199449:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa000, rc 0) 00000100:00100000:0.0:1746147132.199495:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307689216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 318us (477us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147132.199501:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13826 00000100:00100000:0.0:1746147132.199514:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13827 00000100:00100000:0.0:1746147132.199519:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307689088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.199525:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.199531:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d06 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.199547:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.199549:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.199556:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 38 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.199569:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 38 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.199578:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb000, rc 0) 00000100:00100000:0.0:1746147132.199593:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307689088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 73us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.199598:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13827 00000100:00100000:0.0:1746147132.199666:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310564352:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.199682:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x313993942505455a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cff expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.199691:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563400, rc 0) 00000100:00100000:0.0:1746147132.199705:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:31966:x1830967307688704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5881us (6302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.199710:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13825 00000100:00100000:0.0:1746147132.199757:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.199855:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307689344 00000100:00100000:0.0:1746147132.199858:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307689344 00010000:00010000:0.0:1746147132.199874:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc0 expref: 16 pid: 9584 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.199892:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5989 00000100:00100000:0.0:1746147132.199898:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307689344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147132.199906:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.199921:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc0 expref: 16 pid: 9584 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147132.199930:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc0 expref: 15 pid: 9584 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147132.199949:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844bc00/0x31399394250544dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cc0 expref: 15 pid: 9584 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147132.199958:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147132.199976:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307689344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.199981:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5989 00000100:00100000:0.0:1746147132.204559:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.204697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.205112:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307689600 00000100:00100000:1.0:1746147132.205116:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307689600 00010000:00010000:1.0:1746147132.205143:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffbc00/0x31399394250544b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cab expref: 33 pid: 1136 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.205161:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5990 00000100:00100000:1.0:1746147132.205166:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307689600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.205174:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.205186:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffbc00/0x31399394250544b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cab expref: 33 pid: 1136 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.205194:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffbc00/0x31399394250544b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cab expref: 33 pid: 1136 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.205210:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffbc00/0x31399394250544b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cab expref: 33 pid: 1136 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.206183:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147132.206371:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.206374:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.206382:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21e00/0x3139939425054553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3248127) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cf8 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.206389:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21e00/0x3139939425054553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3248127) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cf8 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.206419:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21e00/0x3139939425054553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3248127) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cf8 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.206431:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310564608:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.206484:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.212660:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.217547:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147132.218284:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147132.220964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.225119:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.225198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.225216:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307690752 00000100:00100000:0.0:1746147132.225222:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307690752 00000100:00100000:0.0:1746147132.225251:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5360 00000100:00100000:0.0:1746147132.225257:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:31967:x1830967307690752:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147132.225421:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:31967:x1830967307690752:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 163us (222us total) trans 8589935746 rc 0/0 00000100:00100000:0.0:1746147132.225428:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5360 00000100:00100000:0.0:1746147132.226022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.230785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.231681:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.235976:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.242914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.243526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.243671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.243838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.244449:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307692032 00000100:00100000:1.0:1746147132.244454:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307692032 00000100:00100000:1.0:1746147132.244475:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13832 00000100:00100000:1.0:1746147132.244480:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307692032:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147132.244486:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.244494:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x31399394250545a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d37 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.244503:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.244505:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.244509:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x31399394250545a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d37 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.244518:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x31399394250545a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d37 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.244530:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563600, rc 0) 00000100:00080000:0.0:1746147132.246467:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147132.246473:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147132.246479:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307692032:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1992us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.246487:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13832 00000100:00100000:0.0:1746147132.246535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.248483:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.248534:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307692416 00000100:00100000:0.0:1746147132.248540:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307692416 00000100:00100000:0.0:1746147132.248580:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13833 00000100:00100000:0.0:1746147132.248585:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+15:31966:x1830967307692416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.248598:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.248617:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d3e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.248639:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.248641:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.248648:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.248662:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.248672:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56c00, rc 0) 00000100:00100000:0.0:1746147132.248707:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:31966:x1830967307692416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 121us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.248716:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13833 00000100:00100000:0.0:1746147132.255796:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.255958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.256050:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307692800 00000100:00100000:1.0:1746147132.256058:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307692800 00002000:00100000:1.0:1746147132.256124:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012ca20000 x1830967307692800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.256145:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca20000 with x1830967307692800 ext(3145728->4194303) 00002000:00010000:1.0:1746147132.256150:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca20000 00000100:00100000:1.0:1746147132.256166:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307692928 00000100:00100000:1.0:1746147132.256168:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307692928 00002000:00100000:1.0:1746147132.256182:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012ca20e00 x1830967307692928/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.256189:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca20e00 with x1830967307692928 ext(3145728->4194303) 00002000:00010000:1.0:1746147132.256192:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca20e00 00000100:00100000:1.0:1746147132.256204:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3164 00000100:00100000:1.0:1746147132.256211:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967307692800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147132.261281:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.265756:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967307692800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9533us (9953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147132.265768:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3164 00002000:00100000:1.0:1746147132.265779:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012ca20000 x1830967307692800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/440 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.265790:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca20000 with x1830967307692800 ext(3145728->4194303) 00002000:00010000:1.0:1746147132.265796:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca20000 00000100:00100000:0.0:1746147132.272804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.272888:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.272926:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307693696 00000100:00100000:0.0:1746147132.272934:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307693696 00000100:00100000:0.0:1746147132.272983:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5362 00000100:00100000:0.0:1746147132.272990:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:31961:x1830967307693696:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147132.274254:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:31961:x1830967307693696:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1264us (1365us total) trans 8589935748 rc 0/0 00000100:00100000:0.0:1746147132.274261:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5362 00000100:00100000:0.0:1746147132.276353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.279556:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147132.280229:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x31399394250545d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147132.280236:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x31399394250545d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147132.280286:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147132.280291:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147132.280310:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x31399394250545d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147132.280341:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x31399394250545d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d53 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.280356:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x31399394250545d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d53 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.280363:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147132.280366:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147132.280368:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03ca00, rc 0) 00000100:00100000:0.0:1746147132.280405:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:31970:x1830967307693824:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3798us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.280411:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15107 00000100:00100000:0.0:1746147132.284885:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.288477:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.293260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.297057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.297382:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3166 00000100:00100000:1.0:1746147132.297393:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307694720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147132.301237:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.301268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.301297:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.301311:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.301323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.301345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.301431:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307695360 00000100:00100000:0.0:1746147132.301438:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307695360 00000100:00100000:0.0:1746147132.301471:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307695488 00000100:00100000:0.0:1746147132.301473:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307695488 00000100:00100000:0.0:1746147132.301498:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13838 00000100:00100000:0.0:1746147132.301505:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307695104:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.301543:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301558:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301566:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147132.301568:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147132.301570:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301597:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301608:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 38 pid: 1136 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.301620:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310565888:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.301681:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.301701:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13839 00000100:00100000:0.0:1746147132.301707:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307694976:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.301721:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425054610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301731:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x313993942505451b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cdc expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301737:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x3139939425054592 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d22 expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301743:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 38 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301748:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.301750:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.301752:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425054610 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301763:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 38 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301770:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 38 pid: 9584 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.301777:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310566400:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.301801:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x3139939425054592 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d22 expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301808:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x3139939425054592 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d22 expref: 15 pid: 1136 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.301814:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310566528:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.301828:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x313993942505451b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cdc expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301835:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x313993942505451b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cdc expref: 24 pid: 1136 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.301845:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310566656:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.301855:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.301877:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13841 00000100:00100000:0.0:1746147132.301882:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967307695232:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.301898:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x313993942505461e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301907:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x31399394250542ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b9a expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301914:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x31399394250543a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c18 expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301920:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425054323 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bd2 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301924:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.301925:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.301926:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x313993942505461e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.301938:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425054323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bd2 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301945:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425054323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76bd2 expref: 17 pid: 1398 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.301955:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310567168:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.301975:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x31399394250543a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c18 expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.301981:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x31399394250543a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76c18 expref: 32 pid: 1136 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.301988:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310567296:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.301999:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x31399394250542ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b9a expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.302005:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x31399394250542ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76b9a expref: 17 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.302011:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310567424:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.302019:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.306289:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307694720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8890us (9225us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147132.306303:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3166 00002000:00100000:1.0:1746147132.306313:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca22300 x1830967307694720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/440 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.306322:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca22300 with x1830967307694720 ext(4194304->4919295) 00010000:00010000:1.0:1746147132.306332:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 16 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.306344:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 16 pid: 1854 timeout: 770 lvb_type: 0 00002000:00010000:1.0:1746147132.306351:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca22300 00000100:00100000:0.0:1746147132.312164:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310567168:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.312182:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310566400:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.312197:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310566528:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.312207:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310566656:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147132.312238:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425054610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.313310:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310565888:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147132.313325:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147132.317684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.317719:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.317742:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.317760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.317782:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307697280 00000100:00100000:0.0:1746147132.317791:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307697280 00000100:00100000:0.0:1746147132.317828:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307697408 00000100:00100000:0.0:1746147132.317830:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307697408 00000100:00100000:0.0:1746147132.317841:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307697664 00000100:00100000:0.0:1746147132.317842:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307697664 00000100:00100000:0.0:1746147132.318673:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13844 00000100:00100000:0.0:1746147132.318682:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967307697408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.318692:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.318704:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425054633 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d76 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.318718:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.318723:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425054633 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d76 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.318731:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425054633 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d76 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.318744:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38cc00, rc 0) 00000100:00100000:0.0:1746147132.318764:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967307697408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 84us (1044us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147132.318770:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13844 00000100:00100000:0.0:1746147132.318784:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13845 00000100:00100000:0.0:1746147132.318788:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967307697536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.318794:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.318801:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x313993942505463a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d7d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147132.318840:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310568064:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147132.318888:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.318908:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13846 00000100:00100000:0.0:1746147132.318914:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307697664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.318920:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.318928:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425054641 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d84 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.318939:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.318944:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425054641 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d84 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.318950:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425054641 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d84 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.318957:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5c00, rc 0) 00000100:00100000:0.0:1746147132.318972:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307697664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 58us (1211us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147132.318976:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13846 00000100:00100000:0.0:1746147132.319048:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.319065:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307697792 00000100:00100000:0.0:1746147132.319069:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307697792 00000100:00100000:0.0:1746147132.319084:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13847 00000100:00100000:0.0:1746147132.319113:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307697792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.319120:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.319126:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425054648 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76d8b expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.319151:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.319156:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425054648 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d8b expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.319162:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425054648 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d8b expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.319168:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034a00, rc 0) 00000100:00100000:0.0:1746147132.319184:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307697792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (135us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147132.319188:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13847 00000100:00100000:0.0:1746147132.325895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.325965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.326001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.326018:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.326030:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.326052:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307696896 00000100:00100000:0.0:1746147132.326052:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307695616 00000100:00100000:1.0:1746147132.326062:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307696896 00000100:00100000:0.0:1746147132.326062:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307695616 00010000:00010000:0.0:1746147132.326125:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 16 pid: 1398 timeout: 770 lvb_type: 0 00002000:00100000:1.0:1746147132.326143:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1425408->1433599) req@ffff88009f084a80 x1830967307696896/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 8680/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.326153:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084a80 with x1830967307696896 ext(1425408->1433599) 00010000:00010000:1.0:1746147132.326164:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 39 pid: 1136 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.326164:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307695872 00000100:00100000:0.0:1746147132.326168:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307695872 00010000:00010000:1.0:1746147132.326176:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 40 pid: 1136 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.326182:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 40 pid: 9584 timeout: 770 lvb_type: 1 00002000:00010000:1.0:1746147132.326183:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f084a80 00000100:00100000:0.0:1746147132.326194:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307696128 00000100:00100000:0.0:1746147132.326197:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307696128 00000100:00100000:1.0:1746147132.326206:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1013 00010000:00010000:0.0:1746147132.326208:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04800/0x3139939425053f1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7694e expref: 33 pid: 1853 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.326213:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307696896:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147132.326222:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5996 00000100:00100000:0.0:1746147132.326228:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307695616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147132.326240:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.326260:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 16 pid: 1398 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.326270:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 16 pid: 1398 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.326292:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425053f25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76955 expref: 16 pid: 1398 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.326312:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147132.326354:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307695616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.326361:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5996 00000100:00100000:0.0:1746147132.326374:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5997 00000100:00100000:0.0:1746147132.326379:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307695872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147132.326386:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.326395:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 40 pid: 9584 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147132.326403:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 41 pid: 9584 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147132.326414:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb000/0x3139939425054568 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d06 expref: 42 pid: 9584 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147132.326423:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147132.326434:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307695872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 56us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.330525:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5997 00000100:00100000:0.0:1746147132.330621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.330632:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307698304 00000100:00100000:0.0:1746147132.330637:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307698304 00010000:00010000:0.0:1746147132.330651:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 15 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.330663:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6010 00000100:00100000:0.0:1746147132.330667:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307698304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147132.330672:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.330678:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 15 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.330684:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 15 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.330694:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250545ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d3e expref: 15 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.330706:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.330707:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.330709:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x3139939425054617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.330715:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x3139939425054617 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.330728:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147132.330740:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307698304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.330744:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6010 00000100:00100000:0.0:1746147132.330828:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307696896:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4616us (4863us total) trans 21474841331 rc 0/0 00000100:00100000:0.0:1746147132.330835:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1013 00002000:00100000:0.0:1746147132.330842:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1425408->1433599) req@ffff88009f084a80 x1830967307696896/t21474841331(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 8680/448 e 0 to 0 dl 1746147143 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.330851:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084a80 with x1830967307696896 ext(1425408->1433599) 00010000:00010000:0.0:1746147132.330857:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 39 pid: 1136 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.330866:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 39 pid: 1136 timeout: 770 lvb_type: 0 00002000:00010000:0.0:1746147132.330870:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f084a80 00000100:00100000:0.0:1746147132.330926:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310567552:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.331470:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.331569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147132.331741:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.331748:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.331759:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.331764:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.331770:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.331774:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147132.331776:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.331781:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.331867:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.331874:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.331885:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.331891:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.331897:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.331907:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147132.331909:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.332043:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.332052:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.332058:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425054625 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.332112:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307695488:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 30129us (30766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.332118:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13842 00010000:00010000:0.0:1746147132.332265:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.332272:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d000/0x3139939425054602 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147132.332302:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307694848:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 30807us (31075us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.332307:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13837 00000100:00100000:0.0:1746147132.332643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336143:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336182:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336226:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.336299:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307698944 00000100:00100000:0.0:1746147132.336308:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307698944 00000100:00100000:0.0:1746147132.336344:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307699200 00000100:00100000:0.0:1746147132.336347:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307699200 00000100:00100000:0.0:1746147132.336358:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307698816 00000100:00100000:0.0:1746147132.336359:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307698816 00000100:00100000:0.0:1746147132.336368:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307699072 00000100:00100000:0.0:1746147132.336370:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307699072 00000100:00100000:0.0:1746147132.336380:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307699328 00000100:00100000:0.0:1746147132.336382:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307699328 00000100:00100000:0.0:1746147132.336395:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13850 00000100:00100000:0.0:1746147132.336402:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307698944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.336420:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.336440:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76da7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147132.336466:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6814173b, atime: 0x6814173b, ctime: 0x6814173b, blocks: 0x808 00010000:00010000:0.0:1746147132.336484:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336485:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336493:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336509:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336519:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c4400, rc 0) 00000100:00100000:0.0:1746147132.336559:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307698944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 157us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.336565:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13850 00000100:00100000:0.0:1746147132.336582:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13851 00000100:00100000:0.0:1746147132.336587:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307699200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.336593:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.336605:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76db5 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147132.336619:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814173b, atime: 0x6814173b, ctime: 0x6814173b, blocks: 0x800 00010000:00010000:0.0:1746147132.336628:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336630:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336633:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336644:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336651:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5600, rc 0) 00000100:00100000:0.0:1746147132.336667:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307699200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.336672:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13851 00000100:00100000:0.0:1746147132.336683:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13852 00000100:00100000:0.0:1746147132.336687:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307698816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.336692:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.336699:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76da0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147132.336709:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814173a, atime: 0x68141739, ctime: 0x6814173a, blocks: 0x7c8 00010000:00010000:0.0:1746147132.336716:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336717:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336721:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336729:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336735:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56200, rc 0) 00000100:00100000:0.0:1746147132.336748:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307698816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 61us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.336753:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13852 00000100:00100000:0.0:1746147132.336767:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13853 00000100:00100000:0.0:1746147132.336772:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307699072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.336778:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.336784:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425054672 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76dae expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147132.336826:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310568192:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147132.336885:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.336907:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13854 00000100:00100000:0.0:1746147132.336912:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307699328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.336918:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.336930:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562600/0x3139939425054679 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76dbc expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147132.336941:0:12201:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x6814173c, atime: 0x6814173b, ctime: 0x6814173c, blocks: 0x1008 00010000:00010000:0.0:1746147132.336951:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336952:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.336956:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562600/0x3139939425054679 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dbc expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336964:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092562600/0x3139939425054679 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dbc expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.336970:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562600, rc 0) 00000100:00100000:0.0:1746147132.336986:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967307699328:12345-192.168.204.25@tcp:101:cat.0 Request processed in 74us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.336990:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13854 00010000:00010000:1.0:1746147132.337597:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337606:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337622:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337629:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337637:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337643:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147132.337646:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337654:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337665:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.337671:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x3139939425054609 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.337706:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307695104:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 36202us (36437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.337713:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13838 00010000:00010000:0.0:1746147132.340556:0:1853:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880095060000 x1830967310568192) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 37 pid: 1136 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.340593:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425054545 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76cea expref: 37 pid: 1136 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.340605:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310568192:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147132.340637:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425054672 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dae expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.340649:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425054672 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dae expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.340664:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57400, rc 0) 00000100:00100000:0.0:1746147132.340703:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307699072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3929us (4460us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147132.340711:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13853 00000100:00100000:0.0:1746147132.344975:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.345688:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.347887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.347916:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.347952:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.351337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.351399:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307700352 00000100:00100000:1.0:1746147132.351407:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307700352 00000100:00100000:0.0:1746147132.351415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147132.351438:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425053f79 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76994 expref: 52 pid: 7238 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.351447:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307700480 00000100:00100000:0.0:1746147132.351450:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307700480 00010000:00010000:0.0:1746147132.351464:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4200/0x3139939425053f87 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769a2 expref: 53 pid: 7238 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.351479:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6016 00000100:00100000:0.0:1746147132.351483:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6017 00000100:00100000:1.0:1746147132.351487:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2003:x1830967307700352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147132.351488:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2003:x1830967307700480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.351498:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.351498:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.351502:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4200/0x3139939425053f87 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769a2 expref: 53 pid: 7238 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.351503:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425053f79 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76994 expref: 53 pid: 7238 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.351511:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4200/0x3139939425053f87 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769a2 expref: 53 pid: 7238 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.351899:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425053f79 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76994 expref: 53 pid: 7238 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.351918:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425053f79 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76994 expref: 53 pid: 7238 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.351943:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.351947:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147132.351954:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.351991:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967307700352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 505us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.351997:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6016 00010000:00010000:0.0:1746147132.352336:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4200/0x3139939425053f87 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e769a2 expref: 51 pid: 7238 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.352346:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147132.352349:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147132.352356:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147132.352363:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147132.352377:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147132.352394:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307700480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 905us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.352399:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6017 00000100:00100000:0.0:1746147132.355488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.355541:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307700736 00000100:00100000:1.0:1746147132.355551:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307700736 00000100:00100000:1.0:1746147132.355604:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5363 00000100:00100000:1.0:1746147132.355611:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:31966:x1830967307700736:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147132.360110:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310569216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147132.360298:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310568960 00000100:00100000:0.0:1746147132.360306:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310568960 00000100:00100000:0.0:1746147132.360338:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310569344 00000100:00100000:0.0:1746147132.360340:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310569344 00000100:00100000:0.0:1746147132.360353:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13855 00000100:00100000:0.0:1746147132.360361:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3765:x1830967310568960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.360582:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.360596:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310569728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.360612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.360621:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.360634:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.360639:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.360649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.360655:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147132.360659:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.360669:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.360674:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.360684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.360698:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310569728 00000100:00100000:1.0:1746147132.360701:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310569728 00000100:00100000:1.0:1746147132.360714:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13857 00000100:00100000:1.0:1746147132.360718:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3764:x1830967310569856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.360730:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310570240 00000100:00100000:1.0:1746147132.360732:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310570240 00000100:00100000:1.0:1746147132.360739:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310570752 00000100:00100000:1.0:1746147132.360741:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310570752 00000100:00100000:1.0:1746147132.360747:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310570112 00000100:00100000:1.0:1746147132.360748:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310570112 00000100:00100000:1.0:1746147132.360753:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310570624 00000100:00100000:1.0:1746147132.360754:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310570624 00000100:00100000:1.0:1746147132.360761:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13858 00000100:00100000:1.0:1746147132.360765:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310570368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147132.360826:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147132.360829:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147132.360831:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147132.360833:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147132.360835:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147132.360852:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967310570368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (422us total) trans 21474841332 rc 0/0 00000100:00100000:1.0:1746147132.360858:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13858 00000100:00100000:1.0:1746147132.360868:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13860 00000100:00100000:1.0:1746147132.360871:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3764:x1830967310569472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.360914:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3764:x1830967310569472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (430us total) trans 17179874059 rc 0/0 00000100:00100000:1.0:1746147132.360919:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13860 00000100:00100000:1.0:1746147132.360926:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13862 00000100:00100000:1.0:1746147132.360930:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310570496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.360970:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967310570496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (439us total) trans 21474841334 rc 0/0 00000100:00100000:1.0:1746147132.360975:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13862 00000100:00100000:1.0:1746147132.360984:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13864 00000100:00100000:1.0:1746147132.360987:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967310569728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.361030:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3767:x1830967310569728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (417us total) trans 17179874061 rc 0/0 00000100:00100000:1.0:1746147132.361035:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13864 00000100:00100000:1.0:1746147132.361044:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13865 00000100:00100000:1.0:1746147132.361048:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310570240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147132.361079:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147132.361081:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147132.361083:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147132.361085:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147132.361087:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147132.361118:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967310570240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (483us total) trans 21474841336 rc 0/0 00000100:00100000:1.0:1746147132.361123:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13865 00000100:00100000:1.0:1746147132.361140:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13867 00000100:00100000:1.0:1746147132.361144:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310570112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.361185:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310570112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (515us total) trans 21474841338 rc 0/0 00000100:00100000:1.0:1746147132.361190:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13867 00000004:00080000:1.0:1746147132.361216:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f57480/2, rc 0, transno 21474841338 00000100:00100000:1.0:1746147132.361220:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.361227:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8380/2, rc 0, transno 21474841339 00000100:00100000:1.0:1746147132.361230:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.361235:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f57b80/2, rc 0, transno 21474841336 00000100:00100000:1.0:1746147132.361238:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.361243:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c30aa00/2, rc 0, transno 21474841337 00000100:00100000:1.0:1746147132.361246:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310570752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.361252:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f55c00/2, rc 0, transno 21474841335 00000100:00100000:1.0:1746147132.361254:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310569216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.361260:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097095c00/2, rc 0, transno 17179874061 00000100:00100000:1.0:1746147132.361499:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310569728:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147132.361572:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147132.361574:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147132.361576:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147132.361578:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147132.361580:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147132.361600:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310569856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 880us (1203us total) trans 17179874064 rc 0/0 00000100:00100000:1.0:1746147132.361605:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13857 00000100:00100000:1.0:1746147132.361625:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310571008 00000100:00100000:1.0:1746147132.361628:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310571008 00000100:00100000:1.0:1746147132.361640:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13871 00000100:00100000:1.0:1746147132.361644:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967310571008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147132.361986:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147132.361988:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147132.361990:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147132.361991:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147132.361993:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147132.362018:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3765:x1830967310568960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1658us (2211us total) trans 17179874066 rc 0/0 00010000:00010000:1.0:1746147132.362022:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147132.362024:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13855 00010000:00010000:1.0:1746147132.362031:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147132.362038:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147132.362044:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a72000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147132.362047:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147132.362053:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147132.362062:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.362064:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147132.362067:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147132.362072:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72000/0x3139939425054680 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147132.362123:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967310571008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 478us (505us total) trans 17179874065 rc 0/0 00000100:00100000:1.0:1746147132.362128:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13871 00000100:00100000:0.0:1746147132.365418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.365839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.366003:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307700992 00000100:00100000:1.0:1746147132.366011:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307700992 00000100:00100000:1.0:1746147132.367221:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307701120 00000100:00100000:0.0:1746147132.367258:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15110 00000100:00100000:1.0:1746147132.367312:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307701120 00000100:00100000:1.0:1746147132.367337:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15111 00000100:00100000:1.0:1746147132.367343:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:31970:x1830967307701120:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147132.367368:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.367389:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d200/0x3139939425054687 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76dca expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.367447:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d200/0x3139939425054687 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dca expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.367460:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d200/0x3139939425054687 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dca expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.367478:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.367480:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147132.367483:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d200, rc 0) 00000100:00100000:0.0:1746147132.367572:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:31975:x1830967307700992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147132.367585:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.367595:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505468e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76dc3 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.367655:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367664:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367671:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367687:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367692:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367697:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367785:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367793:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x31399394250545f4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d68 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.367799:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.367828:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x31399394250545f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d68 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.367839:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x31399394250545f4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76d68 expref: 8 pid: 16099 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.367851:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310571136:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.368673:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:31970:x1830967307701120:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1327us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.368680:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15111 00000100:00100000:0.0:1746147132.368757:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.370831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.370909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147132.371212:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371223:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147132.371237:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147132.371340:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371346:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371352:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371358:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147132.371362:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371368:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371376:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147132.371378:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147132.371381:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371386:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250546a3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371421:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371426:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371434:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371439:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371443:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147132.371445:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371450:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371457:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147132.371459:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147132.371461:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371466:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425054695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371474:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371478:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371482:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371486:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147132.371488:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371495:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371501:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1c00) 00010000:00010000:0.0:1746147132.371503:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147132.371505:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371509:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x313993942505469c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147132.371551:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505468e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dc3 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.371558:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505468e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dc3 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.371564:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563c00, rc 0) 00000100:00100000:0.0:1746147132.371613:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:31975:x1830967307700992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4322us (6178us total) trans 8589935753 rc 301/301 00000100:00100000:0.0:1746147132.371711:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15110 00000100:00100000:0.0:1746147132.374577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.411616:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.419617:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.419664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.419686:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307702144 00000100:00100000:1.0:1746147132.419696:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307702144 00000100:00100000:1.0:1746147132.419923:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307702272 00000100:00100000:1.0:1746147132.419934:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307702272 00000100:00100000:1.0:1746147132.419956:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13872 00000100:00100000:1.0:1746147132.419962:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307702144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.419979:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.420018:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76dd8 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.420051:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.420053:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.420061:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 31 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.420075:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 31 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.420086:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03c800, rc 0) 00000100:00100000:1.0:1746147132.420186:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307702144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 223us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.420192:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13872 00000100:00100000:1.0:1746147132.420206:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13873 00000100:00100000:1.0:1746147132.420210:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307702272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.420217:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.420238:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ddf expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.420250:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.420252:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.420256:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.420265:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.420271:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d800, rc 0) 00000100:00100000:1.0:1746147132.420286:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307702272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 75us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.420290:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13873 00000100:00100000:1.0:1746147132.420744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.421925:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.422336:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.422899:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.423020:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307702656 00000100:00100000:1.0:1746147132.423028:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307702656 00000100:00100000:1.0:1746147132.423059:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307702784 00000100:00100000:1.0:1746147132.423061:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307702784 00000100:00100000:1.0:1746147132.423471:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13876 00000100:00100000:1.0:1746147132.423482:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307702528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.423495:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.423511:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ded expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.423529:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.423531:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.423538:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 34 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.423551:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 34 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.423566:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d400, rc 0) 00000100:00100000:1.0:1746147132.423594:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307702528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 115us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.423600:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13876 00000100:00100000:0.0:1746147132.428619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.435981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.438635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.438674:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.439524:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307703424 00000100:00100000:1.0:1746147132.439535:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307703424 00002000:00100000:1.0:1746147132.439582:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880099155500 x1830967307703424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.439591:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155500 with x1830967307703424 ext(0->1048575) 00002000:00010000:1.0:1746147132.439595:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099155500 00000100:00100000:1.0:1746147132.439719:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3169 00000100:00100000:1.0:1746147132.439727:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967307703680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147132.440125:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.440158:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307703936 00000100:00100000:0.0:1746147132.440164:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307703936 00002000:00100000:0.0:1746147132.440193:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880099154380 x1830967307703936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.440203:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154380 with x1830967307703936 ext(1048576->2097151) 00002000:00010000:0.0:1746147132.440208:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099154380 00000100:00100000:0.0:1746147132.440223:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3170 00000100:00100000:0.0:1746147132.440229:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307703936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147132.440332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.444871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.456569:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307703680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16832us (17883us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147132.456581:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3169 00002000:00100000:1.0:1746147132.456592:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099154000 x1830967307703680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/440 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.456601:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154000 with x1830967307703680 ext(1048576->2097151) 00002000:00010000:1.0:1746147132.456610:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099154000 00000100:00100000:1.0:1746147132.465849:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.469311:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.469503:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307704704 00000100:00100000:1.0:1746147132.469509:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307704704 00000100:00100000:1.0:1746147132.469547:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15116 00000100:00100000:1.0:1746147132.469553:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:31980:x1830967307704704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.469571:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.469586:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76e17 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.469630:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147132.469638:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.469651:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147132.469661:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.469671:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.469674:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147132.469676:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147132.469681:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb7600, rc 0) 00000100:00100000:1.0:1746147132.469718:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:31980:x1830967307704704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 164us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.469723:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15116 00000100:00100000:0.0:1746147132.469919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.473283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.483763:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310571648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147132.483840:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310571904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.484119:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147132.484156:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310571648 00000100:00100000:0.0:1746147132.484164:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310571648 00000100:00100000:1.0:1746147132.484180:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310572160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.484199:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147132.484207:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310572160 00000100:00100000:0.0:1746147132.484209:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310572160 00000100:00100000:1.0:1746147132.484213:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310572672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.484227:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13878 00000100:00100000:0.0:1746147132.484234:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967310571648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.484235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.484250:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310573184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.484264:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.484291:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310572672 00000100:00100000:1.0:1746147132.484297:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310572672 00002000:00010000:0.0:1746147132.484448:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147132.484451:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147132.484453:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147132.484456:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147132.484458:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147132.484499:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967310571648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 264us (379us total) trans 21474841340 rc 0/0 00000100:00100000:0.0:1746147132.484506:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13878 00000100:00100000:0.0:1746147132.484732:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13880 00000100:00100000:0.0:1746147132.484740:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3767:x1830967310573184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.484827:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967310573184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (560us total) trans 17179874067 rc 0/0 00000100:00100000:0.0:1746147132.484833:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13880 00000100:00100000:0.0:1746147132.484845:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13881 00000100:00100000:0.0:1746147132.484849:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310571520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147132.484896:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147132.484898:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147132.484901:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147132.484902:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147132.484904:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147132.484933:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967310571520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (572us total) trans 21474841342 rc 0/0 00000100:00100000:0.0:1746147132.484938:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13881 00000100:00100000:0.0:1746147132.484948:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13883 00000100:00100000:0.0:1746147132.484953:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3766:x1830967310572544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.484990:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13885 00000100:00100000:1.0:1746147132.484996:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967310572672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147132.484996:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147132.484998:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147132.485000:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:0.0:1746147132.485002:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:0.0:1746147132.485005:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147132.485024:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310572544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (610us total) trans 17179874068 rc 0/0 00000100:00100000:0.0:1746147132.485029:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13883 00002000:00010000:1.0:1746147132.485081:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147132.485083:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147132.485085:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147132.485086:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147132.485105:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00010000:00010000:0.0:1746147132.485121:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485141:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147132.485145:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147132.485149:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485159:0:7237:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485166:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485173:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485180:0:7237:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485186:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.485213:0:7237:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147132.485228:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310573568:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.485409:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967310572672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 413us (1172us total) trans 17179874069 rc 0/0 00000100:00100000:1.0:1746147132.485414:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13885 00000100:00100000:1.0:1746147132.485435:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.485461:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.485477:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.485484:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.485497:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.485506:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310573440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.485519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.485540:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746147132.485545:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147132.485559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.485571:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.485571:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310571904 00000100:00100000:0.0:1746147132.485576:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310571904 00000100:00100000:1.0:1746147132.485583:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147132.485591:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310572416 00000100:00100000:1.0:1746147132.485593:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310573312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.485593:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310572416 00000100:00100000:0.0:1746147132.485599:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310572928 00000100:00100000:0.0:1746147132.485601:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310572928 00000100:00100000:1.0:1746147132.485605:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147132.485609:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310573440 00000100:00100000:0.0:1746147132.485610:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310573440 00000100:00100000:0.0:1746147132.485617:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310572288 00000100:00100000:1.0:1746147132.485619:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310572800 00000100:00100000:0.0:1746147132.485619:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310572288 00000100:00100000:1.0:1746147132.485623:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310572800 00000100:00100000:0.0:1746147132.485626:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310573312 00000100:00100000:0.0:1746147132.485629:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310573312 00000100:00100000:1.0:1746147132.485639:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13886 00000100:00100000:1.0:1746147132.485644:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3765:x1830967310571904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147132.485644:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13887 00000100:00100000:0.0:1746147132.485649:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3765:x1830967310572416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147132.485689:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147132.485692:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147132.485693:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147132.485695:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147132.485697:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147132.485720:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310571904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (284us total) trans 21474841344 rc 0/0 00000100:00100000:0.0:1746147132.485723:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310572416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (244us total) trans 21474841345 rc 0/0 00000100:00100000:1.0:1746147132.485724:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13886 00000100:00100000:0.0:1746147132.485730:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13887 00000100:00100000:0.0:1746147132.485743:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13889 00000100:00100000:0.0:1746147132.485747:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310573440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147132.485791:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147132.485794:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147132.485795:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147132.485797:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147132.485799:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147132.485819:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310573440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (298us total) trans 17179874071 rc 0/0 00000100:00100000:0.0:1746147132.485825:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13889 00000100:00100000:1.0:1746147132.485831:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13891 00000100:00100000:1.0:1746147132.485836:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967310572800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.485837:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13892 00000100:00100000:0.0:1746147132.485842:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967310573312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147132.485877:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147132.485880:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147132.485881:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147132.485883:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147132.485884:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00002000:00010000:0.0:1746147132.485890:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147132.485893:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147132.485895:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147132.485896:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147132.485898:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147132.485906:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310572800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (321us total) trans 17179874072 rc 0/0 00000100:00100000:1.0:1746147132.485910:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13891 00000100:00100000:0.0:1746147132.485923:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310573312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (316us total) trans 17179874073 rc 0/0 00000100:00100000:0.0:1746147132.485929:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13892 00000004:00080000:1.0:1746147132.485941:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca20700/2, rc 0, transno 21474841346 00000100:00100000:1.0:1746147132.485946:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.485955:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca22d80/2, rc 0, transno 17179874072 00000100:00100000:1.0:1746147132.485970:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147132.485980:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca23100/2, rc 0, transno 17179874073 00000100:00100000:1.0:1746147132.488947:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310573312:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147132.488995:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154a80/2, rc 0, transno 21474841344 00000100:00100000:1.0:1746147132.488999:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310571904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.489010:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca20a80/2, rc 0, transno 21474841345 00000100:00100000:1.0:1746147132.489013:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572416:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147132.489013:0:7237:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147132.489021:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca22a00/2, rc 0, transno 17179874070 00000100:00100000:1.0:1746147132.489025:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310572928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.489028:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310573824:192.168.204.25@tcp:105: 00000004:00080000:1.0:1746147132.489033:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70700/2, rc 0, transno 17179874071 00000100:00100000:1.0:1746147132.489036:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310573440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147132.489069:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca21180/2, rc 0, transno 21474841341 00000100:00100000:1.0:1746147132.489072:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310572160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147132.489081:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca22680/2, rc 0, transno 17179874069 00000100:00100000:1.0:1746147132.489083:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310572672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147132.489113:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca23b80/2, rc 0, transno 17179874067 00000100:00100000:1.0:1746147132.489116:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310573184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147132.489123:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155c00/2, rc 0, transno 21474841340 00000100:00100000:1.0:1746147132.489125:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310571648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147132.489126:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.489140:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147132.489147:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310573696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.489198:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147132.489248:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310573696 00000100:00100000:1.0:1746147132.489252:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310573696 00000100:00100000:1.0:1746147132.489300:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13894 00000100:00100000:1.0:1746147132.489306:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967310573696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147132.489420:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967310573696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (221us total) trans 17179874075 rc 0/0 00000100:00100000:1.0:1746147132.489425:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13894 00000004:00080000:1.0:1746147132.489445:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70a80/2, rc 0, transno 17179874075 00000100:00100000:1.0:1746147132.489448:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310573696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147132.489712:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310573568:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.489775:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307705088 00000100:00100000:1.0:1746147132.489778:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307705088 00000100:00100000:1.0:1746147132.489810:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5366 00000100:00100000:1.0:1746147132.489815:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:31975:x1830967307705088:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:1.0:1746147132.490070:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:31975:x1830967307705088:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 254us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.490076:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5366 00000100:00100000:0.0:1746147132.490707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.491140:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307705216 00000100:00100000:1.0:1746147132.491145:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307705216 00000100:00100000:1.0:1746147132.491167:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5367 00000100:00100000:1.0:1746147132.491172:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:31980:x1830967307705216:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:1.0:1746147132.491215:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:31980:x1830967307705216:12345-192.168.204.25@tcp:49:cat.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.491220:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5367 00000100:00100000:0.0:1746147132.492899:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.492988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.493160:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307705472 00000100:00100000:1.0:1746147132.493164:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307705472 00000100:00100000:1.0:1746147132.493198:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5368 00000100:00100000:1.0:1746147132.493204:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:31982:x1830967307705472:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:1.0:1746147132.493264:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:31982:x1830967307705472:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.493269:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5368 00000100:00100000:0.0:1746147132.497902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.497947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.503368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.507814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.515757:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.515791:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.515807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.515818:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.515833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.516079:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3174 00000100:00100000:1.0:1746147132.516110:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307706880:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147132.516692:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307706624 00000100:00100000:1.0:1746147132.516696:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307706624 00010000:00010000:1.0:1746147132.516715:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092562600/0x3139939425054679 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dbc expref: 25 pid: 12201 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746147132.516742:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307706496 00000100:00100000:1.0:1746147132.516745:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307706496 00010000:00010000:1.0:1746147132.516756:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72400/0x31399394250546f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dfb expref: 46 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746147132.516771:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6023 00000100:00100000:1.0:1746147132.516776:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307706624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.516785:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.516797:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092562600/0x3139939425054679 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dbc expref: 25 pid: 12201 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147132.516806:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092562600/0x3139939425054679 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dbc expref: 25 pid: 12201 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147132.516826:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.520484:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307706624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3704us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.520493:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6023 00000100:00100000:1.0:1746147132.520587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.528805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.544575:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.547669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.548449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.548505:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307708288 00000100:00100000:1.0:1746147132.548510:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307708288 00002000:00100000:1.0:1746147132.548531:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3497984->4194303) req@ffff8801349a0e00 x1830967307708288/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.548538:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0e00 with x1830967307708288 ext(3497984->4194303) 00010000:00010000:1.0:1746147132.548544:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054736 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e25 expref: 16 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.548553:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054736 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e25 expref: 16 pid: 17600 timeout: 770 lvb_type: 0 00002000:00010000:1.0:1746147132.548559:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801349a0e00 00000100:00100000:1.0:1746147132.548574:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1017 00000100:00100000:1.0:1746147132.548579:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307708288:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147132.557061:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.558626:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6025 00000100:00100000:1.0:1746147132.558636:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967307708416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.558650:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.558669:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a73400/0x313993942505473d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e2c expref: 42 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.558680:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a73400/0x313993942505473d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3588095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e2c expref: 42 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.558703:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a73400/0x313993942505473d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3588095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e2c expref: 42 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.558727:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.558730:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.558737:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.558746:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.558777:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.558789:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310574976:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.558867:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.560040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.560212:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310574976:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147132.560232:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.560270:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307708416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1636us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.560277:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6025 00000100:00100000:1.0:1746147132.560316:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6026 00000100:00100000:1.0:1746147132.560323:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307708544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.560333:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.560349:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054736 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e25 expref: 18 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.560917:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e25 expref: 18 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.560938:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e25 expref: 18 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.560951:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.560953:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.560959:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a72400/0x313993942505474b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e3a expref: 32 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.560965:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a72400/0x313993942505474b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e3a expref: 32 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.560989:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a72400/0x313993942505474b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e3a expref: 32 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.561003:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310575104:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.561077:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.561849:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.563274:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310575104:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147132.563293:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.563314:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307708544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2993us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.563323:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6026 00000100:00100000:0.0:1746147132.564435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.567253:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.577362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.577703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.582646:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.582715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.584041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.584244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.584299:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307710208 00000100:00100000:1.0:1746147132.584302:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307710208 00000100:00100000:1.0:1746147132.584331:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13902 00000100:00100000:1.0:1746147132.584337:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967307710208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.584344:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.584352:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x313993942505478a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76e5d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.584390:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310575360:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147132.584448:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.586776:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310575360:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147132.586808:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x313993942505478a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e5d expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.586822:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x313993942505478a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e5d expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.586844:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f213000, rc 0) 00000100:00100000:1.0:1746147132.586884:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967307710208:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2546us (2639us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147132.586892:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13902 00000100:00100000:0.0:1746147132.592232:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.592378:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307710336 00000100:00100000:1.0:1746147132.592388:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307710336 00010000:00010000:1.0:1746147132.592426:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 28 pid: 17600 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.592469:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6027 00000100:00100000:1.0:1746147132.592477:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967307710336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.592492:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.592512:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 28 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.592529:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 28 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.592554:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cc4200/0x3139939425054744 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e33 expref: 28 pid: 17600 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.592602:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.592605:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.592613:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a73400/0x3139939425054767 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e48 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.592620:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a73400/0x3139939425054767 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e48 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.592658:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a73400/0x3139939425054767 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e48 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.592671:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310575488:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.595205:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.595964:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310575488:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147132.595985:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.596035:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967307710336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3558us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.596044:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6027 00000100:00100000:0.0:1746147132.600193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.600234:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.600254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.600271:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307710848 00000100:00100000:0.0:1746147132.600274:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307710848 00002000:00100000:0.0:1746147132.600481:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009cd47b80 x1830967307710848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.600488:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47b80 with x1830967307710848 ext(1048576->2097151) 00002000:00010000:0.0:1746147132.600492:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47b80 00000100:00100000:0.0:1746147132.601251:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3179 00000100:00100000:0.0:1746147132.601259:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307710848:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147132.603078:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3181 00000100:00100000:1.0:1746147132.603100:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967307711104:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147132.603941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.603961:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307711616 00000100:00100000:0.0:1746147132.603966:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307711616 00002000:00100000:0.0:1746147132.603995:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd46300 x1830967307711616/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.604005:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46300 with x1830967307711616 ext(2097152->4194303) 00002000:00010000:0.0:1746147132.604010:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd46300 00000100:00100000:0.0:1746147132.604039:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3182 00000100:00100000:0.0:1746147132.604045:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307711616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147132.606169:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.643040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.646569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.655391:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.655569:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307712512 00000100:00100000:1.0:1746147132.655578:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307712512 00000100:00100000:1.0:1746147132.655642:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13903 00000100:00100000:1.0:1746147132.655650:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:31986:x1830967307712512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.655670:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.655691:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc000/0x3139939425054791 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76e64 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.655719:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.655720:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.655728:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc000/0x3139939425054791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e64 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.655742:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc000/0x3139939425054791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e64 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.655752:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cc000, rc 0) 00000100:00100000:1.0:1746147132.655794:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:31986:x1830967307712512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 144us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.655800:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13903 00000100:00100000:0.0:1746147132.656920:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.662542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.662727:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.686639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.691462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.695938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.696061:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307714048 00000100:00100000:0.0:1746147132.696071:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307714048 00000100:00100000:0.0:1746147132.696144:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5371 00000100:00100000:0.0:1746147132.696152:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:31986:x1830967307714048:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147132.696785:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:31986:x1830967307714048:12345-192.168.204.25@tcp:35:cat.0 Request processed in 628us (850us total) trans 8589935763 rc 0/0 00000100:00100000:0.0:1746147132.696793:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5371 00000100:00100000:0.0:1746147132.700148:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.701850:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307714176 00000100:00100000:1.0:1746147132.701864:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307714176 00000100:00100000:1.0:1746147132.701959:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 777 00000100:00100000:1.0:1746147132.701971:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307714176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.701991:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.702025:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250547ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e6b expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.702070:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.702076:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.702181:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307714176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 209us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.702193:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 777 00000100:00100000:0.0:1746147132.770410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.772420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.806030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.806085:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.812583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.812626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.812701:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.812862:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307715072 00000100:00100000:1.0:1746147132.812867:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307715072 00010000:00010000:1.0:1746147132.812894:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a72400/0x313993942505474b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e3a expref: 34 pid: 17600 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.812942:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6028 00000100:00100000:1.0:1746147132.812950:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307715200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.812964:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.812982:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054783 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e56 expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147132.813002:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054783 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e56 expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147132.813150:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425054783 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e56 expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147132.813166:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.813168:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.813174:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.813182:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.813214:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.813226:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310576128:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.813271:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.814658:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.818153:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310576128:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147132.818170:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.818191:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307715200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5243us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.818198:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6028 00000100:00100000:0.0:1746147132.820617:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.821918:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.825674:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.825973:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.827753:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.827975:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307716480 00000100:00100000:1.0:1746147132.827981:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307716480 00002000:00100000:1.0:1746147132.828007:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4141056->4194303) req@ffff88011da9d880 x1830967307716480/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.828015:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d880 with x1830967307716480 ext(4141056->4194303) 00010000:00010000:1.0:1746147132.828021:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 33 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.828032:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 33 pid: 1854 timeout: 770 lvb_type: 0 00002000:00010000:1.0:1746147132.828039:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011da9d880 00000100:00100000:1.0:1746147132.828069:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1020 00000100:00100000:1.0:1746147132.828075:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307716480:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147132.830318:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307716480:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 2241us (2567us total) trans 17179874077 rc 0/0 00000100:00100000:1.0:1746147132.830327:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1020 00002000:00100000:1.0:1746147132.830332:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4141056->4194303) req@ffff88011da9d880 x1830967307716480/t17179874077(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/448 e 0 to 0 dl 1746147143 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.830339:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d880 with x1830967307716480 ext(4141056->4194303) 00010000:00010000:1.0:1746147132.830345:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 35 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.830353:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 35 pid: 1854 timeout: 770 lvb_type: 0 00002000:00010000:1.0:1746147132.830359:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011da9d880 00000100:00100000:0.0:1746147132.831037:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.831799:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.831891:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307716736 00000100:00100000:1.0:1746147132.831895:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307716736 00010000:00010000:1.0:1746147132.831911:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 35 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.831930:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6033 00000100:00100000:1.0:1746147132.831935:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307716736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.831942:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.831951:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 35 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.831960:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 35 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.831978:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f09ee00/0x31399394250547de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e79 expref: 35 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746147132.831989:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.831991:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.831995:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250547f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e8e expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.832001:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250547f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e8e expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.832019:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250547f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e8e expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.832028:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310576768:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147132.832190:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897af00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.834482:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310576768:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147132.834494:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.834513:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307716736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2578us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.834519:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6033 00000100:00100000:0.0:1746147132.836271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.836480:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307716992 00000100:00100000:1.0:1746147132.836487:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307716992 00002000:00100000:1.0:1746147132.836529:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3547136->3551231) req@ffff8800930eb480 x1830967307716992/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.836550:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb480 with x1830967307716992 ext(3547136->3551231) 00002000:00010000:1.0:1746147132.836556:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930eb480 00000100:00100000:1.0:1746147132.836587:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3191 00000100:00100000:1.0:1746147132.836595:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307716992:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147132.836915:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307716992:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 319us (650us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147132.836921:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3191 00002000:00100000:1.0:1746147132.836927:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3547136->3551231) req@ffff8800930eb480 x1830967307716992/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.836933:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb480 with x1830967307716992 ext(3547136->3551231) 00002000:00010000:1.0:1746147132.836936:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930eb480 00000100:00100000:0.0:1746147132.841010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.841429:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307717248 00000100:00100000:1.0:1746147132.841439:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307717248 00002000:00100000:1.0:1746147132.841580:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3907584->3911679) req@ffff8800930eb100 x1830967307717248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.841590:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb100 with x1830967307717248 ext(3907584->3911679) 00002000:00010000:1.0:1746147132.841595:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930eb100 00000100:00100000:1.0:1746147132.841632:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3192 00000100:00100000:1.0:1746147132.841640:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307717248:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147132.841796:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307717248:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 156us (794us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147132.841802:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3192 00002000:00100000:1.0:1746147132.841810:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3907584->3911679) req@ffff8800930eb100 x1830967307717248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746147143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147132.841816:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb100 with x1830967307717248 ext(3907584->3911679) 00002000:00010000:1.0:1746147132.841819:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930eb100 00000100:00100000:0.0:1746147132.845132:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.880235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.883475:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.883536:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307717888 00000100:00100000:1.0:1746147132.883544:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307717888 00000100:00100000:1.0:1746147132.883598:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 778 00000100:00100000:1.0:1746147132.883605:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307717888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147132.883618:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147132.883636:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x313993942505480f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e95 expref: 35 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.883659:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147132.883663:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147132.883698:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307717888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.883704:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 778 00000100:00100000:0.0:1746147132.889065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.893783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.900443:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310577024:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.900473:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054839 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147132.900812:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307718656 00000100:00100000:0.0:1746147132.900820:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307718656 00002000:00100000:0.0:1746147132.900858:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009f084700 x1830967307718656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:508/0 lens 488/0 e 0 to 0 dl 1746147143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147132.900868:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967307718656 ext(0->1048575) 00002000:00010000:0.0:1746147132.900874:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:0.0:1746147132.900905:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3193 00000100:00100000:0.0:1746147132.900912:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307718656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147132.909110:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.915538:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307718912 00000100:00100000:1.0:1746147132.915552:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307718912 00000100:00100000:1.0:1746147132.915762:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307719168 00000100:00100000:1.0:1746147132.915985:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307719168 00000100:00100000:1.0:1746147132.916012:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13911 00000100:00100000:1.0:1746147132.916017:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307719168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147132.916025:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.916034:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505484e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76eb8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.916050:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.916051:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.916056:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505484e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb8 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.916065:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505484e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb8 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.916071:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43a00, rc 0) 00000100:00100000:1.0:1746147132.916542:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307719168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 523us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.916548:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13911 00000100:00100000:0.0:1746147132.918503:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.918540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.918553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.918577:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.918614:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307719296 00000100:00100000:0.0:1746147132.918621:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307719296 00000100:00100000:0.0:1746147132.918649:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13912 00000100:00100000:0.0:1746147132.918655:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307719296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147132.918668:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.918682:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ebf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.918699:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.918701:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.918707:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.918719:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.918728:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730a00, rc 0) 00000100:00100000:1.0:1746147132.918939:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307719424 00000100:00100000:1.0:1746147132.918943:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307719424 00000100:00100000:1.0:1746147132.918960:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307719552 00000100:00100000:1.0:1746147132.918962:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307719552 00000100:00100000:1.0:1746147132.918973:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307719680 00000100:00100000:1.0:1746147132.918974:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307719680 00000100:00100000:1.0:1746147132.918986:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13913 00000100:00100000:1.0:1746147132.918991:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307719424:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147132.918998:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.919004:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x313993942505485c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ec6 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147132.919040:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310577152:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147132.919365:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307719296:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 709us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.919370:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13912 00000100:00100000:1.0:1746147132.919568:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.921268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.922411:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310577152:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147132.922429:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x313993942505485c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ec6 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.922438:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x313993942505485c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ec6 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.922449:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43e00, rc 0) 00000100:00100000:1.0:1746147132.922478:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307719424:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3486us (3937us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147132.922483:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13913 00000100:00100000:0.0:1746147132.923399:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.924767:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.925848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.926067:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307720448 00000100:00100000:0.0:1746147132.926071:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307720448 00000100:00100000:0.0:1746147132.926116:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13916 00000100:00100000:0.0:1746147132.926131:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307720448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147132.926140:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147132.926151:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731400/0x31399394250548a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76ee9 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147132.926179:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310577664:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147132.929746:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147132.931581:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.937630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.937689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.937768:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6035 00000100:00100000:0.0:1746147132.937775:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307720704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147132.937787:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147132.937792:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425054886 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76edb expref: 16 pid: 7237 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.937801:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425054886 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76edb expref: 16 pid: 7237 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.938910:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425054886 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76edb expref: 16 pid: 7237 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147132.939622:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147132.939686:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147132.939714:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307720704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1938us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147132.939720:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6035 00010000:00010000:0.0:1746147132.939787:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250547f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e8e expref: 22 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746147132.939797:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310577664:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147132.939813:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731400/0x31399394250548a2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ee9 expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.939821:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731400/0x31399394250548a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ee9 expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.939828:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731400, rc 0) 00000100:00100000:0.0:1746147132.939846:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307720448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 13725us (14000us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147132.939851:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13916 00000100:00100000:0.0:1746147132.942591:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.947404:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.949651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.950581:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3194 00000100:00100000:0.0:1746147132.950594:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307721344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147132.956681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.956715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.956751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147132.957027:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307721856 00000100:00100000:1.0:1746147132.957032:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307721856 00000100:00100000:1.0:1746147132.957056:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13918 00000100:00100000:1.0:1746147132.957061:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967307721856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147132.957073:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147132.957107:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x31399394250548c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76efe expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.957134:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.957136:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147132.957143:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x31399394250548c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76efe expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.957154:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x31399394250548c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76efe expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147132.957161:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0e800, rc 0) 00000100:00100000:1.0:1746147132.957177:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307721856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 116us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147132.957182:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13918 00000100:00100000:0.0:1746147132.971291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.971315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.972926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.976749:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.985401:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.985530:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.985543:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.985553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.985567:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723136 00000100:00100000:0.0:1746147132.985569:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723136 00000100:00100000:0.0:1746147132.985587:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723264 00000100:00100000:0.0:1746147132.985588:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723264 00000100:00100000:0.0:1746147132.985596:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723392 00000100:00100000:0.0:1746147132.985598:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723392 00000100:00100000:0.0:1746147132.985606:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13922 00000100:00100000:0.0:1746147132.985611:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307723136:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.985641:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x31399394250548f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.985657:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 21 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985664:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 15 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985671:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 36 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985681:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.985683:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.985685:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x31399394250548f6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.985711:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 36 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985723:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 36 pid: 10340 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.985735:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310578560:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.985800:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 15 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985807:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 15 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.985813:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310578688:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.985831:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 21 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985837:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 21 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.985848:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310578816:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.985858:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.985874:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13923 00000100:00100000:0.0:1746147132.985879:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307723264:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.985895:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250548fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.985905:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985910:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x3139939425054840 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb1 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985916:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 41 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985920:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.985921:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.985923:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250548fd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.985933:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 41 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985940:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 41 pid: 10340 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.985948:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310578944:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.985971:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x3139939425054840 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb1 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.985978:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x3139939425054840 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb1 expref: 14 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.985984:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310579072:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.985999:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986006:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 28 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.986013:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310579200:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.986027:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.986060:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.986075:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723520 00000100:00100000:0.0:1746147132.986078:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723520 00000100:00100000:0.0:1746147132.986113:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13925 00000100:00100000:0.0:1746147132.986129:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307723520:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.986143:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.986156:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 21 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986162:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986168:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986173:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.986174:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.986175:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.986189:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986196:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 36 pid: 1136 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.986202:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310579712:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.986223:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986229:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 16 pid: 9586 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.986240:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310579840:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.986257:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 21 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986264:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 21 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.986270:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310579968:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.986282:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147132.986325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147132.986337:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723648 00000100:00100000:0.0:1746147132.986339:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723648 00000100:00100000:0.0:1746147132.986356:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13926 00000100:00100000:0.0:1746147132.986360:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307723648:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147132.986375:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a1f800/0x3139939425054912 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.986384:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x313993942505486a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ed4 expref: 36 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.986389:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986395:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x31399394250548c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76efe expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986400:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.986401:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147132.986403:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1f800/0x3139939425054912 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.986415:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x31399394250548c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76efe expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147132.986421:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x31399394250548c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76efe expref: 21 pid: 12225 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.986428:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310580096:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147132.986449:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147132.986451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147132.986454:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 17 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147132.986461:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310580224:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.986466:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723776 00000100:00100000:1.0:1746147132.986469:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723776 00010000:00010000:0.0:1746147132.986476:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x313993942505486a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ed4 expref: 36 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147132.986482:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x313993942505486a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ed4 expref: 36 pid: 17600 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.986486:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13927 00000100:00100000:1.0:1746147132.986490:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307723776:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:0.0:1746147132.986492:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310580352:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147132.986500:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147132.986504:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.986512:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.986518:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.986519:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147132.986521:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.986534:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147132.986545:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 41 pid: 1854 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746147132.986553:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310580480:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147132.986569:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.002790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.002843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.002855:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.002876:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.002905:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.002932:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724160 00000100:00100000:0.0:1746147133.002938:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724160 00010000:00010000:0.0:1746147133.002967:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 20 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.002987:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724032 00000100:00100000:0.0:1746147133.002989:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724032 00010000:00010000:0.0:1746147133.002998:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 35 pid: 10340 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.003005:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307723904 00000100:00100000:0.0:1746147133.003007:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307723904 00010000:00010000:0.0:1746147133.003014:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.003021:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724416 00000100:00100000:0.0:1746147133.003023:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724416 00010000:00010000:0.0:1746147133.003030:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 42 pid: 10340 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.003042:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724288 00000100:00100000:0.0:1746147133.003044:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724288 00010000:00010000:0.0:1746147133.003050:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x3139939425054840 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb1 expref: 16 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.003059:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6039 00000100:00100000:0.0:1746147133.003065:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967307724160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.003076:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.003131:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 20 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003140:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 20 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003159:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x313993942505466b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da0 expref: 20 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003175:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.003208:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967307724160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 142us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.003213:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6039 00000100:00100000:0.0:1746147133.003226:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6040 00000100:00100000:0.0:1746147133.003231:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307724032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.003237:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.003243:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 35 pid: 10340 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003251:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 35 pid: 10340 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003260:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03c800/0x31399394250546d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76dd8 expref: 35 pid: 10340 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003266:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.003277:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307724032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.003282:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6040 00000100:00100000:0.0:1746147133.003290:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6041 00000100:00100000:0.0:1746147133.003294:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307723904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.003299:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.003304:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003311:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003320:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425054847 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eaa expref: 18 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003327:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.003328:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.003333:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x31399394250548f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.003340:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x31399394250548f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.003357:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.003371:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967307723904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.003376:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6041 00000100:00100000:0.0:1746147133.003384:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6042 00000100:00100000:0.0:1746147133.003389:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307724416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.003395:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.003405:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 42 pid: 10340 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.003411:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x31399394250546db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ddf expref: 42 pid: 10340 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746147133.003422:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6043 00010000:00010000:0.0:1746147133.003422:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.003429:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307724288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147133.003435:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307724416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 46us (558us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147133.003437:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147133.003439:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6042 00010000:00010000:1.0:1746147133.003446:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x3139939425054840 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb1 expref: 16 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.003454:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x3139939425054840 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb1 expref: 16 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.003466:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.003482:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307724288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.003487:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6043 00000100:00100000:0.0:1746147133.003504:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.003528:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724544 00000100:00100000:1.0:1746147133.003532:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724544 00010000:00010000:1.0:1746147133.003543:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 29 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746147133.003558:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6044 00000100:00100000:1.0:1746147133.003562:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:2002:x1830967307724544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.003569:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.003574:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 29 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.003582:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x313993942505465d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76da7 expref: 29 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.003592:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.003594:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.003596:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250548fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.003602:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250548fd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.003612:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.003626:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:2002:x1830967307724544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.003631:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6044 00000100:00100000:0.0:1746147133.006897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.006969:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310579840:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.006995:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310579968:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.007010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.007030:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310579712:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.007052:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.007075:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.007129:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310580096:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.007160:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310580352:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.007183:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310580224:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.007196:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095a1f800/0x3139939425054912 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.007227:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.007239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.007253:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724672 00000100:00100000:0.0:1746147133.007257:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724672 00010000:00010000:0.0:1746147133.007282:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x313993942505477c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e4f expref: 28 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.007299:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724928 00000100:00100000:0.0:1746147133.007301:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724928 00010000:00010000:0.0:1746147133.007309:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 16 pid: 9586 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.007317:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725056 00000100:00100000:0.0:1746147133.007319:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725056 00010000:00010000:0.0:1746147133.007326:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 19 pid: 1853 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.007334:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725312 00000100:00100000:0.0:1746147133.007336:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725312 00010000:00010000:0.0:1746147133.007342:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 17 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.007349:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307724800 00000100:00100000:0.0:1746147133.007351:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307724800 00010000:00010000:0.0:1746147133.007357:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505484e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb8 expref: 14 pid: 9586 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746147133.007367:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6045 00000100:00100000:0.0:1746147133.007373:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2002:x1830967307724672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.007382:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.007397:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x313993942505477c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e4f expref: 28 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007406:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x313993942505477c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e4f expref: 28 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007423:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x313993942505477c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e4f expref: 28 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007438:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.007466:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:2002:x1830967307724672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.007474:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6045 00000100:00100000:0.0:1746147133.007486:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6046 00000100:00100000:0.0:1746147133.007490:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307724928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.007496:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.007507:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 17 pid: 9586 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007513:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 17 pid: 9586 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007524:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730a00/0x3139939425054855 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ebf expref: 17 pid: 9586 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007532:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.007544:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307724928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.007549:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6046 00000100:00100000:0.0:1746147133.007557:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6047 00000100:00100000:0.0:1746147133.007562:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967307725056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.007567:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.007572:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 19 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007580:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 19 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007594:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425054664 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76db5 expref: 19 pid: 1853 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007602:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.007613:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307725056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.007617:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6047 00000100:00100000:0.0:1746147133.007625:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6048 00000100:00100000:0.0:1746147133.007629:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307725312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.007634:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.007640:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 15 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007647:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 15 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007656:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x31399394250548d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f0c expref: 15 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007663:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.007675:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307725312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 46us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.007680:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6048 00000100:00100000:0.0:1746147133.007688:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6049 00000100:00100000:0.0:1746147133.007692:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307724800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.007700:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.007748:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505484e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb8 expref: 14 pid: 9586 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007754:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505484e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76eb8 expref: 14 pid: 9586 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746147133.007763:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.007776:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307724800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.007781:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6049 00000100:00100000:0.0:1746147133.007827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.008932:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310580480:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.008948:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.009008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.009019:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725568 00000100:00100000:1.0:1746147133.009023:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725568 00010000:00010000:1.0:1746147133.009037:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a73600/0x31399394250546e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76de6 expref: 41 pid: 17600 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746147133.009052:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6050 00000100:00100000:1.0:1746147133.009057:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307725568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.009064:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.009072:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a73600/0x31399394250546e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76de6 expref: 41 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.009080:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a73600/0x31399394250546e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76de6 expref: 41 pid: 17600 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.009104:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.009105:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.009109:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f200/0x3139939425054904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.009115:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f200/0x3139939425054904 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.009136:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.009152:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307725568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.009156:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6050 00000100:00100000:1.0:1746147133.009184:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.009192:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725184 00000100:00100000:1.0:1746147133.009194:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725184 00010000:00010000:1.0:1746147133.009203:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 34 pid: 1136 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746147133.009228:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6051 00000100:00100000:1.0:1746147133.009233:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307725184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.009240:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.009248:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 34 pid: 1136 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.009255:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 34 pid: 1136 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.009267:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x31399394250546f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ded expref: 34 pid: 1136 timeout: 770 lvb_type: 1 00010000:00010000:1.0:1746147133.009279:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.009280:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.009283:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.009289:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.009308:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.009324:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307725184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.009328:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6051 00000100:00100000:1.0:1746147133.009362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.009377:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725696 00000100:00100000:1.0:1746147133.009380:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725696 00000100:00100000:1.0:1746147133.009395:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13928 00000100:00100000:1.0:1746147133.009400:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967307725696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.009411:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.009421:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425054920 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76f21 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147133.009432:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814173a, atime: 0x68141739, ctime: 0x6814173a, blocks: 0x7c8 00010000:00010000:1.0:1746147133.009441:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.009443:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.009448:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425054920 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f21 expref: 34 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.009457:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425054920 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f21 expref: 34 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.009464:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fc00, rc 0) 00000100:00100000:1.0:1746147133.009480:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967307725696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.009590:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725440 00000100:00100000:0.0:1746147133.009595:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725440 00010000:00010000:0.0:1746147133.009604:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009612:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009623:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009629:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009635:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009641:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093730800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147133.009643:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009649:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009658:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.009663:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942505490b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.009754:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13928 00000100:00100000:0.0:1746147133.009773:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307723520:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 23652us (23710us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.009780:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13925 00002000:00100000:0.0:1746147133.009905:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3551231) req@ffff880099150000 x1830967307725440/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.009913:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967307725440 ext(3145728->3551231) 00010000:00010000:0.0:1746147133.009919:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 41 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147133.009927:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 41 pid: 1854 timeout: 770 lvb_type: 0 00002000:00010000:0.0:1746147133.009937:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150000 00000100:00100000:0.0:1746147133.009961:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1022 00000100:00100000:0.0:1746147133.009966:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967307725440:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147133.010026:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307725952 00000100:00100000:0.0:1746147133.010029:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307725952 00000100:00100000:0.0:1746147133.010233:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307726080 00000100:00100000:0.0:1746147133.010236:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307726080 00000100:00100000:0.0:1746147133.010254:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13931 00000100:00100000:0.0:1746147133.010258:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307726080:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.010264:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.010272:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76f36 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147133.010280:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814173b, atime: 0x6814173b, ctime: 0x6814173b, blocks: 0x800 00010000:00010000:0.0:1746147133.010287:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.010289:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.010293:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f36 expref: 36 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.010302:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f36 expref: 36 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.010307:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbed600, rc 0) 00000100:00100000:0.0:1746147133.010321:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307726080:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.010328:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13931 00000100:00100000:1.0:1746147133.012408:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13933 00000100:00100000:1.0:1746147133.012415:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967307726336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.012426:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.012436:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0e000/0x3139939425054943 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76f44 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.012471:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310580608:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147133.012520:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.017841:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967307725440:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7867us (10006us total) trans 21474841351 rc 0/0 00000100:00100000:0.0:1746147133.017852:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1022 00002000:00100000:0.0:1746147133.017863:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3551231) req@ffff880099150000 x1830967307725440/t21474841351(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/448 e 0 to 0 dl 1746147144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.017873:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967307725440 ext(3145728->3551231) 00010000:00010000:0.0:1746147133.017883:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 44 pid: 1854 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746147133.017898:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 44 pid: 1854 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746147133.017907:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150000 00000100:00100000:0.0:1746147133.020787:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.023758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.024695:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307726976 00000100:00100000:1.0:1746147133.024703:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307726976 00000100:00100000:0.0:1746147133.024920:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147133.024963:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 44 pid: 1854 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.024998:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6054 00000100:00100000:1.0:1746147133.025005:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307726976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.025018:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.025034:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 44 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.025045:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 45 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.025063:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x31399394250547ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e87 expref: 45 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.025080:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.025082:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.025086:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.025108:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.025135:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.025169:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307726976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 164us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.025175:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6054 00010000:00010000:0.0:1746147133.025334:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025342:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025356:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025367:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025373:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025379:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0f400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147133.025382:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025679:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025689:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.025690:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.025695:0:12225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025701:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.025724:0:12225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.025735:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310580736:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147133.025784:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.027333:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310580736:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147133.027351:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.027357:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425054919 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.027396:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307723776:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 40905us (40945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.027696:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13927 00000100:00100000:0.0:1746147133.030627:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.033307:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.033980:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.034153:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307727872 00000100:00100000:0.0:1746147133.034156:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307727872 00000100:00100000:0.0:1746147133.034181:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15127 00000100:00100000:0.0:1746147133.034186:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32000:x1830967307727872:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1746147133.034697:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.034728:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7600/0x31399394250548be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ef7 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034758:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.034762:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147133.034790:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147133.034803:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034869:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 33 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034875:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 33 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034881:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034885:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034895:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 8/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147133.034920:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.034931:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 14 pid: 16099 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.034942:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310580864:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.035329:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.035336:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 33 pid: 7238 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.035342:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310580992:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.035619:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 33 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.035627:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 33 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.035635:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310581120:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.035661:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 33 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.035673:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 33 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.035680:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310581248:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.035700:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.035706:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.035713:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310581376:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.035725:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.039463:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.039489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.039880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.039964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.040002:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307728128 00000100:00100000:1.0:1746147133.040007:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307728128 00010000:00010000:1.0:1746147133.040032:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 34 pid: 7238 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.040051:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307728384 00000100:00100000:1.0:1746147133.040052:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307728384 00010000:00010000:1.0:1746147133.040058:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 35 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.040072:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307728000 00000100:00100000:1.0:1746147133.040073:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307728000 00010000:00010000:1.0:1746147133.040079:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 15 pid: 16099 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.040114:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6055 00000100:00100000:1.0:1746147133.040130:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307728128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.040142:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.040147:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 35 pid: 7238 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040154:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 35 pid: 7238 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040171:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb7600/0x3139939425054728 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e17 expref: 35 pid: 7238 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040181:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.040185:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147133.040191:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.040221:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307728128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.040226:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6055 00000100:00100000:1.0:1746147133.040236:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6056 00000100:00100000:1.0:1746147133.040240:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307728384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.040245:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.040248:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 33 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040258:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 33 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040266:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250547d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e72 expref: 33 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040271:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.040274:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147133.040278:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.040287:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307728384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.040290:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6056 00000100:00100000:1.0:1746147133.040320:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6057 00000100:00100000:1.0:1746147133.040323:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307728000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.040328:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.040330:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 15 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040336:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 15 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040344:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505472f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e1e expref: 15 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.040349:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.040352:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147133.040356:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.040364:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307728000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.040368:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6057 00000100:00100000:0.0:1746147133.040610:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307728256 00000100:00100000:0.0:1746147133.040613:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307728256 00010000:00010000:0.0:1746147133.040623:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 32 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.040635:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6058 00000100:00100000:0.0:1746147133.040638:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307728256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.040643:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.040646:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 32 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.040652:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 32 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.040662:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425054721 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e10 expref: 32 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.040668:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.040670:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147133.040674:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.040687:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307728256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.040691:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6058 00000100:00100000:0.0:1746147133.040728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.042843:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.042959:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307728768 00000100:00100000:1.0:1746147133.042964:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307728768 00010000:00010000:1.0:1746147133.042984:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.043003:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6059 00000100:00100000:1.0:1746147133.043009:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307728768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.043023:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.043027:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.043035:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.043049:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x313993942505476e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76e41 expref: 14 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.043058:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.043062:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147133.043068:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147133.043073:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed000/0x313993942505495f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147133.043497:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.043518:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307728768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 509us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.043524:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6059 00000100:00100000:1.0:1746147133.045547:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310581504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.045587:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.045616:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147133.045622:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310581632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.045635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.045653:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310581504 00000100:00100000:1.0:1746147133.045656:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310581504 00000100:00100000:1.0:1746147133.045683:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310581632 00000100:00100000:1.0:1746147133.045685:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310581632 00000100:00100000:1.0:1746147133.045694:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13937 00000100:00100000:1.0:1746147133.045699:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3767:x1830967310581504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147133.045779:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147133.045782:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147130 -> 1746147130 00002000:00010000:1.0:1746147133.045783:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147129 -> 1746147129 00002000:00010000:1.0:1746147133.045785:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147130 -> 1746147130 00002000:00010000:1.0:1746147133.045787:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147133.045808:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967310581504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (221us total) trans 17179874079 rc 0/0 00000100:00080000:0.0:1746147133.045997:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147133.046028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.046364:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310581760 00000100:00100000:0.0:1746147133.046366:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310581760 00000100:00100000:1.0:1746147133.046406:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13937 00000100:00100000:1.0:1746147133.046414:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310582272 00000100:00100000:1.0:1746147133.046417:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310582272 00000100:00100000:1.0:1746147133.046427:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310581888 00000100:00100000:1.0:1746147133.046428:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310581888 00000100:00100000:1.0:1746147133.046433:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310582400 00000100:00100000:1.0:1746147133.046435:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310582400 00000100:00100000:1.0:1746147133.046570:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13941 00000100:00100000:1.0:1746147133.046575:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:32003:x1830967307728896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.046583:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.046593:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425054966 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76f60 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.046609:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.046611:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147133.047028:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13946 00000100:00100000:0.0:1746147133.047034:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3764:x1830967310581760:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147133.047125:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425054966 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f60 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147133.047137:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147133.047139:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147133.047141:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147133.047143:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147133.047144:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00010000:00010000:1.0:1746147133.047149:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425054966 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f60 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.047158:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9c00, rc 0) 00000100:00100000:0.0:1746147133.047165:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3764:x1830967310581760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (1061us total) trans 17179874087 rc 0/0 00000100:00100000:0.0:1746147133.047170:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13946 00000100:00100000:1.0:1746147133.047179:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:32003:x1830967307728896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 604us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.047184:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13941 00000100:00100000:1.0:1746147133.047253:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310582784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.047271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147133.047280:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310582784 00000100:00100000:1.0:1746147133.047282:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310583296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147133.047283:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310582784 00000100:00100000:1.0:1746147133.047292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.047301:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147133.047301:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310583296 00000100:00100000:0.0:1746147133.047303:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310583296 00000100:00100000:1.0:1746147133.047304:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310582656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147133.047312:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13947 00000100:00100000:1.0:1746147133.047315:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147133.047316:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310582784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.047323:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310583168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.047334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.047348:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310582656 00000100:00100000:1.0:1746147133.047351:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310582656 00000100:00100000:1.0:1746147133.047362:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310583168 00000100:00100000:1.0:1746147133.047364:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310583168 00002000:00010000:0.0:1746147133.047367:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147133.047369:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147133.047371:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00000100:00100000:1.0:1746147133.047373:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13948 00002000:00010000:0.0:1746147133.047373:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147133.047375:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147133.047377:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967310583296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147133.047394:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967310582784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (122us total) trans 21474841352 rc 0/0 00000100:00100000:0.0:1746147133.047399:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13947 00000100:00100000:0.0:1746147133.047407:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13949 00000100:00100000:0.0:1746147133.047411:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967310582656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147133.047415:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147133.047417:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.047419:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147133.047420:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.047421:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147133.047438:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3765:x1830967310583296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (144us total) trans 21474841353 rc 0/0 00000100:00100000:1.0:1746147133.047442:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13948 00002000:00010000:0.0:1746147133.047442:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147133.047444:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147133.047446:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147133.047447:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147131 -> 1746147131 00002000:00010000:0.0:1746147133.047448:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147133.047450:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13950 00000100:00100000:1.0:1746147133.047454:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967310583168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147133.047463:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967310582656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (146us total) trans 21474841354 rc 0/0 00000100:00100000:0.0:1746147133.047467:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13949 00000100:00080000:0.0:1746147133.047478:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147133.047496:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967310583168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (161us total) trans 21474841355 rc 0/0 00000100:00100000:1.0:1746147133.047501:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13950 00000004:00080000:1.0:1746147133.047516:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154e00/2, rc 0, transno 21474841354 00000100:00100000:1.0:1746147133.047519:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310582656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147133.047523:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099157b80/2, rc 0, transno 21474841355 00000100:00100000:1.0:1746147133.047526:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310583168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147133.047530:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155880/2, rc 0, transno 21474841352 00000100:00100000:1.0:1746147133.047532:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310582784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147133.047537:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099157480/2, rc 0, transno 21474841353 00000100:00100000:1.0:1746147133.047538:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310583296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.047548:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310583040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.047562:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.047582:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310583552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.047593:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147133.047608:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a1f80/2, rc 0, transno 17179874079 00000100:00100000:1.0:1746147133.047611:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310581504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.047623:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13951 00000100:00100000:1.0:1746147133.047627:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3767:x1830967310583040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147133.047666:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147133.047668:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.047670:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147133.047672:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.047674:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147133.047690:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3767:x1830967310583040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (128us total) trans 21474841356 rc 0/0 00000100:00100000:1.0:1746147133.047694:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13951 00000100:00100000:1.0:1746147133.047701:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310583424 00000100:00100000:1.0:1746147133.047703:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310583424 00000100:00100000:1.0:1746147133.047711:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13953 00000100:00100000:1.0:1746147133.047714:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3766:x1830967310582912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147133.047749:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147133.047751:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147133.047753:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147133.047755:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147133.047756:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147133.047775:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967310582912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (113us total) trans 21474841358 rc 0/0 00000100:00100000:1.0:1746147133.047780:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13953 00000004:00080000:1.0:1746147133.048161:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155f80/2, rc 0, transno 21474841356 00000100:00100000:1.0:1746147133.048164:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310583040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.048208:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3767:x1830967310583552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 578us (614us total) trans 21474841357 rc 0/0 00000100:00100000:1.0:1746147133.048213:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13952 00000004:00080000:0.0:1746147133.048327:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095062a00/2, rc 0, transno 21474841357 00000100:00100000:0.0:1746147133.048330:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310583552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147133.050414:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.050462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.065355:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.065404:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.065480:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.065511:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307729792 00000100:00100000:0.0:1746147133.065514:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307729792 00002000:00100000:0.0:1746147133.065533:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880134869c00 x1830967307729792/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.065540:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134869c00 with x1830967307729792 ext(3145728->4194303) 00002000:00010000:0.0:1746147133.065544:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134869c00 00000100:00100000:0.0:1746147133.065570:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3201 00000100:00100000:0.0:1746147133.065575:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307729792:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147133.079215:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.080280:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.087544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.087733:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307730432 00000100:00100000:1.0:1746147133.087738:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307730432 00010000:00010000:1.0:1746147133.087761:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x31399394250548e8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f1a expref: 9 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.087784:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6060 00000100:00100000:1.0:1746147133.087789:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307730432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.087797:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.087801:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x31399394250548e8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f1a expref: 9 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.087808:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x31399394250548e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f1a expref: 9 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.087824:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x31399394250548e8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f1a expref: 9 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.087848:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.087852:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x31399394250549ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147133.087859:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x31399394250549ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147133.087864:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x31399394250549ba lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147133.087870:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed400/0x31399394250549b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.087875:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed400/0x31399394250549b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.087879:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed400/0x31399394250549b3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.087905:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.087942:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307730432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 152us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.087947:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6060 00000100:00100000:0.0:1746147133.091542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.091577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.091618:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.091647:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307730560 00000100:00100000:0.0:1746147133.091653:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307730560 00000100:00100000:0.0:1746147133.091684:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307730816 00000100:00100000:0.0:1746147133.091686:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307730816 00000100:00100000:0.0:1746147133.091710:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307731072 00000100:00100000:0.0:1746147133.091713:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307731072 00000100:00100000:0.0:1746147133.091727:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13955 00000100:00100000:0.0:1746147133.091734:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307730560:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147133.091748:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.091762:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x31399394250549cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76f8a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.091783:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.091785:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.091791:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x31399394250549cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f8a expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.091802:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x31399394250549cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f8a expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.091810:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4000, rc 0) 00000100:00100000:0.0:1746147133.092303:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307730560:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 568us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.092308:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13955 00000100:00100000:0.0:1746147133.096842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.096880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.096908:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.096937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.096984:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307730688 00000100:00100000:0.0:1746147133.096992:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307730688 00000100:00100000:0.0:1746147133.097353:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307731200 00000100:00100000:0.0:1746147133.097356:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307731200 00000100:00100000:0.0:1746147133.097373:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13958 00000100:00100000:0.0:1746147133.097378:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307730688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147133.097387:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.097401:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x31399394250549e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76f91 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.097416:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.097418:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.097425:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x31399394250549e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f91 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.097439:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x31399394250549e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f91 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.097447:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4200, rc 0) 00000100:00100000:0.0:1746147133.097485:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307730688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 107us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.097491:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13958 00000100:00100000:0.0:1746147133.097505:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13960 00000100:00100000:0.0:1746147133.097509:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307731200:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147133.097515:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.097521:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76fad expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.097531:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.097532:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.097536:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.097544:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.097550:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4600, rc 0) 00000100:00100000:0.0:1746147133.097565:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307731200:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 55us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.097569:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13960 00000100:00100000:0.0:1746147133.101692:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.101725:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.103164:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307731584 00000100:00100000:1.0:1746147133.103174:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307731584 00000100:00100000:0.0:1746147133.103195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.103222:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307731840 00000100:00100000:1.0:1746147133.103225:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307731840 00000100:00100000:0.0:1746147133.103234:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.103243:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307731712 00000100:00100000:1.0:1746147133.103245:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307731712 00000100:00100000:0.0:1746147133.103251:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307731968 00000100:00100000:0.0:1746147133.103253:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307731968 00000100:00100000:1.0:1746147133.103263:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13961 00000100:00100000:1.0:1746147133.103270:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307731584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.103286:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.103301:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250549f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76fb4 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.103323:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.103324:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.103331:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250549f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fb4 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.103345:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250549f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fb4 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.103354:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822be00, rc 0) 00000100:00100000:1.0:1746147133.103388:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307731584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 119us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.103462:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13962 00000100:00100000:0.0:1746147133.103469:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967307731840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.103476:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.103484:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4600/0x3139939425054a00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76fc2 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.103496:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.103497:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.103501:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4600/0x3139939425054a00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fc2 expref: 30 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.103510:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4600/0x3139939425054a00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fc2 expref: 30 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.103516:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4600, rc 0) 00000100:00100000:0.0:1746147133.103532:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967307731840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 64us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.103538:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13962 00000100:00100000:1.0:1746147133.103717:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13961 00000100:00100000:0.0:1746147133.126381:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.126415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.126444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.126462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.126474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.126486:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.126617:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307731456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29369us (29678us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147133.126628:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3202 00002000:00100000:0.0:1746147133.126639:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880098c73480 x1830967307731456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.126649:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73480 with x1830967307731456 ext(4194304->4919295) 00002000:00010000:0.0:1746147133.126655:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c73480 00000100:00100000:0.0:1746147133.142059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.142182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.142224:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307732864 00000100:00100000:1.0:1746147133.142235:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307732864 00000100:00100000:0.0:1746147133.142248:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.142274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.143407:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.143630:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307733120 00000100:00100000:1.0:1746147133.143638:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307733120 00000100:00100000:1.0:1746147133.143698:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307733376 00000100:00100000:1.0:1746147133.143701:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307733376 00000100:00100000:1.0:1746147133.143719:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307732992 00000100:00100000:1.0:1746147133.143721:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307732992 00000100:00100000:1.0:1746147133.143731:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307733248 00000100:00100000:1.0:1746147133.143733:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307733248 00000100:00100000:1.0:1746147133.143758:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13971 00000100:00100000:1.0:1746147133.143767:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967307732864:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147133.143869:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.143876:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967307732864:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 110us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.143882:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13971 00000100:00100000:1.0:1746147133.143895:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307733504 00000100:00100000:1.0:1746147133.143897:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307733504 00000100:00100000:1.0:1746147133.143906:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13972 00000100:00100000:1.0:1746147133.143910:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307733120:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147133.143945:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307733120:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 34us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.143949:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13972 00000100:00100000:1.0:1746147133.143957:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13973 00000100:00100000:1.0:1746147133.143961:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307733376:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147133.143987:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307733376:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 26us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.143992:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13973 00000100:00100000:1.0:1746147133.144233:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13975 00000100:00100000:1.0:1746147133.144241:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307733248:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147133.144276:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307733248:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 36us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.144281:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13975 00000100:00100000:0.0:1746147133.147303:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.147528:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.150568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.150616:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307734016 00000100:00100000:0.0:1746147133.150625:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307734016 00000100:00100000:0.0:1746147133.150677:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13978 00000100:00100000:0.0:1746147133.150686:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307734016:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:0.0:1746147133.150870:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147133.150873:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147133.150875:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147133.150877:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147133.150878:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147133.150937:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967307734016:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 251us (377us total) trans 17179874088 rc 0/0 00000100:00100000:0.0:1746147133.150943:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13978 00000100:00100000:0.0:1746147133.154901:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.154948:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.155024:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307734272 00000100:00100000:1.0:1746147133.155033:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307734272 00000100:00100000:1.0:1746147133.156949:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3204 00000100:00100000:1.0:1746147133.156958:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307734272:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147133.156987:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.156998:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.157000:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.157004:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.157015:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.158771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.160574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.160654:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307734784 00000100:00100000:0.0:1746147133.160664:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307734784 00000100:00100000:0.0:1746147133.160714:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307735040 00000100:00100000:0.0:1746147133.160717:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307735040 00000100:00100000:0.0:1746147133.160735:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3205 00000100:00100000:0.0:1746147133.160743:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967307734784:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147133.160779:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.160793:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.160794:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.160799:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.160813:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.167147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.167186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.169680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.172340:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3207 00000100:00100000:0.0:1746147133.172352:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2000:x1830967307735296:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147133.172390:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x3139939425054a31 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.172405:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.172407:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.172411:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x3139939425054a31 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.172424:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x3139939425054a31 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.174167:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3209 00000100:00100000:1.0:1746147133.174176:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307735808:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147133.174196:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.174202:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.174203:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.174207:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.174214:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.177078:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147133.178553:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.178567:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.178575:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.178582:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091e31a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147133.178586:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.178594:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.178614:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.178619:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31a00/0x3139939425054a15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.178687:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2000:x1830967307734528:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23511us (23733us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.178697:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3203 00000100:00100000:1.0:1746147133.178724:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307736064 00000100:00100000:1.0:1746147133.178732:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307736064 00010000:00010000:1.0:1746147133.186050:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.186069:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.186083:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.186133:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822ba00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147133.186137:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.186145:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.186164:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.186171:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822ba00/0x3139939425054a1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.186289:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2000:x1830967307734272:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 29323us (31386us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746147133.186303:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3204 00010000:00010000:1.0:1746147133.188321:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.188336:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.188343:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.188351:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeee00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147133.188354:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.188361:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.188377:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.188383:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425054a23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.188452:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2000:x1830967307734784:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 27704us (29681us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.188462:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3205 00000100:00100000:0.0:1746147133.221369:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147133.221565:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.221579:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.221587:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.221594:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ffc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147133.221598:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.221607:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.221626:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.221633:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425054a3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.221733:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967307735808:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 47557us (52059us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.221744:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3209 00000100:00100000:0.0:1746147133.234292:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.236469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.236496:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.236531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.236557:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307736576 00000100:00100000:0.0:1746147133.236562:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307736576 00010000:00010000:0.0:1746147133.236588:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425054974 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f6e expref: 10 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.236607:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307736704 00000100:00100000:0.0:1746147133.236610:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307736704 00010000:00010000:0.0:1746147133.236618:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x313993942505496d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f67 expref: 8 pid: 7237 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.236628:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307736832 00000100:00100000:0.0:1746147133.236630:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307736832 00010000:00010000:0.0:1746147133.236636:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425054982 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f75 expref: 9 pid: 16099 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.236648:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6061 00000100:00100000:0.0:1746147133.236654:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307736576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.236666:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.236671:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425054974 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f6e expref: 10 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.236679:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425054974 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f6e expref: 10 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.236694:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.236698:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236706:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236711:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.236733:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307736576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.236739:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6061 00000100:00100000:0.0:1746147133.236749:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6062 00000100:00100000:0.0:1746147133.236754:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307736704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.236760:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.236763:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x313993942505496d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f67 expref: 9 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.236770:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x313993942505496d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f67 expref: 9 pid: 7237 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.236780:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.236783:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236788:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236792:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.236805:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307736704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.236810:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6062 00000100:00100000:0.0:1746147133.236818:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6063 00000100:00100000:0.0:1746147133.236822:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2002:x1830967307736832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.236827:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.236831:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425054982 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f75 expref: 8 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.236838:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425054982 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f75 expref: 8 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.236846:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.236850:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236856:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236862:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.236876:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.236889:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2002:x1830967307736832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.236894:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6063 00000100:00100000:0.0:1746147133.240621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.240689:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307737088 00000100:00100000:1.0:1746147133.240699:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307737088 00000100:00100000:1.0:1746147133.240741:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15135 00000100:00100000:1.0:1746147133.240749:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:32000:x1830967307737088:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:1.0:1746147133.240851:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.240866:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147133.240872:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.240887:0:16099:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147133.240896:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147133.242261:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310584576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147133.242309:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147133.242333:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310585088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147133.242353:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147133.242378:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310585728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.242413:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310584320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147133.242666:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147133.242698:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310586112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.242719:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310584576 00000100:00100000:1.0:1746147133.242724:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310584576 00000100:00100000:1.0:1746147133.242756:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310584704 00000100:00100000:1.0:1746147133.242759:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310584704 00000100:00100000:1.0:1746147133.242772:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310584448 00000100:00100000:1.0:1746147133.242774:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310584448 00000100:00100000:1.0:1746147133.242789:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310585216 00000100:00100000:1.0:1746147133.242791:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310585216 00000100:00100000:1.0:1746147133.242934:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13980 00000100:00100000:1.0:1746147133.242942:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3764:x1830967310584704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147133.243029:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147133.243032:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147133.243035:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147133.243037:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147133.243039:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147131 -> 1746147131 00002000:00010000:1.0:1746147133.243040:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147133.243059:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310586112 00000100:00100000:0.0:1746147133.243062:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310586112 00000100:00100000:1.0:1746147133.243072:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3764:x1830967310584704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (740us total) trans 17179874090 rc 0/0 00000100:00100000:0.0:1746147133.243076:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310585600 00000100:00100000:1.0:1746147133.243077:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13980 00000100:00100000:0.0:1746147133.243078:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310585600 00000100:00100000:0.0:1746147133.243087:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13981 00000100:00100000:0.0:1746147133.243108:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3767:x1830967310585088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.243109:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13982 00000100:00100000:1.0:1746147133.243124:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967310584448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147133.243182:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147133.243185:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147133.243187:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147133.243188:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147132 -> 1746147132 00000100:00100000:0.0:1746147133.243189:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3767:x1830967310585088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (834us total) trans 17179874091 rc 0/0 00002000:00010000:1.0:1746147133.243190:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147133.243215:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3766:x1830967310584448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (835us total) trans 21474841361 rc 0/0 00000100:00100000:1.0:1746147133.243220:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13982 00000100:00100000:1.0:1746147133.243232:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13984 00000100:00100000:1.0:1746147133.243237:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3764:x1830967310585216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.243292:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3764:x1830967310585216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (587us total) trans 21474841363 rc 0/0 00000100:00100000:1.0:1746147133.243297:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13984 00000100:00100000:1.0:1746147133.243306:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13986 00000100:00100000:1.0:1746147133.243310:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967310585600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.243361:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967310585600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (303us total) trans 17179874093 rc 0/0 00000100:00100000:1.0:1746147133.243366:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13986 00000100:00100000:1.0:1746147133.243375:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310584832 00000100:00100000:1.0:1746147133.243377:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310584832 00000100:00100000:1.0:1746147133.243385:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310585472 00000100:00100000:1.0:1746147133.243387:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310585472 00000100:00100000:1.0:1746147133.243394:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310585984 00000100:00100000:1.0:1746147133.243396:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310585984 00000100:00100000:1.0:1746147133.243403:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13987 00000100:00100000:1.0:1746147133.243407:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3766:x1830967310584832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147133.243444:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147133.243447:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.243448:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147133.243450:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.243452:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147133.243474:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3766:x1830967310584832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (131us total) trans 21474841364 rc 0/0 00000100:00100000:1.0:1746147133.243479:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13987 00000100:00100000:0.0:1746147133.243491:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13981 00000100:00100000:1.0:1746147133.243894:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13989 00000100:00100000:1.0:1746147133.243901:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3766:x1830967310585984:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147133.243955:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c72300/2, rc 0, transno 17179874089 00002000:00010000:1.0:1746147133.243957:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147133.243960:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00000100:00100000:0.0:1746147133.243960:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310584576:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147133.243962:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147133.243964:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147133.243965:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000004:00080000:0.0:1746147133.243968:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c71f80/2, rc 0, transno 17179874091 00000100:00100000:0.0:1746147133.243971:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310585088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147133.243979:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e9880/2, rc 0, transno 21474841362 00000100:00100000:0.0:1746147133.243982:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310585728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.243986:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3766:x1830967310585984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (593us total) trans 17179874094 rc 0/0 00000004:00080000:0.0:1746147133.243990:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e9880/2, rc 0, transno 17179874092 00000100:00100000:1.0:1746147133.243992:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13989 00000100:00100000:0.0:1746147133.243992:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310586112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.244033:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.244052:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310584960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.244072:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.244083:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310585344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.244128:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.244140:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310585856:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147133.244142:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.244151:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147133.244159:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147133.244184:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14380/2, rc 0, transno 21474841367 00000100:00100000:1.0:1746147133.244188:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310584320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147133.244193:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147133.244197:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310586240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147133.244213:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.244229:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310586240 00000100:00100000:1.0:1746147133.244232:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310586240 00000004:00010000:0.0:1746147133.244234:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098c71500 reply state ffff8800a46b8000 transno 8589935778 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147133.244246:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13993 00010000:00010000:0.0:1746147133.244248:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147133.244251:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3765:x1830967310585344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147133.244297:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:1.0:1746147133.244299:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:1.0:1746147133.244301:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147133.244302:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147133.244304:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:1.0:1746147133.244326:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3765:x1830967310585344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (198us total) trans 17179874096 rc 0/0 00000100:00100000:1.0:1746147133.244333:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13993 00000004:00080000:1.0:1746147133.244359:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70e00/2, rc 0, transno 17179874095 00000100:00100000:1.0:1746147133.244363:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310584960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147133.244370:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011da9e680/2, rc 0, transno 17179874096 00000100:00100000:1.0:1746147133.244372:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310585344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147133.244380:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e9f80/2, rc 0, transno 21474841368 00000100:00100000:1.0:1746147133.244383:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310585856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147133.244411:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151180/2, rc 0, transno 17179874097 00000100:00100000:1.0:1746147133.244414:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310586240:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147133.244452:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db16680/2, rc 0, transno 21474841366 00000100:00100000:1.0:1746147133.244456:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310584192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147133.244467:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f54a80/2, rc 0, transno 21474841363 00000100:00100000:1.0:1746147133.244471:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310585216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147133.244479:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011da9d180/2, rc 0, transno 17179874093 00000100:00100000:1.0:1746147133.244482:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310585600:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147133.244505:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.244508:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147133.244512:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147133.245177:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32000:x1830967307737088:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 4427us (4565us total) trans 8589935778 rc 0/0 00000100:00100000:1.0:1746147133.245184:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15135 00000100:00100000:0.0:1746147133.246880:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.249906:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.249932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.251185:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307737344 00000100:00100000:1.0:1746147133.251195:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307737344 00010000:00010000:1.0:1746147133.251233:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x31399394250549cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f8a expref: 16 pid: 9584 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746147133.251567:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307737472 00000100:00100000:1.0:1746147133.251571:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307737472 00010000:00010000:1.0:1746147133.251586:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250549f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fb4 expref: 20 pid: 12225 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746147133.254377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.254426:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.254546:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307737728 00000100:00100000:1.0:1746147133.254554:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307737728 00000100:00100000:1.0:1746147133.254591:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15136 00000100:00100000:1.0:1746147133.254597:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32000:x1830967307737728:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147133.254618:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.254637:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425054a70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e76fe5 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.254688:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425054a70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fe5 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.254700:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425054a70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fe5 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.254719:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.254722:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147133.254725:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12de00, rc 0) 00000100:00100000:1.0:1746147133.254767:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32000:x1830967307737728:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 169us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.254773:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15136 00000100:00100000:0.0:1746147133.257805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.260632:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.269304:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.269351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.269387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.269733:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307738496 00000100:00100000:1.0:1746147133.269737:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307738496 00002000:00100000:1.0:1746147133.269766:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (1036288->1048575) req@ffff88012ca0dc00 x1830967307738496/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 12776/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.269776:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0dc00 with x1830967307738496 ext(1036288->1048575) 00010000:00010000:1.0:1746147133.269784:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 35 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.269794:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 35 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.269799:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca0dc00 00000100:00100000:1.0:1746147133.269815:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1024 00000100:00100000:1.0:1746147133.269821:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307738496:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147133.271925:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307738496:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 2098us (2627us total) trans 17179874098 rc 0/0 00000100:00100000:1.0:1746147133.271936:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1024 00002000:00100000:1.0:1746147133.271945:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (1036288->1048575) req@ffff88012ca0dc00 x1830967307738496/t17179874098(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 12776/448 e 0 to 0 dl 1746147144 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.271955:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0dc00 with x1830967307738496 ext(1036288->1048575) 00010000:00010000:1.0:1746147133.271962:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 37 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.271974:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 37 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.271980:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca0dc00 00000100:00100000:0.0:1746147133.274520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.279294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.279325:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.280289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.280450:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307739136 00000100:00100000:0.0:1746147133.280461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.280482:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.280497:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307739520 00000100:00100000:0.0:1746147133.280500:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307739520 00010000:00010000:0.0:1746147133.280516:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 37 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.280530:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6069 00000100:00100000:0.0:1746147133.280534:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307739520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.280541:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147133.280551:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147130 -> 1746147133 00002000:00010000:0.0:1746147133.280553:0:7226:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147130 -> 1746147133 00010000:00010000:0.0:1746147133.280557:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 37 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.280565:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 37 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.280585:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x3139939425054a69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fde expref: 37 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.280602:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.280603:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.280608:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425054a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fec expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.280614:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425054a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fec expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.280639:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425054a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fec expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.280648:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310587392:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147133.280697:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.280737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.282029:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307739136 00010000:00010000:1.0:1746147133.282048:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x3139939425054a07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fbb expref: 31 pid: 1853 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746147133.282388:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6070 00000100:00100000:1.0:1746147133.282395:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967307739136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.282404:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.282414:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x3139939425054a07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fbb expref: 31 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.282423:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x3139939425054a07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fbb expref: 31 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.282435:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x3139939425054a07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fbb expref: 31 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.282447:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.282449:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.282454:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.282460:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.282478:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.282488:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 42 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.282502:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310587648:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147133.283368:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.283615:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310587392:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147133.283637:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.283689:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307739520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3152us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.283698:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6069 00000100:00100000:1.0:1746147133.283786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.283815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.283842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.283860:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307739776 00000100:00100000:1.0:1746147133.283865:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307739776 00000100:00100000:1.0:1746147133.283889:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307739904 00000100:00100000:1.0:1746147133.283892:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307739904 00000100:00100000:1.0:1746147133.283904:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307740032 00000100:00100000:1.0:1746147133.283905:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307740032 00000100:00100000:1.0:1746147133.283918:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14000 00000100:00100000:1.0:1746147133.283924:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32000:x1830967307739776:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147133.283939:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.283954:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77016 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.283979:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147133.283985:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1437696->2097151] (req 1437696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.283991:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147133.283995:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77016 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.284021:0:10340:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1437696->2097151] (req 1437696->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.284031:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77016 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.284040:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0af600, rc 0) 00000100:00100000:1.0:1746147133.284062:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32000:x1830967307739776:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 138us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.284067:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14000 00000100:00100000:1.0:1746147133.284078:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14001 00000100:00100000:1.0:1746147133.284083:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307739904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.284108:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.284131:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425054acb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7701d expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.284157:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310587904:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147133.284198:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.284641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.284654:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307740160 00000100:00100000:0.0:1746147133.284657:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307740160 00000100:00100000:0.0:1746147133.284690:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14003 00000100:00100000:0.0:1746147133.284695:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967307740160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.284702:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.284709:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7702b expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.284720:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.284722:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.284728:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.284738:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.284744:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee800, rc 0) 00000100:00100000:0.0:1746147133.284758:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967307740160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 64us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.284763:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14003 00000100:00100000:1.0:1746147133.286804:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310587648:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147133.286824:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.286857:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967307739136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4462us (7565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.286866:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6070 00002000:00010000:0.0:1746147133.287613:0:10340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147129 -> 1746147132 00000100:00100000:0.0:1746147133.287630:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310587904:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147133.287651:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425054acb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7701d expref: 37 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.287662:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425054acb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7701d expref: 37 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.288111:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afe00, rc 0) 00000100:00100000:0.0:1746147133.288152:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307739904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4069us (4336us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147133.288157:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14001 00000100:00100000:0.0:1746147133.290395:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.294277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.294539:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307740544 00000100:00100000:1.0:1746147133.294545:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307740544 00002000:00100000:1.0:1746147133.294581:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1957888->1961983) req@ffff88012ca0fb80 x1830967307740544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.294589:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0fb80 with x1830967307740544 ext(1957888->1961983) 00010000:00010000:1.0:1746147133.294595:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 44 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.294605:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 44 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.294611:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca0fb80 00000100:00100000:1.0:1746147133.294626:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1025 00000100:00100000:1.0:1746147133.294632:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967307740544:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147133.294737:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967307740544:12345-192.168.204.25@tcp:3:cat.0 Request processed in 105us (466us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147133.294743:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1025 00002000:00100000:1.0:1746147133.294748:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1957888->1961983) req@ffff88012ca0fb80 x1830967307740544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746147144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.294759:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0fb80 with x1830967307740544 ext(1957888->1961983) 00010000:00010000:1.0:1746147133.294763:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 44 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.294769:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 44 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.294773:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca0fb80 00000100:00100000:0.0:1746147133.303547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.303657:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.304781:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307740800 00000100:00100000:0.0:1746147133.304787:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307740800 00002000:00100000:0.0:1746147133.304816:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1961983) req@ffff88012ca0ed80 x1830967307740800/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.304826:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0ed80 with x1830967307740800 ext(1048576->1961983) 00010000:00010000:0.0:1746147133.304834:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 44 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.304845:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 44 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746147133.304852:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca0ed80 00000100:00100000:0.0:1746147133.304874:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1026 00000100:00100000:0.0:1746147133.304880:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967307740800:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147133.322417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.322511:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307741184 00000100:00100000:1.0:1746147133.322520:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307741184 00010000:00010000:1.0:1746147133.322552:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 46 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.322590:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6071 00000100:00100000:1.0:1746147133.322598:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967307741184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.322610:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.322627:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 46 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.322637:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 46 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.322654:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425054a7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1961983) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ff3 expref: 46 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.322683:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.322685:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.322691:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.322698:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.322728:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.322737:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 29 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.322748:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310588288:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147133.324546:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.325844:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310588288:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147133.325861:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.325902:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967307741184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3304us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.325912:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6071 00000100:00100000:0.0:1746147133.326360:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.336997:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.337550:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.338037:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307741696 00000100:00100000:1.0:1746147133.338049:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307741696 00002000:00100000:1.0:1746147133.338105:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1437696->2097151) req@ffff88012ca0d880 x1830967307741696/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.338126:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0d880 with x1830967307741696 ext(1437696->2097151) 00010000:00010000:1.0:1746147133.338135:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 32 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.338152:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 32 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.338159:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca0d880 00000100:00100000:1.0:1746147133.338177:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1028 00000100:00100000:1.0:1746147133.338184:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967307741696:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147133.343123:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.343156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.343171:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307741952 00000100:00100000:0.0:1746147133.343180:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307742080 00000100:00100000:1.0:1746147133.343183:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307741952 00000100:00100000:0.0:1746147133.343185:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307742080 00010000:00010000:0.0:1746147133.343215:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4600/0x3139939425054a00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fc2 expref: 34 pid: 12201 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.343227:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x31399394250549d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f98 expref: 15 pid: 12201 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746147133.346590:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307742208 00000100:00100000:0.0:1746147133.346602:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307742208 00010000:00010000:0.0:1746147133.346675:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942505492e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f2f expref: 45 pid: 17600 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746147133.346704:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6074 00000100:00100000:0.0:1746147133.346709:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967307742208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.346717:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.346743:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942505492e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f2f expref: 45 pid: 17600 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.346751:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942505492e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f2f expref: 45 pid: 17600 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.346764:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942505492e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f2f expref: 45 pid: 17600 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.346777:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.346810:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967307742208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.346818:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6074 00000100:00100000:1.0:1746147133.353644:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967307741696:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 15459us (16657us total) trans 21474841370 rc 0/0 00000100:00100000:1.0:1746147133.353653:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1028 00002000:00100000:1.0:1746147133.353662:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1437696->2097151) req@ffff88012ca0d880 x1830967307741696/t21474841370(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/448 e 0 to 0 dl 1746147144 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.353670:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca0d880 with x1830967307741696 ext(1437696->2097151) 00010000:00010000:1.0:1746147133.353679:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 32 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.353689:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0a00/0x3139939425054abd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7700f expref: 32 pid: 1136 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.353694:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca0d880 00000100:00100000:0.0:1746147133.356292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.356417:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307742464 00000100:00100000:1.0:1746147133.356426:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307742464 00002000:00100000:1.0:1746147133.356464:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1318912->1323007) req@ffff880091d97800 x1830967307742464/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.356472:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97800 with x1830967307742464 ext(1318912->1323007) 00002000:00010000:1.0:1746147133.356478:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97800 00000100:00100000:1.0:1746147133.357323:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3211 00000100:00100000:1.0:1746147133.357333:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967307742464:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147133.357518:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967307742464:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 186us (1231us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147133.357523:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3211 00002000:00100000:1.0:1746147133.357529:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1318912->1323007) req@ffff880091d97800 x1830967307742464/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.357536:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97800 with x1830967307742464 ext(1318912->1323007) 00000100:00100000:0.0:1746147133.357536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:1.0:1746147133.357539:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97800 00000100:00100000:0.0:1746147133.360158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.362748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.365181:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.365222:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.365357:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307743104 00000100:00100000:1.0:1746147133.365364:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307743104 00002000:00100000:1.0:1746147133.365392:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1323007) req@ffff880093146300 x1830967307743104/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.365400:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146300 with x1830967307743104 ext(1048576->1323007) 00010000:00010000:1.0:1746147133.365406:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x3139939425054ae7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77039 expref: 31 pid: 10340 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.365415:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x3139939425054ae7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77039 expref: 31 pid: 10340 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.365425:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093146300 00000100:00100000:1.0:1746147133.365452:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1029 00000100:00100000:1.0:1746147133.365459:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967307743104:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147133.369591:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.372921:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.372953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.373184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.373559:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14008 00000100:00100000:1.0:1746147133.373567:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967307743744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.373575:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.373585:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425054b2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7705c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.373610:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310589312:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147133.374447:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.375147:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.378363:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.380121:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.381698:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.381733:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.383502:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.383515:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307744640 00000100:00100000:1.0:1746147133.383518:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307744640 00010000:00010000:1.0:1746147133.383531:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f36 expref: 37 pid: 9584 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746147133.383552:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6079 00000100:00100000:1.0:1746147133.383558:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307744640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.383564:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.383573:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f36 expref: 37 pid: 9584 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.383580:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f36 expref: 37 pid: 9584 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.383593:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x3139939425054935 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f36 expref: 37 pid: 9584 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.383614:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.383616:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.383622:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425054b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7706a expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.383629:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425054b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7706a expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.383651:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425054b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7706a expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.383660:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310590080:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147133.383699:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.386190:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310590080:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147133.386206:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.386247:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307744640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2688us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.386255:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6079 00000100:00100000:0.0:1746147133.388599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.392345:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307745152 00000100:00100000:1.0:1746147133.392350:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307745152 00010000:00010000:1.0:1746147133.392383:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425054951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f52 expref: 36 pid: 1854 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.392396:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307745024 00000100:00100000:0.0:1746147133.392400:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307745024 00010000:00010000:0.0:1746147133.392413:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x31399394250549dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fa6 expref: 17 pid: 1853 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746147133.392417:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307744896 00000100:00100000:1.0:1746147133.392420:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307744896 00010000:00010000:1.0:1746147133.392428:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x3139939425054966 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f60 expref: 19 pid: 12225 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.392429:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6080 00000100:00100000:0.0:1746147133.392435:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307745152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147133.392442:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6081 00010000:00010000:0.0:1746147133.392444:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147133.392447:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307745024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.392454:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.392460:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425054951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f52 expref: 36 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.392462:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x31399394250549dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fa6 expref: 17 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.392468:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425054951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f52 expref: 36 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.392553:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x31399394250549dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fa6 expref: 17 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746147133.392576:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x31399394250549dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fa6 expref: 17 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.392584:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425054951 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f52 expref: 36 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.392591:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147133.392598:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.392611:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307745024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 163us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.392616:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307745152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 181us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.392617:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6081 00000100:00100000:0.0:1746147133.392622:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6080 00000100:00100000:0.0:1746147133.395984:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307745280 00000100:00100000:0.0:1746147133.395990:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307745280 00000100:00100000:0.0:1746147133.396029:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14013 00000100:00100000:0.0:1746147133.396034:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32000:x1830967307745280:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147133.396047:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.396061:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7707f expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.396119:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.396127:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.396134:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.396139:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.396142:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.396144:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 16 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.396206:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.396218:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 16 pid: 1398 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746147133.396229:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310590720:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.396294:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.396303:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 43 pid: 1853 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746147133.396310:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310590848:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.396334:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.396341:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 31 pid: 9586 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.396348:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310590976:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147133.396362:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.402399:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.402434:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.402462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.402507:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307745408 00000100:00100000:0.0:1746147133.402516:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307745408 00010000:00010000:0.0:1746147133.402549:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 17 pid: 1398 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746147133.402579:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307745664 00000100:00100000:0.0:1746147133.402581:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307745664 00010000:00010000:0.0:1746147133.402590:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 32 pid: 9586 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.402602:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6083 00000100:00100000:0.0:1746147133.402608:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967307745536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.402619:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.402633:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 44 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.402641:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 44 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.402661:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425054ad9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7702b expref: 44 pid: 1853 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.402681:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.402711:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307745536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.402718:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6083 00000100:00100000:0.0:1746147133.402730:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6084 00000100:00100000:0.0:1746147133.402734:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307745408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.402739:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.402745:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 16 pid: 1398 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.402752:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 16 pid: 1398 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.402762:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250549f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fad expref: 16 pid: 1398 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746147133.402768:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.402778:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307745408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.402783:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6084 00000100:00100000:0.0:1746147133.402811:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6085 00000100:00100000:0.0:1746147133.402815:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967307745664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.402820:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.402824:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 32 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.402830:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 32 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.402844:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942505494a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76f4b expref: 32 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.402851:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.402852:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.402857:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.402864:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.402885:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.402894:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310591104:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147133.403046:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.408055:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.408946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.408969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.409000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.409590:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.410056:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.410071:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307745920 00000100:00100000:1.0:1746147133.410080:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307745920 00000100:00100000:1.0:1746147133.410143:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307746432 00000100:00100000:1.0:1746147133.410146:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307746432 00000100:00100000:1.0:1746147133.410179:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14014 00000100:00100000:0.0:1746147133.410439:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307746304 00000100:00100000:0.0:1746147133.410443:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307746304 00000100:00100000:0.0:1746147133.410845:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14019 00000100:00100000:0.0:1746147133.410851:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307746304:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147133.410892:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147133.410894:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147133.410896:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147131 -> 1746147132 00002000:00010000:0.0:1746147133.410897:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147132 -> 1746147133 00002000:00010000:0.0:1746147133.410899:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147133.410913:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2000:x1830967307746304:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 63us (858us total) trans 17179874101 rc 0/0 00000100:00100000:0.0:1746147133.410917:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14019 00000100:00100000:1.0:1746147133.410991:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967307745920:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147133.411029:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147133.411031:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147133 -> 1746147132 00002000:00010000:1.0:1746147133.411032:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147133.411034:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147133 -> 1746147133 00002000:00010000:1.0:1746147133.411035:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147133.411049:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967307745920:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 865us (3003us total) trans 21474841374 rc 0/0 00000100:00100000:1.0:1746147133.411053:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14014 00000100:00100000:0.0:1746147133.417704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.417760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.417858:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307746816 00000100:00100000:1.0:1746147133.417867:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307746816 00000100:00100000:1.0:1746147133.419133:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5379 00000100:00100000:1.0:1746147133.419144:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32000:x1830967307746816:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147133.419313:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32000:x1830967307746816:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 171us (1552us total) trans 8589935783 rc 0/0 00000100:00100000:1.0:1746147133.419319:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5379 00000100:00100000:0.0:1746147133.421928:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.425058:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.425586:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307747328 00000100:00100000:0.0:1746147133.425593:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307747328 00000100:00100000:0.0:1746147133.425635:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15142 00000100:00100000:0.0:1746147133.425642:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32020:x1830967307747328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147133.425660:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.425675:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425054b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77086 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.425734:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425744:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425752:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425763:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425769:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425774:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425854:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4600/0x3139939425054b6c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425863:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4600/0x3139939425054b6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425869:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4600/0x3139939425054b6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147133.425877:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147133.425939:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425945:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425949:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425954:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147133.425956:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425961:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425968:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147133.425971:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147133.425974:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.425978:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425054b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426003:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426008:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426011:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426015:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbefa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147133.426016:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426020:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426025:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800932c2500) 00010000:00010000:0.0:1746147133.426027:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147133.426029:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426032:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x3139939425054b65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.426061:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425054b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77086 expref: 33 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.426074:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4600/0x3139939425054b6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77086 expref: 32 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.426079:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.426080:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147133.426082:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4600, rc 0) 00000100:00100000:0.0:1746147133.426145:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32020:x1830967307747328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 503us (1088us total) trans 8589935785 rc 0/0 00000100:00100000:0.0:1746147133.426149:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15142 00000100:00100000:0.0:1746147133.426436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.426473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.428851:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.445410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.447383:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.448877:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307748224 00000100:00100000:1.0:1746147133.448887:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307748224 00000100:00100000:1.0:1746147133.448943:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14021 00000100:00100000:1.0:1746147133.448949:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+31:32017:x1830967307748224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.448960:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.448972:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77094 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.448989:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147133.448994:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.449003:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.449012:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afe00, rc 0) 00000100:00100000:1.0:1746147133.449044:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+32:32017:x1830967307748224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.449049:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14021 00000100:00100000:1.0:1746147133.453315:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.453425:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307748352 00000100:00100000:0.0:1746147133.453430:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307748352 00010000:00010000:0.0:1746147133.453452:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77016 expref: 18 pid: 10340 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.453480:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6087 00000100:00100000:0.0:1746147133.453486:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307748352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.453497:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.453512:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77016 expref: 18 pid: 10340 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.453526:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77016 expref: 18 pid: 10340 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.453545:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425054ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77016 expref: 18 pid: 10340 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.453569:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.453571:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.453577:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x3139939425054b7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7708d expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.453583:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x3139939425054b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7708d expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.453589:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.453590:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.453593:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.453599:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.453621:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.453630:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310591616:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147133.453698:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x3139939425054b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7708d expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.453706:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094573100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310591744:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147133.453723:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.458474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.459414:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.459467:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307748864 00000100:00100000:0.0:1746147133.459471:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307748864 00002000:00100000:0.0:1746147133.459493:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098820700 x1830967307748864/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.459500:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820700 with x1830967307748864 ext(1048576->2097151) 00002000:00010000:0.0:1746147133.459503:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820700 00000100:00100000:0.0:1746147133.459529:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3215 00000100:00100000:0.0:1746147133.459535:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967307748864:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147133.476022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.478806:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.482701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.489538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.489582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.490058:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3217 00000100:00100000:1.0:1746147133.490064:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307749760:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147133.493850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.499242:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307749760:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9171us (9651us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.499253:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3217 00002000:00100000:1.0:1746147133.499262:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094573b80 x1830967307749760/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.499270:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094573b80 with x1830967307749760 ext(1048576->2097151) 00002000:00010000:1.0:1746147133.499276:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094573b80 00000100:00100000:0.0:1746147133.500736:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.502348:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.504523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.506691:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.506905:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.506969:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307750528 00000100:00100000:1.0:1746147133.506975:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307750528 00002000:00100000:1.0:1746147133.507017:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2314240->2318335) req@ffff880132098700 x1830967307750528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.507027:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132098700 with x1830967307750528 ext(2314240->2318335) 00002000:00010000:1.0:1746147133.507032:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132098700 00000100:00100000:1.0:1746147133.507058:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3218 00000100:00100000:1.0:1746147133.507064:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307750528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147133.507214:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307750528:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 149us (528us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147133.507220:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3218 00002000:00100000:1.0:1746147133.507225:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2314240->2318335) req@ffff880132098700 x1830967307750528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.507231:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132098700 with x1830967307750528 ext(2314240->2318335) 00002000:00010000:1.0:1746147133.507235:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132098700 00000100:00100000:0.0:1746147133.512189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.513511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.513554:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307751168 00000100:00100000:1.0:1746147133.513560:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307751168 00002000:00100000:1.0:1746147133.513588:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880132098e00 x1830967307751168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.513596:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132098e00 with x1830967307751168 ext(1048576->2097151) 00002000:00010000:1.0:1746147133.513599:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132098e00 00000100:00100000:1.0:1746147133.513628:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3220 00000100:00100000:1.0:1746147133.513635:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307751168:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147133.519694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.531019:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.537640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.537672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.537709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.537868:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307751936 00000100:00100000:1.0:1746147133.537872:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307751936 00000100:00100000:1.0:1746147133.538240:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14028 00000100:00100000:1.0:1746147133.538247:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307751936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.538255:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.538264:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425054bb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770c5 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.538381:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310592896:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147133.538610:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00002000:00010000:0.0:1746147133.541322:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147132 -> 1746147133 00002000:00010000:0.0:1746147133.541329:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147132 -> 1746147133 00000100:00100000:0.0:1746147133.541344:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310592768:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147133.541369:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425054bab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770be expref: 20 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.541381:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425054bab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770be expref: 20 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.541407:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f007c00, rc 0) 00000100:00100000:0.0:1746147133.541442:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307751808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3535us (3808us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147133.541598:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310592896:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147133.541614:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425054bb2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770c5 expref: 34 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.541622:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425054bb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770c5 expref: 34 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.541633:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0200, rc 0) 00000100:00100000:1.0:1746147133.541654:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307751936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3407us (3981us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147133.541661:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14028 00000100:00100000:0.0:1746147133.541713:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14027 00000100:00100000:1.0:1746147133.547667:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307752320 00000100:00100000:1.0:1746147133.547675:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307752320 00000100:00100000:1.0:1746147133.547722:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307752448 00000100:00100000:1.0:1746147133.547724:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307752448 00000100:00100000:1.0:1746147133.547739:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14029 00000100:00100000:1.0:1746147133.547745:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:32017:x1830967307752320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.547759:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.547772:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x3139939425054bb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770cc expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.547802:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x3139939425054b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2916351) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a9 expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.547809:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147133.547811:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147133.547814:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x3139939425054bb9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770cc expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.547860:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14030 00000100:00100000:0.0:1746147133.547871:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32013:x1830967307752448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.547879:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.547892:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770d3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.547906:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.547915:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147133.547916:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147133.547919:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.547942:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.547953:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x3139939425054b50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7707f expref: 15 pid: 10340 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.547963:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132099f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310593024:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.548161:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x3139939425054b96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2916351) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a9 expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.548169:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x3139939425054b96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2916351) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a9 expref: 36 pid: 1853 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.548181:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310593152:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.548263:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.548391:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.552473:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310593152:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.552495:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x3139939425054bb9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770cc expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.552505:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:1.0:1746147133.552830:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:32017:x1830967307752320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5084us (5287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.552836:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14029 00000100:00100000:0.0:1746147133.553188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.553229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.558126:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307752960 00000100:00100000:0.0:1746147133.558133:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307752960 00002000:00100000:0.0:1746147133.558170:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880094187100 x1830967307752960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.558184:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187100 with x1830967307752960 ext(2097152->3145727) 00002000:00010000:0.0:1746147133.558188:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094187100 00000100:00100000:0.0:1746147133.558206:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3223 00000100:00100000:0.0:1746147133.558213:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967307752960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147133.569186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.570560:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967307752960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12345us (12520us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.570569:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3223 00002000:00100000:1.0:1746147133.570578:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880094187100 x1830967307752960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.570587:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187100 with x1830967307752960 ext(2097152->3145727) 00002000:00010000:1.0:1746147133.570594:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094187100 00000100:00100000:0.0:1746147133.576745:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.576781:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.576949:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307753344 00000100:00100000:1.0:1746147133.576955:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307753344 00002000:00100000:1.0:1746147133.576989:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88013209ad80 x1830967307753344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.576998:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209ad80 with x1830967307753344 ext(2097152->3145727) 00002000:00010000:1.0:1746147133.577002:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209ad80 00000100:00100000:1.0:1746147133.577017:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3224 00000100:00100000:1.0:1746147133.577024:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307753344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147133.589188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.589216:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.589889:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3226 00000100:00100000:0.0:1746147133.589898:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967307753984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147133.601399:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.601710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.601777:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307754368 00000100:00100000:0.0:1746147133.601780:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307754368 00000100:00100000:0.0:1746147133.601799:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14032 00000100:00100000:0.0:1746147133.601804:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:32017:x1830967307754368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.601811:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.601820:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770e8 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.601834:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.601836:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.601841:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.601852:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.601861:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a800, rc 0) 00000100:00100000:0.0:1746147133.601898:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+34:32017:x1830967307754368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.601903:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14032 00000100:00100000:0.0:1746147133.602005:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967307753984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12109us (12787us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147133.602010:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3226 00002000:00100000:0.0:1746147133.602016:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880098820e00 x1830967307753984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.602022:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820e00 with x1830967307753984 ext(3145728->4194303) 00002000:00010000:0.0:1746147133.602026:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820e00 00010000:00010000:0.0:1746147133.605777:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147133.606492:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.608431:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.613615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.613682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.613707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.613734:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307755008 00000100:00100000:0.0:1746147133.613743:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307755008 00000100:00100000:0.0:1746147133.613786:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14033 00000100:00100000:0.0:1746147133.613793:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32024:x1830967307755008:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147133.613812:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.613830:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770ef expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.613857:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425054ae0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77032 expref: 40 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.613865:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f007800/0x3139939425054b42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77071 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.613871:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.613873:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147133.613875:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [966656->1048575] (req 966656->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770ef expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.613902:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f007800/0x3139939425054b42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77071 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.613914:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f007800/0x3139939425054b42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77071 expref: 21 pid: 1854 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.613926:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132099f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310593536:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.614303:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425054ae0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77032 expref: 40 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.614311:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425054ae0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77032 expref: 40 pid: 10340 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.614318:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310593664:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.614454:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.618924:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132099f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310593536:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147133.618939:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310593664:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.618979:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [966656->1048575] (req 966656->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770ef expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.618998:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ae00, rc 0) 00000100:00100000:1.0:1746147133.619060:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:32024:x1830967307755008:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5266us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.619074:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14033 00000100:00100000:0.0:1746147133.619810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.620021:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.620080:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6093 00000100:00100000:0.0:1746147133.620119:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967307755520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.620134:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.620155:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f007800/0x3139939425054b42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77071 expref: 23 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.620174:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f007800/0x3139939425054b42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77071 expref: 23 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.620199:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f007800/0x3139939425054b42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77071 expref: 23 pid: 1854 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.620241:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.620268:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307755520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 181us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.620273:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6093 00000100:00100000:0.0:1746147133.625041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.626572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.626620:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307756032 00000100:00100000:1.0:1746147133.626626:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307756032 00000100:00100000:1.0:1746147133.626670:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14034 00000100:00100000:1.0:1746147133.626677:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307756032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.626689:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.626707:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x3139939425054bff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770f6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.626758:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310593920:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147133.626833:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00002000:00010000:1.0:1746147133.630818:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147132 -> 1746147133 00002000:00010000:1.0:1746147133.630826:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147132 -> 1746147133 00000100:00100000:1.0:1746147133.630848:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310593920:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147133.630881:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x3139939425054bff lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770f6 expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.630895:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x3139939425054bff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770f6 expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.630923:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563600, rc 0) 00000100:00100000:1.0:1746147133.631312:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307756032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4634us (4745us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147133.631320:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14034 00000100:00100000:0.0:1746147133.631650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.631695:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307756160 00000100:00100000:1.0:1746147133.631702:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307756160 00000100:00100000:1.0:1746147133.631740:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14035 00000100:00100000:1.0:1746147133.631748:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:32024:x1830967307756160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147133.631762:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.631778:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x3139939425054c06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e770fd expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.631804:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x3139939425054b7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7708d expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.631812:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.631819:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.631821:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.631824:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x3139939425054c06 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770fd expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.631849:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.631861:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425054b81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77094 expref: 35 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.631874:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594048:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.631947:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x3139939425054b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7708d expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.631960:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x3139939425054b7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7708d expref: 45 pid: 1853 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.631967:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594176:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147133.631983:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.633712:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594048:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147133.633725:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594176:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.633751:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x3139939425054c06 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770fd expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.633767:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ac00, rc 0) 00000100:00100000:1.0:1746147133.633811:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:32024:x1830967307756160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2062us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.633818:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14035 00000100:00100000:0.0:1746147133.634671:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.634714:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307756288 00000100:00100000:1.0:1746147133.634721:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307756288 00000100:00100000:1.0:1746147133.634751:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14036 00000100:00100000:1.0:1746147133.634757:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307756288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147133.634772:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.634787:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x3139939425054c0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77104 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.634830:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310594304:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147133.634903:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.635615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.637137:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.637249:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310594304:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147133.637279:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x3139939425054c0d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77104 expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.637292:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x3139939425054c0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77104 expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147133.637320:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a200, rc 0) 00000100:00100000:1.0:1746147133.637353:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307756288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2595us (2684us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147133.637359:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14036 00000100:00100000:0.0:1746147133.642221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.642263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.642298:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.642666:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3231 00000100:00100000:0.0:1746147133.642673:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967307756800:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147133.642816:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967307756800:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 143us (551us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147133.642821:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3231 00002000:00100000:0.0:1746147133.642826:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1167360->1171455) req@ffff880094529c00 x1830967307756800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.642833:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529c00 with x1830967307756800 ext(1167360->1171455) 00002000:00010000:0.0:1746147133.642835:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094529c00 00000100:00100000:0.0:1746147133.647448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.772338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.780321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.780409:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.780478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.780501:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307758464 00000100:00100000:0.0:1746147133.780507:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307758464 00010000:00010000:0.0:1746147133.780536:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x3139939425054b1f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7704e expref: 14 pid: 6215 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.780559:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307758592 00000100:00100000:0.0:1746147133.780561:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307758592 00010000:00010000:0.0:1746147133.780569:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425054ab6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77008 expref: 36 pid: 16099 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.780581:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6097 00000100:00100000:0.0:1746147133.780586:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307758464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.780598:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.780602:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x3139939425054b1f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7704e expref: 14 pid: 6215 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.780612:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x3139939425054b1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7704e expref: 14 pid: 6215 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.780631:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.780635:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.780642:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.780646:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.780680:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307758464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.780687:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6097 00000100:00100000:0.0:1746147133.780699:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6098 00000100:00100000:0.0:1746147133.780703:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307758592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147133.780708:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147133.780711:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425054ab6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77008 expref: 37 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.780719:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425054ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77008 expref: 37 pid: 16099 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746147133.780727:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147133.780730:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.780736:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.780741:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147133.780754:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.781649:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307758592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 943us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.781656:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6098 00000100:00100000:0.0:1746147133.784621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.784695:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307758720 00000100:00100000:1.0:1746147133.784705:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307758720 00000100:00100000:1.0:1746147133.784749:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14037 00000100:00100000:1.0:1746147133.784757:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32029:x1830967307758720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147133.784780:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147133.784797:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425054c3e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77119 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.784827:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.784836:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.784847:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.784848:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.784851:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425054c3e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2437120->2490367] (req 2437120->2490367) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77119 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.784883:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.784901:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 33 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.784913:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.785006:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.785013:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.785021:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594944:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147133.785040:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.785538:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307758848 00000100:00100000:0.0:1746147133.785542:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307758848 00000100:00100000:0.0:1746147133.785588:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15146 00000100:00100000:0.0:1746147133.785594:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32032:x1830967307758848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.785609:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.785622:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425054c45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77120 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.785704:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.785718:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 37 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.785723:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147133.785742:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 37 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.785750:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 37 pid: 6215 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746147133.785758:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310595072:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147133.785807:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147133.787143:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147133.787153:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310594944:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147133.787178:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425054c3e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2437120->2490367] (req 2437120->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77119 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.787202:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d600, rc 0) 00000100:00100000:1.0:1746147133.787246:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32029:x1830967307758720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2488us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.787255:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14037 00000100:00100000:1.0:1746147133.790586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.790814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.790851:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307758976 00000100:00100000:1.0:1746147133.790860:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307758976 00010000:00010000:1.0:1746147133.790893:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 34 pid: 1136 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.790918:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307759104 00000100:00100000:1.0:1746147133.790921:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307759104 00010000:00010000:1.0:1746147133.790934:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 38 pid: 6215 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.791858:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6099 00000100:00100000:1.0:1746147133.791869:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967307758976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.791882:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.791902:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 34 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.791912:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 34 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.791934:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x3139939425054be3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770e8 expref: 34 pid: 1136 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.791954:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.791991:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2000:x1830967307758976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.791997:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6099 00000100:00100000:1.0:1746147133.792011:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6100 00000100:00100000:1.0:1746147133.792015:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967307759104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.792022:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.792026:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 38 pid: 6215 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.792033:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 38 pid: 6215 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.792045:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6e00/0x3139939425054c1b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7710b expref: 38 pid: 6215 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.792056:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147133.792060:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.792070:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.792075:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147133.792115:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147133.792130:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307759104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 114us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147133.792135:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6100 00000100:00100000:0.0:1746147133.793839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.793848:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307759232 00000100:00100000:1.0:1746147133.793856:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307759232 00010000:00010000:1.0:1746147133.793879:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746147133.793908:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6101 00000100:00100000:1.0:1746147133.793914:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967307759232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147133.793923:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147133.793938:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.793948:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.793963:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x3139939425054bc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770d3 expref: 46 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.793973:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.793975:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147133.793981:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425054c3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77119 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.793988:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425054c3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77119 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147133.794018:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425054c3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77119 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147133.794029:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310595200:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147133.794114:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147133.796779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.796816:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.796845:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.797939:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307759360 00000100:00100000:1.0:1746147133.797949:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307759360 00000100:00100000:0.0:1746147133.797982:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.798047:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310595200:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147133.798066:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.798134:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967307759232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4218us (4296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.798144:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6101 00000100:00100000:1.0:1746147133.798876:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307759488 00000100:00100000:1.0:1746147133.798881:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307759488 00000100:00100000:0.0:1746147133.798980:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307759872 00000100:00100000:0.0:1746147133.798984:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307759872 00002000:00100000:0.0:1746147133.799017:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2437120->2441215) req@ffff880094528700 x1830967307759872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.799027:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528700 with x1830967307759872 ext(2437120->2441215) 00002000:00010000:0.0:1746147133.799032:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094528700 00000100:00100000:0.0:1746147133.799048:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3233 00000100:00100000:0.0:1746147133.799053:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967307759872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147133.799200:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967307759872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 146us (1219us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147133.799206:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3233 00002000:00100000:0.0:1746147133.799211:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2437120->2441215) req@ffff880094528700 x1830967307759872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147133.799217:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528700 with x1830967307759872 ext(2437120->2441215) 00002000:00010000:0.0:1746147133.799220:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094528700 00000100:00100000:0.0:1746147133.799334:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14040 00000100:00100000:0.0:1746147133.799340:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967307759616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147133.799347:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147133.799355:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94e00/0x3139939425054c61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77135 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147133.799378:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310595584:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147133.799401:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00002000:00010000:0.0:1746147133.803637:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746147132 -> 1746147133 00002000:00010000:0.0:1746147133.803641:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147132 -> 1746147133 00000100:00100000:0.0:1746147133.803660:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310595456:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147133.803695:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6000/0x3139939425054c5a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7712e expref: 49 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.803708:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6000/0x3139939425054c5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7712e expref: 49 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147133.804685:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6000, rc 0) 00000100:00100000:0.0:1746147133.804709:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967307759488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5473us (7891us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147133.804715:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14039 00000100:00100000:0.0:1746147133.810191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.810258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.814611:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310595712:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147133.814645:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425054c68 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7713c expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147133.814664:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6200, rc 0) 00000100:00100000:0.0:1746147133.814713:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32032:x1830967307760256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3105us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.814721:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14041 00000100:00100000:0.0:1746147133.816472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.816544:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307760640 00000100:00100000:1.0:1746147133.816554:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307760640 00002000:00100000:1.0:1746147133.816630:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (966656->1048575) req@ffff880094524000 x1830967307760640/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.816641:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524000 with x1830967307760640 ext(966656->1048575) 00010000:00010000:1.0:1746147133.816651:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770ef expref: 20 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.816665:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770ef expref: 20 pid: 9586 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.816672:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094524000 00000100:00100000:1.0:1746147133.816705:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1031 00000100:00100000:1.0:1746147133.816712:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307760640:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147133.822683:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307760640:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5960us (6210us total) trans 17179874103 rc 0/0 00000100:00100000:1.0:1746147133.822700:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1031 00002000:00100000:1.0:1746147133.822712:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (966656->1048575) req@ffff880094524000 x1830967307760640/t17179874103(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/448 e 0 to 0 dl 1746147144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.822722:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524000 with x1830967307760640 ext(966656->1048575) 00010000:00010000:1.0:1746147133.822734:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770ef expref: 22 pid: 9586 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.822749:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425054bf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770ef expref: 22 pid: 9586 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.822756:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094524000 00000100:00100000:0.0:1746147133.824748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.835380:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.837084:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307761024 00000100:00100000:1.0:1746147133.837117:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307761024 00002000:00100000:1.0:1746147133.837161:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880094524700 x1830967307761024/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.837171:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524700 with x1830967307761024 ext(0->1048575) 00002000:00010000:1.0:1746147133.837175:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524700 00000100:00100000:1.0:1746147133.837205:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3235 00000100:00100000:1.0:1746147133.837212:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307761024:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147133.850340:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307761024:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13116us (14959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.850354:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3235 00002000:00100000:1.0:1746147133.850365:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880094524700 x1830967307761024/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.850382:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524700 with x1830967307761024 ext(0->1048575) 00002000:00010000:1.0:1746147133.850388:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524700 00000100:00100000:0.0:1746147133.861373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.865838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.876581:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.881506:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147133.881531:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310596224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147133.881590:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147133.882338:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310596224:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1746147133.882908:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147133.883064:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310596096:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147133.883080:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147133.883147:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:2002:x1830967307761408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5881us (6576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147133.883155:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6103 00000100:00100000:0.0:1746147133.884735:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.886198:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.899635:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.902746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.902769:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.902791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.907572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.915238:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.915284:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.915311:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.915967:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307763584 00000100:00100000:1.0:1746147133.915971:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307763584 00002000:00100000:1.0:1746147133.916002:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880094526d80 x1830967307763584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.916012:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526d80 with x1830967307763584 ext(0->1048575) 00002000:00010000:1.0:1746147133.916017:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526d80 00000100:00100000:1.0:1746147133.916037:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3238 00000100:00100000:1.0:1746147133.916042:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967307763584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147133.921287:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.921353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.927483:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967307763584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11438us (12196us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147133.927492:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3238 00002000:00100000:1.0:1746147133.927499:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880094526d80 x1830967307763584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.927508:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526d80 with x1830967307763584 ext(0->1048575) 00002000:00010000:1.0:1746147133.927513:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526d80 00000100:00100000:0.0:1746147133.930597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147133.936427:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.936788:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307764608 00000100:00100000:1.0:1746147133.936799:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307764608 00002000:00100000:1.0:1746147133.936848:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2445312->2650111) req@ffff88009452aa00 x1830967307764608/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.936857:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452aa00 with x1830967307764608 ext(2445312->2650111) 00010000:00010000:1.0:1746147133.936868:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 36 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.936881:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 36 pid: 1853 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.936888:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452aa00 00000100:00100000:1.0:1746147133.936922:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1035 00000100:00100000:1.0:1746147133.936929:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+36:2001:x1830967307764608:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147133.937376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.943025:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+39:2001:x1830967307764608:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6081us (6594us total) trans 21474841377 rc 0/0 00000100:00100000:1.0:1746147133.943040:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1035 00002000:00100000:1.0:1746147133.943052:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2445312->2650111) req@ffff88009452aa00 x1830967307764608/t21474841377(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/448 e 0 to 0 dl 1746147144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.943063:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452aa00 with x1830967307764608 ext(2445312->2650111) 00010000:00010000:1.0:1746147133.943073:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 39 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746147133.943111:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 39 pid: 1853 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746147133.943119:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452aa00 00000100:00100000:0.0:1746147133.944847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147133.945077:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+39:2002:x1830967307764864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147133.945178:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147133.945200:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 39 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:3.0:1746147133.945212:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 39 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:3.0:1746147133.945237:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d000/0x3139939425054cae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->2650111) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77158 expref: 39 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:3.0:1746147133.945256:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147133.945258:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147133.945265:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147133.945273:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147133.945281:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147133.945283:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147133.945286:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147133.945292:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147133.945323:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147133.945340:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310596864:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147133.945444:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147133.945453:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310596992:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147133.946441:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147133.947558:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310596864:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147133.950746:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310596992:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147133.950776:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147133.950833:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+38:2002:x1830967307764864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5755us (5992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147133.950844:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6105 00000100:00100000:0.0:1746147133.954225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.955498:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307765120 00000100:00100000:1.0:1746147133.955510:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307765120 00002000:00100000:1.0:1746147133.955561:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880134ab0000 x1830967307765120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.955577:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0000 with x1830967307765120 ext(2097152->4194303) 00002000:00010000:1.0:1746147133.955584:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab0000 00000100:00100000:0.0:1746147133.956782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147133.956911:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307765376 00000100:00100000:1.0:1746147133.956916:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307765376 00002000:00100000:1.0:1746147133.956945:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880134ab0380 x1830967307765376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/0 e 0 to 0 dl 1746147144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.956954:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0380 with x1830967307765376 ext(2097152->4194303) 00002000:00010000:1.0:1746147133.956958:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab0380 00000100:00100000:1.0:1746147133.956972:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3241 00000100:00100000:1.0:1746147133.956977:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967307765376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147133.978474:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967307765376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21483us (21685us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147133.978487:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3241 00002000:00100000:1.0:1746147133.978499:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880134ab0380 x1830967307765376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147133.978508:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0380 with x1830967307765376 ext(2097152->4194303) 00002000:00010000:1.0:1746147133.978515:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab0380 00000100:00100000:3.0:1746147133.986246:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+38:2000:x1830967307765120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29302us (32017us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147133.986258:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3240 00002000:00100000:3.0:1746147133.986270:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880134ab0000 x1830967307765120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:509/0 lens 488/440 e 0 to 0 dl 1746147144 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147133.986280:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0000 with x1830967307765120 ext(2097152->4194303) 00002000:00010000:3.0:1746147133.986286:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab0000 00000100:00100000:0.0:1746147134.036188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147134.037557:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147134.039556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.040938:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307765760 00000100:00100000:3.0:1746147134.040949:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307765760 00000100:00100000:3.0:1746147134.041015:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 781 00000100:00100000:3.0:1746147134.041023:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967307765760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.041040:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.041068:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425054ced lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77182 expref: 39 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.041127:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.041131:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.041294:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307765760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 271us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.041302:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 781 00000100:00100000:0.0:1746147134.133178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.133656:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307765888 00000100:00100000:3.0:1746147134.133673:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307765888 00000100:00100000:3.0:1746147134.133752:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14049 00000100:00100000:3.0:1746147134.133762:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32045:x1830967307765888:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.133783:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.133803:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77189 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.133833:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x3139939425054bb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770cc expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.133841:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x3139939425054bc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770da expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.133847:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.133848:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.133851:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2764800->3145727] (req 2764800->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.133885:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x3139939425054bc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770da expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.133897:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x3139939425054bc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770da expref: 40 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.133908:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310597120:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.134000:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x3139939425054bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770cc expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.134007:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x3139939425054bb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770cc expref: 21 pid: 1136 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.134014:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310597248:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.134029:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1540 going to sleep for 11 seconds 00000100:00080000:0.0:1746147134.134237:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147134.137169:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310597120:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.137472:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310597248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.137505:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2764800->3145727] (req 2764800->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.137523:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b600, rc 0) 00000100:00100000:3.0:1746147134.137575:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32045:x1830967307765888:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3814us (4408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.137587:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14049 00000100:00100000:0.0:1746147134.138566:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147134.139425:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147134.141052:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.141913:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.142410:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307766272 00000100:00100000:3.0:1746147134.142415:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307766272 00000100:00100000:3.0:1746147134.142691:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15150 00000100:00100000:3.0:1746147134.142697:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32046:x1830967307766272:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147134.142717:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.142733:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77190 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746147134.142776:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147134.143055:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143068:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143078:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143266:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143273:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143279:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143353:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143362:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143369:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.143659:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147134.143664:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147134.143683:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143693:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143701:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143706:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143712:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143716:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.143720:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143725:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143734:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.143737:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.143740:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.143745:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x3139939425054d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144486:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144492:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144497:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144501:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400be00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.144504:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144508:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144515:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23200) 00010000:00010000:3.0:1746147134.144517:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.144520:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144525:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425054d10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.144556:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.144566:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.144573:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.144576:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147134.144579:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ae00, rc 0) 00000100:00100000:3.0:1746147134.144608:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32046:x1830967307766272:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1910us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.144613:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15150 00000100:00100000:0.0:1746147134.145087:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.148715:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.148902:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307766656 00000100:00100000:3.0:1746147134.148912:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307766656 00000100:00100000:0.0:1746147134.149155:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147134.149237:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147134.149811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.149846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.149864:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307766784 00000100:00100000:0.0:1746147134.149867:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307766784 00000100:00100000:1.0:1746147134.150159:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14051 00000100:00100000:1.0:1746147134.150166:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307766912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147134.150175:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.150193:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771a5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.150217:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147134.150219:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147134.150229:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.150247:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.150257:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99000, rc 0) 00000100:00100000:3.0:1746147134.150309:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14052 00000100:00100000:1.0:1746147134.150313:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307766912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 143us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.150319:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14051 00000100:00100000:3.0:1746147134.150323:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307767040:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147134.150330:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.150341:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771ac expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147134.150352:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147134.150355:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.150356:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.150362:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147134.150364:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307767168 00000100:00100000:1.0:1746147134.150367:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307767168 00010000:00010000:3.0:1746147134.150371:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.150379:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b800, rc 0) 00000100:00100000:1.0:1746147134.150386:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14053 00000100:00100000:1.0:1746147134.150390:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2003:x1830967307767168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147134.150396:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.150402:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99200/0x3139939425054d2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771b3 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.150409:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2003:x1830967307767040:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 93us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.150414:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14052 00000100:00100000:1.0:1746147134.150441:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310597504:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147134.150485:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.150488:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.150500:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307767296 00000100:00100000:3.0:1746147134.150503:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307767296 00000100:00100000:3.0:1746147134.150520:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14054 00000100:00100000:3.0:1746147134.150525:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307767296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147134.150532:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.150539:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771ba expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.150550:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.150551:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.150556:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ba expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.150565:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ba expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.150572:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400be00, rc 0) 00000100:00100000:3.0:1746147134.150593:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307767296:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 67us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.150598:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14054 00000100:00100000:0.0:1746147134.150662:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14055 00000100:00100000:0.0:1746147134.150667:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307766784:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147134.150673:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.150685:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7719e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.150694:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.150696:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.150700:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7719e expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.150708:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7719e expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.150715:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008400, rc 0) 00000100:00100000:0.0:1746147134.150731:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307766784:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 65us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147134.150735:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14055 00000100:00080000:0.0:1746147134.150755:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147134.151428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147134.151551:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147134.160786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.160986:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307767680 00000100:00100000:3.0:1746147134.160996:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307767680 00000100:00100000:3.0:1746147134.161074:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15151 00000100:00100000:3.0:1746147134.161083:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:32048:x1830967307767680:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.161136:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.161157:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x3139939425054d4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771c8 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147134.161174:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147134.161272:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.161287:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 37 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.161294:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425054c8b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7714a expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.161300:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.161307:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.161340:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.161350:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 11 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.161361:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310598016:192.168.204.25@tcp:104: 00002000:00010000:1.0:1746147134.161439:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147133 -> 1746147134 00002000:00010000:1.0:1746147134.161444:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147133 -> 1746147134 00010000:00010000:3.0:1746147134.161450:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425054c8b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7714a expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.161457:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425054c8b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7714a expref: 19 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.161459:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310597504:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147134.161464:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310598144:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147134.161484:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99200/0x3139939425054d2c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771b3 expref: 19 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.161485:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 37 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.161492:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 37 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.161497:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99200/0x3139939425054d2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771b3 expref: 19 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147134.161498:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310598272:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147134.161520:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99200, rc 0) 00000100:00100000:3.0:1746147134.161590:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147134.161591:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307767168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 11199us (11236us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147134.161598:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14053 00000100:00100000:0.0:1746147134.162205:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.162254:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307767936 00000100:00100000:3.0:1746147134.162258:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307767936 00010000:00010000:3.0:1746147134.162410:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.162434:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6108 00000100:00100000:3.0:1746147134.162440:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+38:2002:x1830967307767936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.162453:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.162467:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.162477:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.162494:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f391600/0x3139939425054cd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7717b expref: 38 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.162512:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746147134.163504:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147134.163507:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+37:2002:x1830967307767936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1065us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.163517:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6108 00000100:00100000:0.0:1746147134.164635:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.164860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.164884:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307768704 00000100:00100000:1.0:1746147134.164890:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307768704 00000100:00100000:1.0:1746147134.164938:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15152 00000100:00100000:1.0:1746147134.164945:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32046:x1830967307768704:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147134.164963:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.164982:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425054d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771cf expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.165055:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165067:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147134.165072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147134.165077:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147134.165083:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147134.165117:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165124:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165130:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165235:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425054d72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165245:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425054d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165251:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425054d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147134.165259:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147134.165331:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165337:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165342:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165347:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165353:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147134.165357:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165363:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165377:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147134.165380:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147134.165384:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165388:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425054d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165402:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165406:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165410:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165414:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147134.165415:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165419:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165425:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4100) 00010000:00010000:1.0:1746147134.165427:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147134.165429:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165433:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425054d6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.165467:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425054d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771cf expref: 15 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.165479:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425054d72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771cf expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.165484:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147134.165487:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147134.165489:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2be00, rc 0) 00000100:00100000:0.0:1746147134.165524:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.165526:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32046:x1830967307768704:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 581us (666us total) trans 8589935798 rc 0/0 00000100:00100000:1.0:1746147134.165531:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15152 00000100:00100000:0.0:1746147134.166135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.166391:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307767808 00000100:00100000:3.0:1746147134.166397:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307767808 00000100:00100000:3.0:1746147134.166408:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307768064 00000100:00100000:3.0:1746147134.166410:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307768064 00010000:00010000:3.0:1746147134.166429:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 14 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.166557:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307768320 00000100:00100000:1.0:1746147134.166562:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307768320 00010000:00010000:1.0:1746147134.166580:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 49 pid: 1853 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.166606:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6110 00000100:00100000:1.0:1746147134.166612:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967307768320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.166620:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.166639:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 49 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.166647:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 49 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.166765:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f390600/0x3139939425054cca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77174 expref: 49 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.166782:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.166800:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967307768320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 188us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.166806:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6110 00000100:00100000:3.0:1746147134.167115:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307768448 00000100:00100000:3.0:1746147134.167118:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307768448 00010000:00010000:3.0:1746147134.167130:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 38 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.167143:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6111 00000100:00100000:3.0:1746147134.167148:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307768064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.167154:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.167158:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 14 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.167165:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 14 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.167178:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ae00/0x3139939425054d17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77190 expref: 14 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.167188:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.167191:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.167205:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.167209:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.167227:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307768064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.167232:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6111 00000100:00100000:3.0:1746147134.167242:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6112 00000100:00100000:3.0:1746147134.167246:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307768448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.167251:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.167255:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 38 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.167261:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 38 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.167271:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425054c4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77120 expref: 38 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.167278:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.167281:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.167287:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.167294:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.167311:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.167325:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307768448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.167331:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6112 00010000:00010000:3.0:1746147134.167355:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ba expref: 18 pid: 12225 timeout: 772 lvb_type: 1 00000100:00100000:3.0:1746147134.167373:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6113 00000100:00100000:3.0:1746147134.167378:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967307767808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.167384:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.167393:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ba expref: 18 pid: 12225 timeout: 772 lvb_type: 1 00010000:00010000:3.0:1746147134.167402:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ba expref: 18 pid: 12225 timeout: 772 lvb_type: 1 00010000:00010000:3.0:1746147134.167414:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400be00/0x3139939425054d33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ba expref: 18 pid: 12225 timeout: 772 lvb_type: 1 00010000:00010000:3.0:1746147134.167424:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.167425:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.167431:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 47 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.167438:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 47 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.167467:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 47 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.167478:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094536680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310598400:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147134.167542:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.171916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.172009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.172266:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307768832 00000100:00100000:1.0:1746147134.172275:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307768832 00000100:00100000:3.0:1746147134.172547:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094536680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310598400:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147134.172568:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.172570:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307768960 00000100:00100000:1.0:1746147134.172574:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307768960 00000100:00100000:1.0:1746147134.172816:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14058 00000100:00100000:1.0:1746147134.172821:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2002:x1830967307768960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147134.172829:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.172839:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425054d8e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771dd expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147134.172864:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310598656:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147134.173123:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967307767808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5743us (8490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.173132:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6113 00000100:00100000:1.0:1746147134.173286:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efa80 going to sleep for 11 seconds 00002000:00010000:1.0:1746147134.175969:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147133 -> 1746147134 00002000:00010000:1.0:1746147134.175973:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147133 -> 1746147134 00000100:00100000:1.0:1746147134.175986:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310598656:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147134.176007:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425054d8e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771dd expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.176017:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425054d8e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771dd expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.176033:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ac00, rc 0) 00000100:00100000:1.0:1746147134.176063:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307768960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3241us (4053us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147134.176071:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14058 00000100:00100000:0.0:1746147134.182928:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.183015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.183057:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307769472 00000100:00100000:3.0:1746147134.183062:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307769472 00000100:00100000:3.0:1746147134.183122:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15153 00000100:00100000:3.0:1746147134.183131:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32046:x1830967307769472:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147134.183151:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.183172:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054d95 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771e4 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.183552:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.183570:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c8 expref: 18 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.183578:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 4/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.183613:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c8 expref: 18 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.183625:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c8 expref: 18 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.183636:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094536680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310598784:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.183713:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.186147:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147134.186589:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425054d56 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c8 expref: 18 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.186619:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094536680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310598784:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.186636:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186643:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186648:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186664:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186670:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186675:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186684:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.186688:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186694:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186702:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.186704:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147134.186708:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186712:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054d9c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.186744:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054d95 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771e4 expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.186752:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054d95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771e4 expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.186759:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00000100:00100000:3.0:1746147134.186782:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32046:x1830967307769472:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3653us (3766us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147134.186789:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15153 00000100:00100000:1.0:1746147134.187827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.196433:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.203806:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.203907:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307770240 00000100:00100000:1.0:1746147134.203920:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307770240 00000100:00100000:1.0:1746147134.203980:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14059 00000100:00100000:1.0:1746147134.203988:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:32048:x1830967307770240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147134.204005:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.204022:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771eb expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.204051:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.204059:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147134.204060:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147134.204063:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3280896->3739647] (req 3280896->3739647) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 22 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.204129:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.204141:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 38 pid: 1853 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.204156:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310598912:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147134.204322:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147134.212221:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310598912:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147134.212252:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147134.212257:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3280896->3739647] (req 3280896->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 22 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.212277:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:1.0:1746147134.212427:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:32048:x1830967307770240:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8438us (8631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.212436:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14059 00000100:00100000:3.0:1746147134.215845:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307770752 00000100:00100000:3.0:1746147134.215852:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307770752 00000100:00100000:3.0:1746147134.215884:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307770880 00000100:00100000:3.0:1746147134.215886:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307770880 00000100:00100000:3.0:1746147134.215913:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15154 00000100:00100000:3.0:1746147134.215919:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32056:x1830967307770752:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.215936:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.215951:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425054daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771f2 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.216008:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216018:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216026:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216036:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216040:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216045:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216146:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216153:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216158:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.216166:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.216222:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216228:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216233:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216237:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e04800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.216239:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216244:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216253:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.216255:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.216259:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216263:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x3139939425054db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216275:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216279:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216284:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216287:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.216289:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216294:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216299:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23400) 00010000:00010000:3.0:1746147134.216301:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.216303:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216306:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x3139939425054db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.216336:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425054daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 41 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.216345:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 40 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.216350:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.216352:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147134.216354:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05e00, rc 0) 00000100:00100000:3.0:1746147134.216389:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32056:x1830967307770752:12345-192.168.204.25@tcp:101:cat.0 Request processed in 470us (1338us total) trans 8589935802 rc 0/0 00000100:00100000:3.0:1746147134.216394:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15154 00000100:00100000:3.0:1746147134.216407:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15155 00000100:00100000:3.0:1746147134.216412:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:32055:x1830967307770880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.216419:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.216424:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x3139939425054dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e771f9 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.216798:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217890:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217898:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217910:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217916:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217921:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217986:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.217994:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218000:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.218006:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.218048:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218054:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218063:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218067:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.218070:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218075:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218081:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.218084:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.218086:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218117:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x3139939425054dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218126:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218131:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218136:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218140:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.218142:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218146:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218156:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23c00) 00010000:00010000:3.0:1746147134.218158:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.218159:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218164:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425054ddb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.218190:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x3139939425054dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f9 expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.218200:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f9 expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.218206:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.218208:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147134.218210:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05600, rc 0) 00000100:00100000:3.0:1746147134.218240:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:32055:x1830967307770880:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1827us (2841us total) trans 8589935803 rc 0/0 00000100:00100000:3.0:1746147134.218246:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15155 00000100:00100000:0.0:1746147134.219083:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.222538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.222657:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307771392 00000100:00100000:3.0:1746147134.222664:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307771392 00000100:00100000:3.0:1746147134.222712:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5390 00000100:00100000:3.0:1746147134.222719:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+20:32055:x1830967307771392:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147134.223635:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+21:32055:x1830967307771392:12345-192.168.204.25@tcp:35:cat.0 Request processed in 913us (1100us total) trans 8589935805 rc 0/0 00000100:00100000:3.0:1746147134.223643:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5390 00000100:00100000:0.0:1746147134.224269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.224369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.224385:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307771648 00000100:00100000:0.0:1746147134.224389:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307771648 00010000:00010000:0.0:1746147134.224411:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 41 pid: 1853 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746147134.224450:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6115 00000100:00100000:0.0:1746147134.224455:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098066300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967307771648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147134.224467:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147134.224484:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 41 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.224495:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 41 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.224515:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425054cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77189 expref: 41 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.224538:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.224540:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.224546:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.224553:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.224578:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147134.224589:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098066680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310599040:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147134.224640:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.228273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.228719:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.229521:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307771904 00000100:00100000:1.0:1746147134.229525:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307771904 00000100:00100000:1.0:1746147134.229544:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14062 00000100:00100000:1.0:1746147134.229549:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2000:x1830967307771904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147134.229555:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.229564:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a400/0x3139939425054dfe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7720e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147134.229586:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310599424:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147134.230065:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.230317:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.230341:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307772160 00000100:00100000:3.0:1746147134.230344:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307772160 00002000:00100000:3.0:1746147134.230368:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3280896->3284991) req@ffff880094535c00 x1830967307772160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.230376:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535c00 with x1830967307772160 ext(3280896->3284991) 00002000:00010000:3.0:1746147134.230380:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535c00 00000100:00100000:3.0:1746147134.230393:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3244 00000100:00100000:3.0:1746147134.230398:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307772160:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147134.230496:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307772160:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 97us (179us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147134.230502:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3244 00002000:00100000:3.0:1746147134.230507:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3280896->3284991) req@ffff880094535c00 x1830967307772160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.230514:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535c00 with x1830967307772160 ext(3280896->3284991) 00002000:00010000:3.0:1746147134.230517:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535c00 00000100:00100000:1.0:1746147134.232620:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310599424:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147134.232635:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a400/0x3139939425054dfe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7720e expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.232646:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a400/0x3139939425054dfe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7720e expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.232662:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a400, rc 0) 00000100:00100000:1.0:1746147134.232680:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2000:x1830967307771904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3131us (3962us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147134.232685:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14062 00000100:00100000:0.0:1746147134.240009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.240143:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307772416 00000100:00100000:3.0:1746147134.240152:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307772416 00002000:00100000:3.0:1746147134.240189:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3735552->3739647) req@ffff880098067100 x1830967307772416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.240198:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098067100 with x1830967307772416 ext(3735552->3739647) 00002000:00010000:3.0:1746147134.240203:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098067100 00000100:00100000:3.0:1746147134.240223:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3245 00000100:00100000:3.0:1746147134.240230:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307772416:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147134.240510:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307772416:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 279us (508us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147134.240517:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3245 00002000:00100000:3.0:1746147134.240522:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3735552->3739647) req@ffff880098067100 x1830967307772416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.240590:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098067100 with x1830967307772416 ext(3735552->3739647) 00002000:00010000:3.0:1746147134.240593:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098067100 00000100:00100000:0.0:1746147134.240924:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.248272:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.248539:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307772800 00000100:00100000:3.0:1746147134.248551:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307772800 00002000:00100000:3.0:1746147134.248588:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880098067800 x1830967307772800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.248597:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098067800 with x1830967307772800 ext(2097152->3145727) 00010000:00010000:3.0:1746147134.248606:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 22 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.248620:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 22 pid: 9584 timeout: 772 lvb_type: 0 00002000:00010000:3.0:1746147134.248626:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098067800 00000100:00100000:3.0:1746147134.248644:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1037 00000100:00100000:3.0:1746147134.248650:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307772800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147134.250628:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307773056 00000100:00100000:3.0:1746147134.250634:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307773056 00000100:00100000:3.0:1746147134.250849:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5391 00000100:00100000:3.0:1746147134.250857:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+21:32048:x1830967307773056:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147134.251726:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:32048:x1830967307773056:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 869us (1467us total) trans 8589935806 rc 0/0 00000100:00100000:3.0:1746147134.251732:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5391 00000100:00100000:0.0:1746147134.258153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.270348:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307772800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21688us (22075us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147134.270360:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1037 00002000:00100000:3.0:1746147134.270370:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880098067800 x1830967307772800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.270378:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098067800 with x1830967307772800 ext(2097152->3145727) 00010000:00010000:3.0:1746147134.270387:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.270400:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00002000:00010000:3.0:1746147134.270406:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098067800 00000100:00100000:0.0:1746147134.279423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.279998:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.280046:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307773440 00000100:00100000:3.0:1746147134.280050:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307773440 00010000:00010000:3.0:1746147134.280072:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.280124:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6116 00000100:00100000:3.0:1746147134.280130:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307773440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.280140:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.280159:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.280172:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.280191:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425054da3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3739647) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771eb expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.280218:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.280221:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.280226:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.280234:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.280264:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.280276:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310599680:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147134.280352:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.282407:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.282433:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310599680:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147134.282454:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147134.282458:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307773568 00000100:00100000:0.0:1746147134.282465:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307773568 00002000:00100000:0.0:1746147134.282510:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2478079) req@ffff880096890000 x1830967307773568/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.282518:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096890000 with x1830967307773568 ext(2097152->2478079) 00010000:00010000:0.0:1746147134.282527:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 48 pid: 1136 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.282538:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967307773440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2381us (2512us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147134.282540:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 48 pid: 1136 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.282549:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6116 00002000:00010000:0.0:1746147134.282550:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096890000 00000100:00100000:0.0:1746147134.282571:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1039 00000100:00100000:0.0:1746147134.282579:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2002:x1830967307773568:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147134.284357:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307773824 00000100:00100000:3.0:1746147134.284364:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307773824 00002000:00100000:3.0:1746147134.284400:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880094186a00 x1830967307773824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.284410:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186a00 with x1830967307773824 ext(2097152->3145727) 00002000:00010000:3.0:1746147134.284415:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186a00 00000100:00100000:3.0:1746147134.284432:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3246 00000100:00100000:3.0:1746147134.284440:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307773824:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.289067:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2002:x1830967307773568:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6474us (6655us total) trans 21474841378 rc 0/0 00000100:00100000:0.0:1746147134.289080:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1039 00002000:00100000:0.0:1746147134.289115:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2478079) req@ffff880096890000 x1830967307773568/t21474841378(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/448 e 0 to 0 dl 1746147145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.289125:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096890000 with x1830967307773568 ext(2097152->2478079) 00010000:00010000:0.0:1746147134.289136:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 50 pid: 1136 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.289152:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425054d48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771c1 expref: 50 pid: 1136 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746147134.289159:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096890000 00000100:00100000:0.0:1746147134.290972:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.292450:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307773824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8008us (8798us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147134.292460:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3246 00002000:00100000:3.0:1746147134.292469:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880094186a00 x1830967307773824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.292478:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186a00 with x1830967307773824 ext(2097152->3145727) 00002000:00010000:3.0:1746147134.292482:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186a00 00000100:00100000:0.0:1746147134.297558:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307774080 00000100:00100000:0.0:1746147134.297565:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307774080 00000100:00100000:0.0:1746147134.297616:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14065 00000100:00100000:0.0:1746147134.297623:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32056:x1830967307774080:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.297642:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.297660:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400a600/0x3139939425054e13 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77223 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.297689:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.297690:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.297698:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400a600/0x3139939425054e13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77223 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.297711:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400a600/0x3139939425054e13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77223 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.297721:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400a600, rc 0) 00000100:00100000:0.0:1746147134.297766:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32056:x1830967307774080:12345-192.168.204.25@tcp:101:cat.0 Request processed in 143us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147134.297771:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14065 00000100:00100000:0.0:1746147134.300514:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.300614:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307774336 00000100:00100000:3.0:1746147134.300625:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307774336 00002000:00100000:3.0:1746147134.300671:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880096890700 x1830967307774336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.300681:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096890700 with x1830967307774336 ext(2097152->3145727) 00002000:00010000:3.0:1746147134.300687:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096890700 00000100:00100000:3.0:1746147134.300707:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3247 00000100:00100000:3.0:1746147134.300715:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+38:2000:x1830967307774336:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.308012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.308066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.308192:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307774720 00000100:00100000:1.0:1746147134.308202:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307774720 00002000:00100000:1.0:1746147134.308250:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880096890a80 x1830967307774720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.308261:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096890a80 with x1830967307774720 ext(2097152->4194303) 00002000:00010000:1.0:1746147134.308267:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096890a80 00000100:00100000:1.0:1746147134.308284:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307774848 00000100:00100000:1.0:1746147134.308287:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307774848 00002000:00100000:1.0:1746147134.308299:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880096890e00 x1830967307774848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.308306:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096890e00 with x1830967307774848 ext(3145728->4194303) 00002000:00010000:1.0:1746147134.308309:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096890e00 00000100:00100000:1.0:1746147134.308320:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3248 00000100:00100000:1.0:1746147134.308327:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307774720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.324507:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.325143:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307774976 00000100:00100000:3.0:1746147134.325163:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307774976 00000100:00100000:3.0:1746147134.325222:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14066 00000100:00100000:3.0:1746147134.325231:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+23:32055:x1830967307774976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.325250:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.325270:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7722a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.325297:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.325299:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.325307:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.325323:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.325335:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0a00, rc 0) 00000100:00100000:3.0:1746147134.325391:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:32055:x1830967307774976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 161us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.325398:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14066 00000100:00100000:1.0:1746147134.328426:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307774720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20091us (20418us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147134.328440:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3248 00002000:00100000:1.0:1746147134.328450:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880096890a80 x1830967307774720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.328459:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096890a80 with x1830967307774720 ext(2097152->4194303) 00002000:00010000:1.0:1746147134.328463:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096890a80 00000100:00100000:0.0:1746147134.331911:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.333036:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307775232 00000100:00100000:1.0:1746147134.333045:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307775232 00002000:00100000:1.0:1746147134.333138:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880096891500 x1830967307775232/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.333148:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096891500 with x1830967307775232 ext(4194304->4919295) 00002000:00010000:1.0:1746147134.333153:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096891500 00000100:00100000:1.0:1746147134.333272:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3250 00000100:00100000:1.0:1746147134.333280:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967307775232:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.338405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.338590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.338675:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307775488 00000100:00100000:3.0:1746147134.338687:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307775488 00002000:00100000:3.0:1746147134.338736:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880096891880 x1830967307775488/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.338746:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096891880 with x1830967307775488 ext(3145728->4194303) 00002000:00010000:3.0:1746147134.338752:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096891880 00000100:00100000:3.0:1746147134.338778:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3251 00000100:00100000:3.0:1746147134.338785:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307775488:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147134.339832:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967307775232:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6549us (7926us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147134.339840:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3250 00002000:00100000:1.0:1746147134.340783:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880096891500 x1830967307775232/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.340793:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096891500 with x1830967307775232 ext(4194304->4919295) 00002000:00010000:1.0:1746147134.340797:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096891500 00000100:00100000:3.0:1746147134.349276:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307775488:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10479us (10867us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147134.349289:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3251 00002000:00100000:3.0:1746147134.349302:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880096891880 x1830967307775488/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.349310:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096891880 with x1830967307775488 ext(3145728->4194303) 00002000:00010000:3.0:1746147134.349316:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096891880 00000100:00100000:0.0:1746147134.357486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.358254:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307776000 00000100:00100000:3.0:1746147134.358266:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307776000 00002000:00100000:3.0:1746147134.358314:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880096891f80 x1830967307776000/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.358323:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096891f80 with x1830967307776000 ext(4194304->4919295) 00002000:00010000:3.0:1746147134.358328:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096891f80 00000100:00100000:3.0:1746147134.358355:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3253 00000100:00100000:3.0:1746147134.358362:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307776000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147134.365147:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307776000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6773us (7658us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147134.365159:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3253 00002000:00100000:3.0:1746147134.365171:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880096891f80 x1830967307776000/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.365180:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096891f80 with x1830967307776000 ext(4194304->4919295) 00002000:00010000:3.0:1746147134.365186:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096891f80 00000100:00100000:0.0:1746147134.420880:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.421920:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307776256 00000100:00100000:3.0:1746147134.421930:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307776256 00000100:00100000:3.0:1746147134.421988:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15156 00000100:00100000:3.0:1746147134.421996:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32061:x1830967307776256:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.422023:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.422045:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77231 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.422177:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.422192:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.422200:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f9 expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.422207:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.422237:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f9 expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.422248:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x3139939425054de2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f9 expref: 21 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.422260:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310600064:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.422372:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.422378:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 42 pid: 16099 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.422389:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310600192:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.422409:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.425608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.425727:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310600064:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.425739:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310600192:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.425764:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147134.425872:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.426423:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6119 00000100:00100000:3.0:1746147134.426430:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967307776512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.426438:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.426443:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 43 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.426453:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 43 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.426471:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05e00/0x3139939425054dbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771f2 expref: 43 pid: 16099 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.426485:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.426488:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.426496:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.426506:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.426521:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.426538:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967307776512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.426543:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6119 00010000:00010000:3.0:1746147134.426564:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.426570:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.426591:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.426730:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 43 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.426743:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.426749:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.426751:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147134.426753:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d800, rc 0) 00000100:00100000:3.0:1746147134.426788:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32061:x1830967307776256:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4793us (5920us total) trans 8589935807 rc 0/0 00000100:00100000:3.0:1746147134.426794:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15156 00000100:00100000:0.0:1746147134.445573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.445846:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307776640 00000100:00100000:3.0:1746147134.445866:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307776640 00000100:00100000:3.0:1746147134.445914:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14067 00000100:00100000:3.0:1746147134.445922:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32061:x1830967307776640:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.445937:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.445964:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77238 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.445991:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.445999:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.446004:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.446006:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.446009:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2269184->2633727] (req 2269184->2633727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.446034:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.446045:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 23 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.446056:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310600320:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.446188:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.446196:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.446203:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310600448:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.446221:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.448385:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310600320:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.448398:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310600448:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.448427:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2269184->2633727] (req 2269184->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.448442:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:3.0:1746147134.448486:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32061:x1830967307776640:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2564us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.448494:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14067 00000100:00100000:0.0:1746147134.450644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.450772:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307776768 00000100:00100000:1.0:1746147134.450782:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307776768 00010000:00010000:1.0:1746147134.450818:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.450851:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6120 00000100:00100000:1.0:1746147134.450859:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967307776768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.450873:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.450894:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.450905:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.450930:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425054e05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77215 expref: 42 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.450960:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.450996:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307776768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.451006:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6120 00000100:00100000:0.0:1746147134.451292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.451351:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307776896 00000100:00100000:1.0:1746147134.451355:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307776896 00010000:00010000:1.0:1746147134.451368:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.451383:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6121 00000100:00100000:1.0:1746147134.451388:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307776896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.451394:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.451402:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.451412:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.451429:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425054e1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7722a expref: 24 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.451439:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147134.451441:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147134.451447:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.451455:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.451485:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147134.451496:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310600576:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147134.451572:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147134.453507:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310600576:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147134.453526:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.453564:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+23:2001:x1830967307776896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2174us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.453574:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6121 00000100:00100000:0.0:1746147134.454810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.455334:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307777152 00000100:00100000:3.0:1746147134.455344:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307777152 00002000:00100000:3.0:1746147134.455394:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2269184->2273279) req@ffff880096893800 x1830967307777152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.455404:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096893800 with x1830967307777152 ext(2269184->2273279) 00002000:00010000:3.0:1746147134.455409:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096893800 00000100:00100000:3.0:1746147134.455616:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3254 00000100:00100000:3.0:1746147134.455625:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307777152:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147134.456248:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307777152:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 622us (1443us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147134.456255:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3254 00002000:00100000:3.0:1746147134.456262:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2269184->2273279) req@ffff880096893800 x1830967307777152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.456270:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096893800 with x1830967307777152 ext(2269184->2273279) 00002000:00010000:3.0:1746147134.456273:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096893800 00000100:00100000:0.0:1746147134.462964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.463129:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307777408 00000100:00100000:3.0:1746147134.463139:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307777408 00002000:00100000:3.0:1746147134.463185:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2629632->2633727) req@ffff880096893b80 x1830967307777408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.463195:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096893b80 with x1830967307777408 ext(2629632->2633727) 00002000:00010000:3.0:1746147134.463201:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096893b80 00000100:00100000:3.0:1746147134.463523:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3255 00000100:00100000:3.0:1746147134.463533:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307777408:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147134.463693:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307777408:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 161us (739us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147134.463699:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3255 00002000:00100000:3.0:1746147134.463705:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2629632->2633727) req@ffff880096893b80 x1830967307777408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.463712:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096893b80 with x1830967307777408 ext(2629632->2633727) 00002000:00010000:3.0:1746147134.463715:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096893b80 00000100:00100000:0.0:1746147134.476961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.477027:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307777664 00000100:00100000:3.0:1746147134.477036:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307777664 00000100:00100000:3.0:1746147134.477151:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15157 00000100:00100000:3.0:1746147134.477161:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32065:x1830967307777664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.477188:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.477208:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7723f expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.478308:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478327:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478338:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478368:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478374:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478380:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478466:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478475:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478481:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.478488:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.478547:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478554:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478560:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478565:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.478568:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478574:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478583:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.478585:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.478588:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.478593:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425054e44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479852:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479860:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479866:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479870:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0ca00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.479873:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479878:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479889:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23e00) 00010000:00010000:3.0:1746147134.479891:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.479894:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479898:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425054e4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.479943:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 45 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.479958:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 44 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.479964:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.479966:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147134.479968:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0dc00, rc 0) 00000100:00100000:3.0:1746147134.480505:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32065:x1830967307777664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3343us (3553us total) trans 8589935808 rc 0/0 00000100:00100000:3.0:1746147134.480513:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15157 00000100:00100000:0.0:1746147134.482456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.482852:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307777920 00000100:00100000:3.0:1746147134.482861:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307777920 00000100:00100000:3.0:1746147134.483171:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5392 00000100:00100000:3.0:1746147134.483181:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32065:x1830967307777920:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147134.483517:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32065:x1830967307777920:12345-192.168.204.25@tcp:35:cat.0 Request processed in 336us (1066us total) trans 8589935809 rc 0/0 00000100:00100000:3.0:1746147134.483524:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5392 00000100:00100000:0.0:1746147134.491793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.491998:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307778176 00000100:00100000:3.0:1746147134.492006:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307778176 00000100:00100000:3.0:1746147134.492042:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15158 00000100:00100000:3.0:1746147134.492047:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:32070:x1830967307778176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.492067:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.492082:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425054e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77246 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.492176:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492187:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492195:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492205:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492209:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492213:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492288:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492297:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492303:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.492311:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.492365:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492375:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492380:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492385:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db80e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.492387:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492392:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492402:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.492404:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.492407:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.492411:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493702:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493711:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493716:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493724:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.493727:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493732:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493740:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23400) 00010000:00010000:3.0:1746147134.493742:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.493744:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493749:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.493790:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425054e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 24 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.493801:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 23 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.493806:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.493808:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147134.493809:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81000, rc 0) 00000100:00100000:3.0:1746147134.494732:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:32070:x1830967307778176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2679us (2941us total) trans 8589935810 rc 0/0 00000100:00100000:3.0:1746147134.494740:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15158 00000100:00100000:1.0:1746147134.498664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.499542:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307778432 00000100:00100000:3.0:1746147134.499549:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307778432 00000100:00100000:3.0:1746147134.499631:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5393 00000100:00100000:3.0:1746147134.499638:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+23:32070:x1830967307778432:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147134.500076:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:32070:x1830967307778432:12345-192.168.204.25@tcp:35:cat.0 Request processed in 437us (1420us total) trans 8589935811 rc 0/0 00000100:00100000:3.0:1746147134.500082:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5393 00000100:00100000:1.0:1746147134.501268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.501888:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307778688 00000100:00100000:3.0:1746147134.501893:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307778688 00002000:00100000:3.0:1746147134.501928:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880132098380 x1830967307778688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 504/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.501937:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132098380 with x1830967307778688 ext(2097152->4194303) 00002000:00010000:3.0:1746147134.501942:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132098380 00000100:00100000:3.0:1746147134.501958:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3256 00000100:00100000:3.0:1746147134.501964:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307778688:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.504484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.506229:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307779072 00000100:00100000:3.0:1746147134.506242:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307779072 00000100:00100000:3.0:1746147134.506290:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15159 00000100:00100000:3.0:1746147134.506298:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:32067:x1830967307779072:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.506318:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.506334:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425054e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77254 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147134.506360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147134.506400:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506412:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506425:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506436:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506441:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506446:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506523:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e9f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506531:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.506536:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.506544:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.507083:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507122:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507127:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507132:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.507134:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507139:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507148:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.507150:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.507152:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507156:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425054e8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507165:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507168:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507172:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507176:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db80e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.507177:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507181:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507185:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23300) 00010000:00010000:3.0:1746147134.507186:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.507187:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507191:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425054e91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.507221:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425054e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77254 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.507230:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e9f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77254 expref: 26 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.507236:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.507237:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147134.507239:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ce00, rc 0) 00000100:00100000:3.0:1746147134.507264:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:32067:x1830967307779072:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 967us (2792us total) trans 8589935812 rc 0/0 00000100:00100000:3.0:1746147134.507270:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15159 00000100:00100000:0.0:1746147134.513608:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.513640:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307779200 00000100:00100000:0.0:1746147134.513648:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307779200 00000100:00100000:1.0:1746147134.513704:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 782 00000100:00100000:1.0:1746147134.513713:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967307779200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.513727:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.513748:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x3139939425054e9f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77254 expref: 26 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.513765:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147134.513769:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.513807:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967307779200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.513813:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 782 00000100:00100000:3.0:1746147134.513869:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307778688:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11904us (12603us total) trans 0 rc 1732608/1732608 00000100:00100000:3.0:1746147134.513881:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3256 00002000:00100000:3.0:1746147134.513889:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880132098380 x1830967307778688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 504/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1732608/1732608 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.513897:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132098380 with x1830967307778688 ext(2097152->4194303) 00002000:00010000:3.0:1746147134.513901:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132098380 00000100:00100000:0.0:1746147134.514924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.517665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.517872:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307779584 00000100:00100000:3.0:1746147134.517881:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307779584 00002000:00100000:3.0:1746147134.517922:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094527b80 x1830967307779584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.517931:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094527b80 with x1830967307779584 ext(4194304->4919295) 00002000:00010000:3.0:1746147134.517936:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094527b80 00000100:00100000:3.0:1746147134.517956:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3257 00000100:00100000:3.0:1746147134.517963:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307779584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.521564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.521612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.521946:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307779840 00000100:00100000:3.0:1746147134.521954:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307779840 00000100:00100000:3.0:1746147134.521989:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14070 00000100:00100000:3.0:1746147134.521997:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32065:x1830967307779840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.522013:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.522031:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77262 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.522051:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.522053:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.522060:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 50 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.522076:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 50 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.522086:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:3.0:1746147134.522164:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32065:x1830967307779840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 168us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.522169:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14070 00000100:00100000:0.0:1746147134.525061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.526981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.527009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.527260:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14071 00000100:00100000:1.0:1746147134.527269:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2001:x1830967307780096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147134.527286:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.527304:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425054ebb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77269 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147134.527343:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132098000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310601216:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147134.527592:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307779584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9621us (9968us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147134.527595:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.527603:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3257 00002000:00100000:3.0:1746147134.527614:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094527b80 x1830967307779584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.527628:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094527b80 with x1830967307779584 ext(4194304->4919295) 00002000:00010000:3.0:1746147134.527634:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094527b80 00000100:00100000:0.0:1746147134.529161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.529226:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307780480 00000100:00100000:3.0:1746147134.529235:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307780480 00002000:00100000:3.0:1746147134.529271:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880094525f80 x1830967307780480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.529279:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525f80 with x1830967307780480 ext(2097152->3145727) 00002000:00010000:3.0:1746147134.529283:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094525f80 00000100:00100000:3.0:1746147134.529566:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3258 00000100:00100000:3.0:1746147134.529587:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307780480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.530506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.530525:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307780736 00000100:00100000:0.0:1746147134.530530:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307780736 00002000:00100000:0.0:1746147134.530562:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3870720->3874815) req@ffff880094526300 x1830967307780736/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.530571:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526300 with x1830967307780736 ext(3870720->3874815) 00002000:00010000:0.0:1746147134.530575:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094526300 00000100:00100000:0.0:1746147134.530589:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3259 00000100:00100000:0.0:1746147134.530595:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+41:2000:x1830967307780736:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147134.530687:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967307780736:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 92us (182us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147134.530692:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3259 00002000:00100000:0.0:1746147134.530697:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3870720->3874815) req@ffff880094526300 x1830967307780736/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.530703:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526300 with x1830967307780736 ext(3870720->3874815) 00002000:00010000:0.0:1746147134.530706:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094526300 00000100:00100000:1.0:1746147134.530805:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132098000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310601216:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147134.530824:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425054ebb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77269 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.530835:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425054ebb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77269 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.530850:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33200, rc 0) 00000100:00100000:1.0:1746147134.530870:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2001:x1830967307780096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3603us (3891us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147134.530877:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14071 00000100:00100000:0.0:1746147134.536194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.536255:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.537789:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307780864 00000100:00100000:1.0:1746147134.537797:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307780864 00000100:00100000:1.0:1746147134.537855:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14073 00000100:00100000:1.0:1746147134.537863:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:32070:x1830967307780864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147134.537885:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.537908:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77277 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.537939:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.537947:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147134.537949:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147134.537952:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.537983:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.537994:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 40 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.538012:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132098000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310601472:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147134.538083:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.543082:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.543188:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307781376 00000100:00100000:0.0:1746147134.543197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.543200:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307781376 00000100:00100000:3.0:1746147134.543260:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5394 00000100:00100000:3.0:1746147134.543268:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:32067:x1830967307781376:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147134.543540:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132098000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310601472:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147134.543567:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.543584:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:1.0:1746147134.543632:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:32070:x1830967307780864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5770us (7449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.543639:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14073 00000100:00100000:3.0:1746147134.543849:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:32067:x1830967307781376:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 581us (775us total) trans 8589935813 rc 0/0 00000100:00100000:3.0:1746147134.543965:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5394 00000100:00100000:1.0:1746147134.544446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.544501:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307781632 00000100:00100000:0.0:1746147134.544506:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307781632 00000100:00100000:0.0:1746147134.544536:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14074 00000100:00100000:0.0:1746147134.544542:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32065:x1830967307781632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.544550:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.544564:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe800/0x3139939425054ed0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7727e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.544583:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147134.544585:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147134.544589:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe800/0x3139939425054ed0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7727e expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.544600:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe800/0x3139939425054ed0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7727e expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.544614:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe800, rc 0) 00000100:00100000:0.0:1746147134.544650:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32065:x1830967307781632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147134.544656:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14074 00000100:00100000:0.0:1746147134.555585:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967307781504:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11705us (12380us total) trans 17179874106 rc 0/0 00000100:00100000:0.0:1746147134.555596:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1040 00002000:00100000:0.0:1746147134.555606:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2269184->2633727) req@ffff880094529880 x1830967307781504/t17179874106(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/448 e 0 to 0 dl 1746147145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.555614:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529880 with x1830967307781504 ext(2269184->2633727) 00010000:00010000:0.0:1746147134.555623:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 44 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.555638:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425054e36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77238 expref: 44 pid: 9584 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746147134.555645:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094529880 00000100:00100000:0.0:1746147134.561615:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.568897:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.570434:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307782016 00000100:00100000:0.0:1746147134.570445:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307782016 00002000:00100000:0.0:1746147134.570494:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880132099880 x1830967307782016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.570503:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132099880 with x1830967307782016 ext(3145728->4194303) 00002000:00010000:0.0:1746147134.570508:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132099880 00000100:00100000:0.0:1746147134.570527:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3261 00000100:00100000:0.0:1746147134.570535:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307782016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.571230:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.571870:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307782272 00000100:00100000:1.0:1746147134.571875:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307782272 00002000:00100000:1.0:1746147134.571898:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880094528e00 x1830967307782272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.571905:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528e00 with x1830967307782272 ext(2097152->3145727) 00002000:00010000:1.0:1746147134.571908:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094528e00 00000100:00100000:1.0:1746147134.571928:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3262 00000100:00100000:1.0:1746147134.571933:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307782272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147134.589815:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967307782272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17873us (18579us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147134.589826:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3262 00002000:00100000:1.0:1746147134.589836:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880094528e00 x1830967307782272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.589844:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528e00 with x1830967307782272 ext(2097152->3145727) 00002000:00010000:1.0:1746147134.589848:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094528e00 00000100:00100000:0.0:1746147134.593873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.597962:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.598212:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307782656 00000100:00100000:1.0:1746147134.598221:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307782656 00000100:00100000:1.0:1746147134.598853:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15160 00000100:00100000:1.0:1746147134.598862:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32073:x1830967307782656:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147134.598885:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.598901:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0000/0x3139939425054ed7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7728c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.598966:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.598978:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.598988:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599000:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599005:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599010:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599871:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054ef3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599883:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599890:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147134.599900:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147134.599962:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599968:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599973:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599979:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599983:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e1400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147134.599987:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.599993:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600003:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147134.600006:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147134.600009:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600013:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054ede lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600032:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600036:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600046:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600050:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e0a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147134.600051:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600056:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600061:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c4100) 00010000:00010000:1.0:1746147134.600063:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147134.600065:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600068:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054ee5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.600118:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0000/0x3139939425054ed7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7728c expref: 48 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.600127:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7728c expref: 47 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.600132:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147134.600134:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147134.600135:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1800, rc 0) 00000100:00100000:1.0:1746147134.600159:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32073:x1830967307782656:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1299us (2209us total) trans 8589935814 rc 0/0 00000100:00100000:1.0:1746147134.600164:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15160 00000100:00100000:0.0:1746147134.607205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.607265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.607268:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307782784 00000100:00100000:3.0:1746147134.607276:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307782784 00000100:00100000:0.0:1746147134.607287:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.607302:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307783296 00000100:00100000:0.0:1746147134.607304:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307783296 00000100:00100000:3.0:1746147134.607311:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14076 00000100:00100000:3.0:1746147134.607317:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+38:32070:x1830967307782784:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147134.607328:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5395 00000100:00100000:0.0:1746147134.607333:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32073:x1830967307783296:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:3.0:1746147134.607342:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.607360:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77293 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.607392:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.607394:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.607401:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 39 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.607414:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 39 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.607422:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730e00, rc 0) 00000100:00100000:3.0:1746147134.607463:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+39:32070:x1830967307782784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 145us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.607468:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14076 00000100:00100000:0.0:1746147134.607476:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32073:x1830967307783296:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 143us (187us total) trans 8589935815 rc 0/0 00000100:00100000:0.0:1746147134.607481:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5395 00000100:00100000:3.0:1746147134.607527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.607546:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307783040 00000100:00100000:3.0:1746147134.607552:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307783040 00000100:00100000:3.0:1746147134.607575:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 783 00000100:00100000:3.0:1746147134.607580:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967307783040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.607587:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147134.607587:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307782912 00000100:00100000:1.0:1746147134.607590:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307782912 00010000:00010000:3.0:1746147134.607602:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054ef3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7728c expref: 48 pid: 7237 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147134.607609:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3870720->3973119) req@ffff88009452bb80 x1830967307782912/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147134.607615:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00002000:00100000:1.0:1746147134.607617:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452bb80 with x1830967307782912 ext(3870720->3973119) 00010000:00010000:3.0:1746147134.607619:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147134.607622:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 39 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.607632:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967307783040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147134.607632:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 39 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.607637:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 783 00002000:00010000:1.0:1746147134.607638:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452bb80 00000100:00100000:1.0:1746147134.607649:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1041 00000100:00100000:1.0:1746147134.607653:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967307782912:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:3.0:1746147134.607852:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147134.620746:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.620837:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307783680 00000100:00100000:3.0:1746147134.620846:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307783680 00002000:00100000:3.0:1746147134.620885:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88009452b480 x1830967307783680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.620893:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b480 with x1830967307783680 ext(2097152->3145727) 00002000:00010000:3.0:1746147134.620897:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452b480 00000100:00100000:3.0:1746147134.620965:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3263 00000100:00100000:3.0:1746147134.620973:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+41:2001:x1830967307783680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147134.624564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.626687:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307783808 00000100:00100000:0.0:1746147134.626702:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307783808 00002000:00100000:0.0:1746147134.626753:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880094537100 x1830967307783808/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.626764:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537100 with x1830967307783808 ext(3145728->4194303) 00002000:00010000:0.0:1746147134.626770:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094537100 00000100:00100000:0.0:1746147134.626826:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3264 00000100:00100000:0.0:1746147134.626835:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307783808:12345-192.168.204.25@tcp:3:cat.0 00000001:00080000:0.0:1746147134.634476:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841379 is committed 00000001:00080000:0.0:1746147134.634492:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841378 is committed 00000001:00080000:0.0:1746147134.634507:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841374 is committed 00000001:00080000:0.0:1746147134.634524:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841368 is committed 00000100:00100000:1.0:1746147134.638928:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307782912:12345-192.168.204.25@tcp:4:cat.0 Request processed in 31259us (31647us total) trans 21474841379 rc 0/0 00000100:00100000:1.0:1746147134.638943:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1041 00002000:00100000:1.0:1746147134.638957:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3870720->3973119) req@ffff88009452bb80 x1830967307782912/t21474841379(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/448 e 0 to 0 dl 1746147145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.638966:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452bb80 with x1830967307782912 ext(3870720->3973119) 00010000:00010000:1.0:1746147134.638978:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 11 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.638993:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 11 pid: 9584 timeout: 772 lvb_type: 0 00002000:00010000:1.0:1746147134.639000:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452bb80 00000100:00100000:3.0:1746147134.644474:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307783680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23491us (23726us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147134.644483:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3263 00002000:00100000:3.0:1746147134.644493:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88009452b480 x1830967307783680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.644501:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b480 with x1830967307783680 ext(2097152->3145727) 00002000:00010000:3.0:1746147134.644506:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452b480 00000100:00100000:0.0:1746147134.652947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.654995:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307783936 00000100:00100000:3.0:1746147134.655006:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307783936 00010000:00010000:3.0:1746147134.655044:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 9 pid: 9584 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.655082:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6125 00000100:00100000:3.0:1746147134.656507:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307783936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.656524:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.656546:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 9 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.656560:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 9 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.656580:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x3139939425054ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3870720->18446744073709551615] (req 3870720->3973119) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7725b expref: 9 pid: 9584 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.658882:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.658887:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.658898:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.658909:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.658951:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.658963:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310601984:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147134.659072:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.660584:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310601984:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147134.660599:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.660629:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307783936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5540us (7688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.660638:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6125 00000100:00100000:1.0:1746147134.663469:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.665190:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.665328:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307784320 00000100:00100000:3.0:1746147134.665331:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307784320 00002000:00100000:3.0:1746147134.665356:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88013209b100 x1830967307784320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.665364:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209b100 with x1830967307784320 ext(3145728->4194303) 00002000:00010000:3.0:1746147134.665367:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013209b100 00000100:00100000:3.0:1746147134.665379:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3265 00000100:00100000:3.0:1746147134.665383:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307784320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.678988:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.680480:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307784320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15094us (15417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147134.680487:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3265 00002000:00100000:3.0:1746147134.680493:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88013209b100 x1830967307784320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.680500:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209b100 with x1830967307784320 ext(3145728->4194303) 00002000:00010000:3.0:1746147134.680503:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013209b100 00000100:00100000:3.0:1746147134.680517:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3266 00000100:00100000:3.0:1746147134.680523:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307784576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.690365:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.691250:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307784832 00000100:00100000:1.0:1746147134.691260:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307784832 00000100:00100000:1.0:1746147134.691314:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15161 00000100:00100000:1.0:1746147134.691321:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:32075:x1830967307784832:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147134.691342:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.691361:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0000/0x3139939425054f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772a1 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.691424:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691436:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691443:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691454:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691458:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691463:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691545:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054f24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691554:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054f24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691559:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054f24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147134.691568:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147134.691623:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691629:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691634:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691651:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691656:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e0a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147134.691660:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691665:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691674:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147134.691677:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147134.691680:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691685:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x3139939425054f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691700:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691704:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691709:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691713:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e1400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147134.691715:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691719:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691724:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88011d412e00) 00010000:00010000:1.0:1746147134.691725:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147134.691727:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691731:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425054f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147134.691762:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0000/0x3139939425054f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a1 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.691771:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054f24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a1 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.691776:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147134.691778:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147134.691780:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1800, rc 0) 00000100:00100000:1.0:1746147134.691831:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:32075:x1830967307784832:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 510us (1474us total) trans 8589935816 rc 0/0 00000100:00100000:1.0:1746147134.691836:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15161 00000100:00100000:1.0:1746147134.696348:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307785088 00000100:00100000:1.0:1746147134.696356:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307785088 00002000:00100000:1.0:1746147134.696394:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca13480 x1830967307785088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.696403:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13480 with x1830967307785088 ext(4194304->4919295) 00002000:00010000:1.0:1746147134.696407:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13480 00000100:00100000:1.0:1746147134.696424:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3267 00000100:00100000:1.0:1746147134.696430:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307785088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.699005:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307785216 00000100:00100000:0.0:1746147134.699013:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307785216 00000100:00100000:0.0:1746147134.699062:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 784 00000100:00100000:0.0:1746147134.699069:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967307785216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147134.699081:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147134.699124:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x3139939425054f24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a1 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.699140:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147134.699143:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147134.699175:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967307785216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147134.699191:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 784 00000100:00100000:3.0:1746147134.699502:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307784576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18977us (20524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147134.699510:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3266 00002000:00100000:3.0:1746147134.699517:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88009452ad80 x1830967307784576/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.699525:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452ad80 with x1830967307784576 ext(3145728->4194303) 00002000:00010000:3.0:1746147134.699529:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452ad80 00000100:00100000:0.0:1746147134.701395:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.701902:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307785088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5470us (5675us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147134.701910:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3267 00002000:00100000:1.0:1746147134.701917:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca13480 x1830967307785088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.701925:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13480 with x1830967307785088 ext(4194304->4919295) 00002000:00010000:1.0:1746147134.701929:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13480 00000100:00100000:0.0:1746147134.706183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.706248:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.706289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.706302:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307785728 00000100:00100000:0.0:1746147134.706303:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307785984 00000100:00100000:1.0:1746147134.706308:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307785728 00000100:00100000:0.0:1746147134.706308:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307785984 00010000:00010000:1.0:1746147134.706335:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425054d41 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77197 expref: 18 pid: 1136 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746147134.706335:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097035e00/0x3139939425054cb5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7715f expref: 26 pid: 1853 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746147134.706368:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6126 00000100:00100000:1.0:1746147134.706374:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307785728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.706385:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.706400:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425054d41 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77197 expref: 18 pid: 1136 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746147134.706409:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425054d41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77197 expref: 18 pid: 1136 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746147134.706428:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.706458:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307785728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.706463:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6126 00000100:00100000:1.0:1746147134.706474:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6127 00000100:00100000:1.0:1746147134.706478:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307785984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.706484:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.706489:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097035e00/0x3139939425054cb5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7715f expref: 26 pid: 1853 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746147134.706496:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097035e00/0x3139939425054cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7715f expref: 26 pid: 1853 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746147134.706505:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097035e00/0x3139939425054cb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7715f expref: 26 pid: 1853 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746147134.706521:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.706531:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307785984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.706536:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6127 00000100:00100000:0.0:1746147134.707025:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307785600 00000100:00100000:0.0:1746147134.707029:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307785600 00002000:00100000:0.0:1746147134.707054:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091d95500 x1830967307785600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147134.707062:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95500 with x1830967307785600 ext(4194304->4919295) 00002000:00010000:0.0:1746147134.707066:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d95500 00000100:00100000:0.0:1746147134.707080:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3268 00000100:00100000:0.0:1746147134.707113:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307785600:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147134.707343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.707358:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.707405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.707435:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307786112 00000100:00100000:0.0:1746147134.707438:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307786112 00000100:00100000:0.0:1746147134.707455:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307786240 00000100:00100000:0.0:1746147134.707457:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307786240 00000100:00100000:0.0:1746147134.707468:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14079 00000100:00100000:0.0:1746147134.707474:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307786112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.707482:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.707492:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3a00/0x3139939425054f39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772af expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.707509:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147134.707512:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307785856 00000100:00100000:3.0:1746147134.707515:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307785856 00010000:00010000:0.0:1746147134.707516:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3a00/0x3139939425054f39 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772af expref: 45 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.707527:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425054c68 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7713c expref: 46 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.707527:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3a00/0x3139939425054f39 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772af expref: 46 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.707537:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3a00, rc 0) 00000100:00100000:3.0:1746147134.707540:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6128 00000100:00100000:3.0:1746147134.707544:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967307785856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.707550:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147134.707554:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967307786112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (212us total) trans 0 rc 301/301 00010000:00010000:3.0:1746147134.707557:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425054c68 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7713c expref: 45 pid: 1853 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746147134.707559:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14079 00010000:00010000:3.0:1746147134.707567:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425054c68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7713c expref: 44 pid: 1853 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746147134.707568:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14080 00000100:00100000:0.0:1746147134.707572:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32073:x1830967307786240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147134.707577:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.707578:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425054c68 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7713c expref: 44 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.707583:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772b6 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.707590:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.707591:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.707593:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.707595:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.707600:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe800/0x3139939425054ed0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7727e expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.707602:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.707605:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.707606:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.707608:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 44 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.707622:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.707622:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe800/0x3139939425054ed0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7727e expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.707631:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe800/0x3139939425054ed0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7727e expref: 44 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.707636:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310602496:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147134.707638:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310602624:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147134.707679:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.707686:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746147134.707692:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310602752:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147134.707707:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.707912:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.712041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.712586:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307786368 00000100:00100000:3.0:1746147134.712594:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307786368 00000100:00100000:3.0:1746147134.713564:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14081 00000100:00100000:3.0:1746147134.713574:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967307786368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.713590:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.713606:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4600/0x3139939425054f47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772bd expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.713652:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310602880:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147134.713724:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147134.713859:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307785600:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 6772us (7683us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147134.713869:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3268 00002000:00100000:1.0:1746147134.713876:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091d95500 x1830967307785600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 724992/724992 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.713889:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95500 with x1830967307785600 ext(4194304->4919295) 00010000:00010000:1.0:1746147134.713896:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 24 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746147134.713906:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 24 pid: 9586 timeout: 772 lvb_type: 0 00002000:00010000:1.0:1746147134.713912:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d95500 00000100:00100000:1.0:1746147134.713980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.713991:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307786624 00000100:00100000:3.0:1746147134.713993:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310602496:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147134.713994:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307786624 00010000:00010000:3.0:1746147134.714004:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147134.714011:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (704512->708607) req@ffff88013209b480 x1830967307786624/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.714018:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209b480 with x1830967307786624 ext(704512->708607) 00002000:00010000:1.0:1746147134.714021:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209b480 00000100:00100000:3.0:1746147134.714029:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967307785856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6479us (6618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.714031:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3269 00000100:00100000:1.0:1746147134.714035:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307786624:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147134.714036:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6128 00000100:00100000:1.0:1746147134.714741:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307786624:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 703us (758us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147134.714747:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3269 00002000:00100000:1.0:1746147134.714752:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (704512->708607) req@ffff88013209b480 x1830967307786624/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.714759:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209b480 with x1830967307786624 ext(704512->708607) 00002000:00010000:1.0:1746147134.714762:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209b480 00000100:00100000:0.0:1746147134.716887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:3.0:1746147134.716911:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147133 -> 1746147134 00002000:00010000:3.0:1746147134.716914:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147133 -> 1746147134 00002000:00010000:3.0:1746147134.716916:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147133 -> 1746147134 00000100:00100000:3.0:1746147134.716928:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310602880:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147134.716949:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4600/0x3139939425054f47 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772bd expref: 44 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.716962:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4600/0x3139939425054f47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772bd expref: 44 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.716972:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4600, rc 0) 00000100:00100000:0.0:1746147134.716989:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.716999:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967307786368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3427us (4964us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147134.717004:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14081 00000100:00100000:1.0:1746147134.717377:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307787008 00000100:00100000:1.0:1746147134.717381:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307787008 00002000:00100000:1.0:1746147134.717426:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (794624->798719) req@ffff880093145880 x1830967307787008/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.717435:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145880 with x1830967307787008 ext(794624->798719) 00002000:00010000:1.0:1746147134.717445:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145880 00000100:00100000:1.0:1746147134.717598:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3270 00000100:00100000:1.0:1746147134.717604:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967307787008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147134.717716:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967307787008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 111us (725us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147134.717722:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3270 00002000:00100000:1.0:1746147134.717727:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (794624->798719) req@ffff880093145880 x1830967307787008/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147134.717734:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145880 with x1830967307787008 ext(794624->798719) 00002000:00010000:1.0:1746147134.717737:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145880 00000100:00100000:0.0:1746147134.717890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.718245:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307787136 00000100:00100000:3.0:1746147134.718249:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307787136 00010000:00010000:3.0:1746147134.718272:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.718298:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6129 00000100:00100000:3.0:1746147134.718303:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307787136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.718311:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.718320:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.718329:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.718341:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425054ec9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77277 expref: 25 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.718361:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.718391:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967307787136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.718397:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6129 00000100:00100000:3.0:1746147134.722961:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307787392 00000100:00100000:3.0:1746147134.722965:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307787392 00002000:00100000:3.0:1746147134.722991:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4198400->4919295) req@ffff880096892a00 x1830967307787392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.722998:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096892a00 with x1830967307787392 ext(4198400->4919295) 00002000:00010000:3.0:1746147134.723001:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096892a00 00000100:00100000:3.0:1746147134.723012:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3271 00000100:00100000:3.0:1746147134.723015:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967307787392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147134.725175:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307787648 00000100:00100000:0.0:1746147134.725187:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307787648 00000100:00100000:0.0:1746147134.725225:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5396 00000100:00100000:0.0:1746147134.725231:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:32075:x1830967307787648:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147134.725425:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:32075:x1830967307787648:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 192us (3052us total) trans 8589935817 rc 0/0 00000100:00100000:0.0:1746147134.725432:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5396 00000100:00100000:0.0:1746147134.728262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.729455:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307788032 00000100:00100000:3.0:1746147134.729463:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307788032 00002000:00100000:3.0:1746147134.729497:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3608576->3612671) req@ffff880093144e00 x1830967307788032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.729505:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144e00 with x1830967307788032 ext(3608576->3612671) 00002000:00010000:3.0:1746147134.729509:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093144e00 00000100:00100000:3.0:1746147134.729524:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3272 00000100:00100000:3.0:1746147134.729530:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307788032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147134.729624:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307788032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 94us (1368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147134.729629:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3272 00002000:00100000:3.0:1746147134.729634:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3608576->3612671) req@ffff880093144e00 x1830967307788032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.729645:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144e00 with x1830967307788032 ext(3608576->3612671) 00002000:00010000:3.0:1746147134.729647:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093144e00 00000100:00100000:3.0:1746147134.730040:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967307787392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7023us (8558us total) trans 0 rc 720896/720896 00000100:00100000:3.0:1746147134.730046:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3271 00002000:00100000:3.0:1746147134.730051:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4198400->4919295) req@ffff880096892a00 x1830967307787392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.730057:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096892a00 with x1830967307787392 ext(4198400->4919295) 00002000:00010000:3.0:1746147134.730060:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096892a00 00000100:00100000:0.0:1746147134.734676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.736684:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.736770:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307788288 00000100:00100000:3.0:1746147134.736775:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307788288 00000100:00100000:3.0:1746147134.736813:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14084 00000100:00100000:3.0:1746147134.736819:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:32073:x1830967307788288:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.736829:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.736841:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772d2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.736861:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.736869:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6800/0x3139939425054f08 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7729a expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.736875:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.736877:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.736880:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->3297279] (req 3145728->3297279) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.736908:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6800/0x3139939425054f08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7729a expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.736919:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6800/0x3139939425054f08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7729a expref: 8 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.736929:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310603136:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.737010:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.737048:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 24 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:3.0:1746147134.737058:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310603264:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.737079:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.737300:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.737414:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307788416 00000100:00100000:3.0:1746147134.737418:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307788416 00000100:00100000:3.0:1746147134.737438:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14085 00000100:00100000:3.0:1746147134.737443:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307788416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.737450:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.737459:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425054f63 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772d9 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.737484:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425054f63 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d9 expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.737492:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425054f63 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d9 expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.737514:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a600, rc 0) 00000100:00100000:3.0:1746147134.737537:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967307788416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 93us (238us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147134.737542:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14085 00000100:00100000:1.0:1746147134.741215:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.741259:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.741335:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310603136:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147134.741343:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310603264:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147134.741365:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->3297279] (req 3145728->3297279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.741380:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42200, rc 0) 00000100:00100000:3.0:1746147134.741422:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32073:x1830967307788288:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4604us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.741428:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14084 00000100:00100000:3.0:1746147134.741454:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6132 00000100:00100000:3.0:1746147134.741458:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967307788672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.741465:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.741472:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 24 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.741480:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 24 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.741490:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6000/0x3139939425054eec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77285 expref: 24 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:3.0:1746147134.741499:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.741500:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147134.741505:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.741511:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.741534:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.741545:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310603392:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147134.741588:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147134.744991:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310603392:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147134.745009:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.746903:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967307788672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5433us (5631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.746917:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6132 00000100:00100000:0.0:1746147134.747418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.747526:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307788928 00000100:00100000:3.0:1746147134.747535:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307788928 00002000:00100000:3.0:1746147134.747570:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3293184->3297279) req@ffff88012f3cc700 x1830967307788928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.747583:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc700 with x1830967307788928 ext(3293184->3297279) 00002000:00010000:3.0:1746147134.747588:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cc700 00000100:00100000:3.0:1746147134.747815:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3273 00000100:00100000:3.0:1746147134.747823:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967307788928:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147134.747948:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967307788928:12345-192.168.204.25@tcp:3:cat.0 Request processed in 126us (532us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147134.747953:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3273 00002000:00100000:3.0:1746147134.747958:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3293184->3297279) req@ffff88012f3cc700 x1830967307788928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.747964:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc700 with x1830967307788928 ext(3293184->3297279) 00002000:00010000:3.0:1746147134.747966:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cc700 00000100:00100000:0.0:1746147134.872187:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.872439:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307789184 00000100:00100000:1.0:1746147134.872449:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307789184 00000100:00100000:3.0:1746147134.873192:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15162 00000100:00100000:3.0:1746147134.873203:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32081:x1830967307789184:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.873223:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.873239:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772e0 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.873302:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873313:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873321:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873334:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873338:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873343:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873446:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054f7f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873455:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054f7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873461:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054f7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.873468:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.873592:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873599:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873602:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873606:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.873608:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873611:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873619:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.873621:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.873623:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873626:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425054f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873646:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873650:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873654:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873658:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ae00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.873660:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873665:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873674:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23200) 00010000:00010000:3.0:1746147134.873675:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.873678:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873681:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425054f78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.873714:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772e0 expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.873724:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054f7f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772e0 expref: 49 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.873729:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.873731:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147134.873733:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a800, rc 0) 00000100:00100000:3.0:1746147134.873984:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32081:x1830967307789184:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 782us (1804us total) trans 8589935818 rc 0/0 00000100:00100000:3.0:1746147134.873990:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15162 00000100:00100000:0.0:1746147134.876650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.876980:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307789568 00000100:00100000:3.0:1746147134.876990:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307789568 00000100:00100000:3.0:1746147134.877129:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 785 00000100:00100000:3.0:1746147134.877139:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967307789568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.877154:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.877182:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054f7f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772e0 expref: 49 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.877217:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.877221:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.877274:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967307789568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.877281:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 785 00000100:00100000:0.0:1746147134.877293:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.877318:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307789440 00000100:00100000:0.0:1746147134.877322:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307789440 00000100:00100000:0.0:1746147134.877350:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5397 00000100:00100000:0.0:1746147134.877356:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32081:x1830967307789440:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147134.877550:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32081:x1830967307789440:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 193us (257us total) trans 8589935819 rc 0/0 00000100:00100000:0.0:1746147134.877556:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5397 00000100:00100000:0.0:1746147134.938357:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.938439:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307789824 00000100:00100000:3.0:1746147134.938450:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307789824 00000100:00100000:3.0:1746147134.938513:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15163 00000100:00100000:3.0:1746147134.938521:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32084:x1830967307789824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.938545:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.938564:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425054f8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772e7 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.938759:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938773:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938787:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938799:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938804:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938809:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938906:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054fa2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938917:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.938923:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.938930:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.939006:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939017:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939022:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939026:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.939030:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939036:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939046:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.939049:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.939054:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939059:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939121:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939126:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939131:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939135:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844aa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.939137:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939145:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939151:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23000) 00010000:00010000:3.0:1746147134.939153:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.939155:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939160:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x3139939425054f9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.939196:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425054f8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772e7 expref: 52 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.939206:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772e7 expref: 51 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.939213:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.939215:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147134.939217:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b400, rc 0) 00000100:00100000:3.0:1746147134.940777:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32084:x1830967307789824:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2247us (2422us total) trans 8589935820 rc 0/0 00000100:00100000:3.0:1746147134.940787:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15163 00000100:00100000:0.0:1746147134.942235:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.942328:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.942394:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307790208 00000100:00100000:1.0:1746147134.942403:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307790208 00000100:00100000:1.0:1746147134.942461:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 786 00000100:00100000:1.0:1746147134.942466:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967307790208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147134.942478:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147134.942503:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425054fa2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772e7 expref: 52 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.942535:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147134.942539:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147134.942582:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2003:x1830967307790208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.942588:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 786 00000100:00100000:3.0:1746147134.946865:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307790336 00000100:00100000:3.0:1746147134.946874:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307790336 00000100:00100000:3.0:1746147134.946924:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307790464 00000100:00100000:3.0:1746147134.946927:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307790464 00000100:00100000:3.0:1746147134.947117:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14086 00000100:00100000:3.0:1746147134.947126:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307790336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147134.947147:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.947166:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x3139939425054fb0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772ee expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147134.947235:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310603520:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147134.947383:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307790592 00000100:00100000:0.0:1746147134.947395:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307790592 00000100:00100000:0.0:1746147134.947418:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14087 00000100:00100000:0.0:1746147134.947424:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307790464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.947430:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.947438:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425054fb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772f5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.947458:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425054fb7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772f5 expref: 45 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.947478:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x3139939425054fb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772f5 expref: 45 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.947492:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0000, rc 0) 00000100:00100000:1.0:1746147134.947558:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14088 00000100:00100000:1.0:1746147134.947570:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307790592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147134.947578:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.947591:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425054fbe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e772fc expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147134.947615:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310603648:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147134.947689:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.949369:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967307790464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1936us (2493us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147134.949380:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14087 00000100:00100000:1.0:1746147134.949546:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147134.954371:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310603648:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147134.954415:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425054fbe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772fc expref: 24 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.954432:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425054fbe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772fc expref: 24 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.954454:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94a00, rc 0) 00000100:00100000:3.0:1746147134.954645:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310603520:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147134.954678:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x3139939425054fb0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772ee expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.954691:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x3139939425054fb0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772ee expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147134.954703:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844aa00, rc 0) 00000100:00100000:3.0:1746147134.955964:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967307790336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8835us (9323us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147134.955967:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307790592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8392us (8632us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147134.955973:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14086 00000100:00100000:1.0:1746147134.955978:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14088 00000100:00100000:0.0:1746147134.956129:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.956273:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307790848 00000100:00100000:3.0:1746147134.956280:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307790848 00000100:00100000:3.0:1746147134.956313:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15164 00000100:00100000:3.0:1746147134.956319:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+28:32087:x1830967307790848:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147134.956335:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147134.956349:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77303 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.956407:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956418:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956428:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956438:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956444:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956449:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956525:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054fda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956534:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054fda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956539:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054fda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147134.956546:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147134.956604:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956609:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956614:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956627:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.956630:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956635:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956646:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147134.956649:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.956653:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956658:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425054fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956671:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956676:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956681:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956684:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147134.956686:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956690:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956695:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23900) 00010000:00010000:3.0:1746147134.956696:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147134.956699:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956703:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x3139939425054fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147134.956743:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425054fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77303 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.956754:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054fda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77303 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.956761:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.956763:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147134.956764:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a400, rc 0) 00000100:00100000:3.0:1746147134.956808:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:32087:x1830967307790848:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 486us (677us total) trans 8589935822 rc 0/0 00000100:00100000:3.0:1746147134.956813:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15164 00000100:00100000:1.0:1746147134.961226:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307790976 00000100:00100000:1.0:1746147134.961238:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307790976 00000100:00100000:1.0:1746147134.961313:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14089 00000100:00100000:1.0:1746147134.961323:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32084:x1830967307790976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147134.961342:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.961363:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7730a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.961394:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.961402:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147134.961404:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147134.961407:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 43 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.961439:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.961464:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 23 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746147134.961476:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310603776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147134.961540:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.961697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147134.962074:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307791104 00000100:00100000:3.0:1746147134.962077:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307791104 00000100:00100000:3.0:1746147134.962139:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 787 00000100:00100000:3.0:1746147134.962144:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967307791104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147134.962151:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147134.962168:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425054fda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77303 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147134.962179:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147134.962183:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.962203:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967307791104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147134.962209:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 787 00000100:00100000:0.0:1746147134.966122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.966160:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307791488 00000100:00100000:0.0:1746147134.966169:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307791488 00000100:00100000:0.0:1746147134.966238:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15165 00000100:00100000:0.0:1746147134.966248:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+29:32090:x1830967307791488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.966272:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.966291:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0000/0x3139939425054fef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77311 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.966360:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966372:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966382:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966396:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966403:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966409:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966507:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x3139939425055004 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966519:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x3139939425055004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966526:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x3139939425055004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147134.966537:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147134.966615:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966622:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966627:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966632:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966636:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e1c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147134.966640:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966645:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966659:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147134.966661:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147134.966666:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966670:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1c00/0x3139939425054ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966686:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966692:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966696:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966699:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e0800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147134.966701:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966705:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966712:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a600) 00010000:00010000:0.0:1746147134.966714:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147134.966716:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966720:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425054ffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147134.966758:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0000/0x3139939425054fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77311 expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.966771:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x3139939425055004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77311 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.966777:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147134.966779:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147134.966781:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0600, rc 0) 00000100:00100000:0.0:1746147134.966834:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+31:32090:x1830967307791488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 586us (753us total) trans 8589935823 rc 0/0 00000100:00100000:0.0:1746147134.966840:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15165 00000100:00100000:1.0:1746147134.967853:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310603776:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147134.967870:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 43 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.967879:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:1.0:1746147134.967952:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32084:x1830967307790976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6629us (7010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.967959:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14089 00000100:00100000:0.0:1746147134.971221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.974886:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307791872 00000100:00100000:0.0:1746147134.974892:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307791872 00000100:00100000:0.0:1746147134.974925:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 788 00000100:00100000:0.0:1746147134.974930:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+32:2001:x1830967307791872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147134.974938:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147134.974956:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x3139939425055004 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77311 expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.974966:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147134.974968:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147134.974990:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967307791872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147134.974995:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 788 00000001:00080000:0.0:1746147134.978018:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874107 is committed 00000001:00080000:0.0:1746147134.978030:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874106 is committed 00000001:00080000:0.0:1746147134.978055:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874101 is committed 00000001:00080000:0.0:1746147134.978065:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874097 is committed 00000100:00100000:0.0:1746147134.978812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.979399:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.979447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.979473:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307792000 00000100:00100000:0.0:1746147134.979480:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307792000 00000100:00100000:0.0:1746147134.979518:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307792128 00000100:00100000:0.0:1746147134.979523:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307792128 00000100:00100000:0.0:1746147134.979565:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307792256 00000100:00100000:0.0:1746147134.979569:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307792256 00000100:00100000:0.0:1746147134.979593:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14090 00000100:00100000:0.0:1746147134.979602:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307792000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.979618:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.979636:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f966200/0x3139939425055012 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77318 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147134.979699:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310603904:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147134.979762:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.979781:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14091 00000100:00100000:0.0:1746147134.979786:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307792128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.979793:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.979800:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01ba00/0x3139939425055019 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7731f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.979819:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ba00/0x3139939425055019 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7731f expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.979834:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ba00/0x3139939425055019 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7731f expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147134.979844:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ba00, rc 0) 00000100:00100000:0.0:1746147134.979873:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307792128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 85us (474us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147134.979879:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14091 00000100:00100000:0.0:1746147134.979896:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14092 00000100:00100000:0.0:1746147134.979902:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307792256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147134.979911:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147134.979921:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e1800/0x3139939425055020 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77326 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147134.979948:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310604032:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147134.979978:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.980029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.980056:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307792384 00000100:00100000:0.0:1746147134.980061:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307792384 00010000:00010000:0.0:1746147134.980078:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 10 pid: 9586 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746147134.980142:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6133 00000100:00100000:0.0:1746147134.980149:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307792384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147134.980160:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147134.980180:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 10 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.980191:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x3139939425054f32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 704512->798719) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772a8 expref: 10 pid: 9586 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746147134.980208:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.980210:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147134.980217:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.980225:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147134.980252:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147134.980261:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310604160:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147134.980310:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147134.987131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147134.987190:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310604160:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147134.987204:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307792640 00010000:00010000:0.0:1746147134.987211:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147134.987216:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307792640 00000100:00100000:0.0:1746147134.987248:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307792384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7101us (7221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147134.987258:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6133 00002000:00100000:3.0:1746147134.987260:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801323d5880 x1830967307792640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/0 e 0 to 0 dl 1746147145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147134.987270:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5880 with x1830967307792640 ext(0->1048575) 00002000:00010000:3.0:1746147134.987276:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5880 00000100:00100000:3.0:1746147134.987299:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3274 00000100:00100000:3.0:1746147134.987306:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307792640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147134.987804:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310604032:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147134.987823:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1800/0x3139939425055020 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77326 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.987832:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e1800/0x3139939425055020 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77326 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147134.987844:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1800, rc 0) 00000100:00100000:1.0:1746147134.987863:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307792256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7963us (8418us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147134.987872:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14092 00000100:00100000:0.0:1746147134.989683:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147134.989979:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307792768 00000100:00100000:1.0:1746147134.989987:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307792768 00000100:00100000:1.0:1746147134.990061:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14093 00000100:00100000:1.0:1746147134.990071:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:32090:x1830967307792768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147134.990125:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147134.990146:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7732d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.990173:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147134.990175:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147134.990184:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7732d expref: 8 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.990200:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7732d expref: 8 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147134.990793:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95600, rc 0) 00000100:00100000:1.0:1746147134.990865:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:32090:x1830967307792768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 793us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147134.990872:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14093 00000100:00100000:0.0:1746147134.998238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.004124:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307792640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16805us (16991us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147135.004137:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3274 00002000:00100000:3.0:1746147135.004148:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801323d5880 x1830967307792640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:510/0 lens 488/440 e 0 to 0 dl 1746147145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.004156:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5880 with x1830967307792640 ext(0->1048575) 00002000:00010000:3.0:1746147135.004162:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5880 00000100:00100000:0.0:1746147135.021222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.022157:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307793152 00000100:00100000:1.0:1746147135.022169:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307793152 00000100:00100000:1.0:1746147135.022234:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14094 00000100:00100000:1.0:1746147135.022244:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32084:x1830967307793152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.022266:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.022287:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77334 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.022318:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.022320:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.022328:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 26 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.022358:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 26 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.022368:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95000, rc 0) 00000100:00100000:1.0:1746147135.022429:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32084:x1830967307793152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 186us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.022435:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14094 00000100:00100000:0.0:1746147135.028042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.033390:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307793536 00000100:00100000:3.0:1746147135.033397:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307793536 00000100:00100000:0.0:1746147135.033426:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307793664 00000100:00100000:3.0:1746147135.033435:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14095 00000100:00100000:0.0:1746147135.033439:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307793664 00000100:00100000:3.0:1746147135.033442:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+9:32087:x1830967307793536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147135.033460:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147135.033475:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7733b expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.033506:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.033512:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147135.033513:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147135.033516:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2408448->2965503] (req 2408448->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.033539:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.033548:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 27 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.033558:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310604288:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147135.033611:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147135.033994:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14096 00000100:00100000:0.0:1746147135.034002:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:32090:x1830967307793664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.034032:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.034046:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77342 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.034066:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.034071:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->2965503] (req 2408448->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.034077:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147135.034103:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.034135:0:9584:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->2965503] (req 2408448->2965503) gid 0 flags: 0x60000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.034151:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.034162:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94400, rc 0) 00000100:00100000:1.0:1746147135.034204:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32090:x1830967307793664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 203us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.034211:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14096 00000100:00100000:3.0:1746147135.038262:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310604288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147135.038295:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->2965503] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.038315:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ac00, rc 0) 00000100:00100000:3.0:1746147135.038370:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+10:32087:x1830967307793536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4927us (5210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.038379:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14095 00000100:00100000:3.0:1746147135.039402:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307793408:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9433us (11369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147135.039411:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3276 00002000:00100000:3.0:1746147135.039420:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8801323d5f80 x1830967307793408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/440 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.039429:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5f80 with x1830967307793408 ext(2097152->3145727) 00010000:00010000:3.0:1746147135.039438:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 26 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.039450:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 26 pid: 9584 timeout: 773 lvb_type: 0 00002000:00010000:3.0:1746147135.039457:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d5f80 00000100:00100000:0.0:1746147135.045202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.045298:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.045350:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307793920 00000100:00100000:1.0:1746147135.045361:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307793920 00010000:00010000:1.0:1746147135.045401:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 26 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.045433:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6134 00000100:00100000:1.0:1746147135.045443:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307793920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147135.045448:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307793792 00000100:00100000:3.0:1746147135.045452:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307793792 00010000:00010000:1.0:1746147135.045459:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147135.045478:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14097 00010000:00010000:1.0:1746147135.045479:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 27 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.045483:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32084:x1830967307793792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.045491:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 27 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.045501:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.045513:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x313993942505502e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77334 expref: 27 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.045515:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77349 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.045533:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.045535:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.045543:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.045551:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.045571:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.045577:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147135.045579:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147135.045583:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.045614:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.045614:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.045624:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 27 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.045634:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 9 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.045637:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094536680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310604672:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.045643:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310604544:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147135.045736:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147135.045740:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.048036:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310604544:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147135.048057:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.048136:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307793920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2693us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.048147:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6134 00000100:00100000:3.0:1746147135.048981:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094536680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310604672:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147135.049005:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.049025:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7200, rc 0) 00000100:00100000:3.0:1746147135.049050:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32084:x1830967307793792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3566us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.049057:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14097 00000100:00100000:0.0:1746147135.050595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.050684:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307794048 00000100:00100000:0.0:1746147135.050691:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307794048 00002000:00100000:0.0:1746147135.050736:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3608576->4194303) req@ffff8801323d5180 x1830967307794048/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147135.050854:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5180 with x1830967307794048 ext(3608576->4194303) 00010000:00010000:0.0:1746147135.050863:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 26 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.050875:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 26 pid: 9585 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746147135.050881:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d5180 00000100:00100000:0.0:1746147135.051198:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1043 00000100:00100000:0.0:1746147135.051208:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307794048:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147135.057896:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.061374:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.065540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.065587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.065708:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307794048:12345-192.168.204.25@tcp:4:cat.0 Request processed in 14500us (15116us total) trans 17179874108 rc 0/0 00000100:00100000:1.0:1746147135.065721:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1043 00002000:00100000:1.0:1746147135.065733:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3608576->4194303) req@ffff8801323d5180 x1830967307794048/t17179874108(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/448 e 0 to 0 dl 1746147146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147135.065743:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5180 with x1830967307794048 ext(3608576->4194303) 00010000:00010000:1.0:1746147135.065754:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 30 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.065766:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 30 pid: 9585 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746147135.065772:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d5180 00000100:00100000:0.0:1746147135.065939:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310604800:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147135.065949:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310604928:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147135.065978:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [57344->1048575] (req 57344->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.065993:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6400, rc 0) 00000100:00100000:0.0:1746147135.066016:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32081:x1830967307794432:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3317us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.066023:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14098 00000100:00100000:1.0:1746147135.066145:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307794944 00000100:00100000:1.0:1746147135.066151:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307794944 00002000:00100000:1.0:1746147135.066184:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2408448->2965503) req@ffff8801323d4380 x1830967307794944/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147135.066190:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4380 with x1830967307794944 ext(2408448->2965503) 00010000:00010000:1.0:1746147135.066195:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 10 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.066203:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 10 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746147135.066209:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d4380 00000100:00100000:1.0:1746147135.066223:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1045 00000100:00100000:1.0:1746147135.066230:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307794944:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147135.069910:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307795072 00000100:00100000:1.0:1746147135.069922:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307795072 00010000:00010000:1.0:1746147135.069973:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 29 pid: 9585 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.070025:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6135 00000100:00100000:1.0:1746147135.070033:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307795072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.070049:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147135.072523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.072585:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307795328 00000100:00100000:3.0:1746147135.072593:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307795328 00010000:00010000:3.0:1746147135.072625:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7732d expref: 12 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.072654:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 29 pid: 9585 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.072659:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6136 00000100:00100000:3.0:1746147135.072666:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307795328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.072671:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 29 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.072681:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.072697:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7732d expref: 12 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.072698:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425054f40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3608576->4194303] (req 3608576->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772b6 expref: 29 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.072707:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7732d expref: 12 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.072724:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147135.072725:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425055027 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7732d expref: 12 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.072745:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.072792:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307795072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2757us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.072800:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6135 00000100:00100000:3.0:1746147135.072810:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307795328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.072817:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6136 00000100:00100000:1.0:1746147135.073968:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.074203:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307795200 00000100:00100000:0.0:1746147135.074211:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307795200 00010000:00010000:0.0:1746147135.074239:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 28 pid: 1136 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.074412:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307794944:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8178us (8819us total) trans 17179874109 rc 0/0 00000100:00100000:3.0:1746147135.074421:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1045 00002000:00100000:3.0:1746147135.074429:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2408448->2965503) req@ffff8801323d4380 x1830967307794944/t17179874109(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:511/0 lens 488/448 e 0 to 0 dl 1746147146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.074439:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4380 with x1830967307794944 ext(2408448->2965503) 00010000:00010000:3.0:1746147135.074447:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.074456:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:3.0:1746147135.074471:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d4380 00000100:00100000:0.0:1746147135.074589:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6137 00000100:00100000:0.0:1746147135.074597:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307795200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147135.074609:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147135.074624:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 28 pid: 1136 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.074634:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 28 pid: 1136 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.074652:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425054fe8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7730a expref: 28 pid: 1136 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.074873:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.074875:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.074882:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.074889:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.074923:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.074934:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310605056:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147135.081814:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.082007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.082042:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.082688:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307795584 00000100:00100000:3.0:1746147135.082699:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307795584 00002000:00100000:3.0:1746147135.082748:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (57344->61439) req@ffff88013209a680 x1830967307795584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.082760:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209a680 with x1830967307795584 ext(57344->61439) 00002000:00010000:3.0:1746147135.082765:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209a680 00000100:00100000:3.0:1746147135.082798:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3277 00000100:00100000:3.0:1746147135.082806:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307795584:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147135.082966:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307795584:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 160us (963us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147135.082972:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3277 00002000:00100000:3.0:1746147135.082978:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (57344->61439) req@ffff88013209a680 x1830967307795584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.082985:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209a680 with x1830967307795584 ext(57344->61439) 00002000:00010000:3.0:1746147135.082987:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209a680 00000100:00100000:0.0:1746147135.083370:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310605056:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147135.083391:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147135.083416:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307795200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8820us (9451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.083424:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6137 00000100:00100000:0.0:1746147135.083472:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307795712 00000100:00100000:0.0:1746147135.083475:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307795712 00010000:00010000:0.0:1746147135.083494:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746147135.083513:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6138 00000100:00100000:0.0:1746147135.083518:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307795712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147135.083529:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147135.083544:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.083556:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.083577:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844ac00/0x3139939425055035 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2408448->3604479] (req 2408448->2965503) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7733b expref: 11 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.083591:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.083593:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.083600:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.083609:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.083617:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.083618:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.083621:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.083627:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.083655:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.083671:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310605184:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147135.084648:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.084659:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310605312:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147135.084700:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147135.087656:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310605184:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147135.087670:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310605312:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147135.087693:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147135.087744:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307795712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4224us (5699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.087756:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6138 00000100:00100000:0.0:1746147135.094277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.094837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.100253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.100323:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307796480 00000100:00100000:3.0:1746147135.100333:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307796480 00002000:00100000:3.0:1746147135.100384:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d6300 x1830967307796480/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.100394:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6300 with x1830967307796480 ext(2097152->4194303) 00002000:00010000:3.0:1746147135.100399:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d6300 00000100:00100000:1.0:1746147135.101489:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3280 00000100:00100000:1.0:1746147135.101503:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307796480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147135.109257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.118560:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307795968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21862us (24287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147135.118571:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3278 00002000:00100000:3.0:1746147135.118580:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801323d5c00 x1830967307795968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/440 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.118587:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5c00 with x1830967307795968 ext(3145728->4194303) 00002000:00010000:3.0:1746147135.118592:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5c00 00000100:00100000:0.0:1746147135.127796:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.127832:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.127865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.127934:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307796736 00000100:00100000:1.0:1746147135.127938:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307796864 00000100:00100000:3.0:1746147135.127940:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307796736 00000100:00100000:1.0:1746147135.127949:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307796864 00010000:00010000:3.0:1746147135.127969:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7719e expref: 9 pid: 9585 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746147135.127984:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097035800/0x3139939425054cbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77166 expref: 8 pid: 1853 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746147135.127990:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307796992 00000100:00100000:3.0:1746147135.127992:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307796992 00010000:00010000:3.0:1746147135.128000:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x3139939425054c6f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77143 expref: 25 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.128018:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6139 00000100:00100000:3.0:1746147135.128024:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307796736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147135.128032:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6140 00010000:00010000:3.0:1746147135.128034:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147135.128040:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307796864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.128048:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7719e expref: 9 pid: 9585 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746147135.128053:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.128061:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7719e expref: 9 pid: 9585 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746147135.128071:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097035800/0x3139939425054cbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77166 expref: 8 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.128115:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094008400/0x3139939425054d3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7719e expref: 9 pid: 9585 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746147135.128118:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097035800/0x3139939425054cbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77166 expref: 8 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.128144:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147135.128144:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097035800/0x3139939425054cbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77166 expref: 8 pid: 1853 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746147135.128161:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2002:x1830967307796736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.128167:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6139 00010000:00010000:1.0:1746147135.128170:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.128209:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307796864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 171us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.128216:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6140 00000100:00100000:3.0:1746147135.135494:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310605824:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147135.135516:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.135564:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967307796992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7403us (7695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.135578:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6141 00000100:00100000:0.0:1746147135.136275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.136326:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307797248 00000100:00100000:3.0:1746147135.136332:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307797248 00002000:00100000:3.0:1746147135.136373:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1093632->1097727) req@ffff880099889f80 x1830967307797248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.136382:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889f80 with x1830967307797248 ext(1093632->1097727) 00002000:00010000:3.0:1746147135.136385:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099889f80 00000100:00100000:3.0:1746147135.136413:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3281 00000100:00100000:3.0:1746147135.136420:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967307797248:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147135.136547:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967307797248:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 126us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147135.136552:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3281 00002000:00100000:3.0:1746147135.136557:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1093632->1097727) req@ffff880099889f80 x1830967307797248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.136564:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889f80 with x1830967307797248 ext(1093632->1097727) 00002000:00010000:3.0:1746147135.136568:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099889f80 00000100:00100000:0.0:1746147135.141657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.143993:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307796480:12345-192.168.204.25@tcp:3:cat.0 Request processed in 42490us (43746us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147135.144003:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3280 00002000:00100000:1.0:1746147135.144011:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d6300 x1830967307796480/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:511/0 lens 488/440 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147135.144020:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6300 with x1830967307796480 ext(2097152->4194303) 00002000:00010000:1.0:1746147135.144049:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d6300 00000100:00100000:0.0:1746147135.158343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.158411:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307797632 00000100:00100000:1.0:1746147135.158419:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307797632 00002000:00100000:1.0:1746147135.158455:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099888380 x1830967307797632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147135.158464:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967307797632 ext(4194304->4919295) 00002000:00010000:1.0:1746147135.158470:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099888380 00000100:00100000:1.0:1746147135.158503:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3282 00000100:00100000:1.0:1746147135.158509:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307797632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147135.163371:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.165019:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307797632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6505us (6680us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147135.165028:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3282 00002000:00100000:1.0:1746147135.165035:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099888380 x1830967307797632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/440 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147135.165043:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967307797632 ext(4194304->4919295) 00002000:00010000:1.0:1746147135.165047:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099888380 00000100:00100000:0.0:1746147135.170964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.171056:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.171058:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307797888 00000100:00100000:1.0:1746147135.171065:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307797888 00000100:00100000:0.0:1746147135.171109:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307798016 00000100:00100000:0.0:1746147135.171113:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307798016 00002000:00100000:1.0:1746147135.171139:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3297279) req@ffff880099888700 x1830967307797888/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147135.171145:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14102 00002000:00100000:1.0:1746147135.171146:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888700 with x1830967307797888 ext(3145728->3297279) 00000100:00100000:0.0:1746147135.171151:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307798016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.171153:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 24 pid: 9586 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.171163:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.171164:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 24 pid: 9586 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746147135.171169:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099888700 00010000:00010000:0.0:1746147135.171177:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260800/0x3139939425055066 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7736c expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.171182:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1046 00000100:00100000:1.0:1746147135.171188:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307797888:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147135.171217:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310606208:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147135.172972:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.175416:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310606208:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147135.175449:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260800/0x3139939425055066 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7736c expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.175462:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260800/0x3139939425055066 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7736c expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.175491:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260800, rc 0) 00000100:00100000:1.0:1746147135.175532:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307798016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4380us (4475us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147135.175540:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14102 00000100:00100000:0.0:1746147135.176346:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307797888:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5152us (5386us total) trans 21474841380 rc 0/0 00000100:00100000:0.0:1746147135.176355:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1046 00002000:00100000:0.0:1746147135.176363:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3297279) req@ffff880099888700 x1830967307797888/t21474841380(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/448 e 0 to 0 dl 1746147146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147135.176371:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888700 with x1830967307797888 ext(3145728->3297279) 00010000:00010000:0.0:1746147135.176379:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.176392:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746147135.176398:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099888700 00000100:00100000:0.0:1746147135.180154:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.180202:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.180260:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307798272 00000100:00100000:3.0:1746147135.180269:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307798272 00010000:00010000:3.0:1746147135.180302:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.180329:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6142 00000100:00100000:3.0:1746147135.180336:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307798272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.180348:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.180366:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.180377:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.180396:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42200/0x3139939425054f5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772d2 expref: 25 pid: 9586 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.180413:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147135.180414:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147135.180420:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.180429:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.180459:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147135.180470:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310606336:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147135.180511:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307798144 00000100:00100000:1.0:1746147135.180515:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307798144 00000100:00100000:1.0:1746147135.180549:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14103 00000100:00100000:1.0:1746147135.180555:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307798144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.180568:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.180577:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77373 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.180588:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.180590:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.180594:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.180603:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147135.180604:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147135.180616:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00000100:00100000:1.0:1746147135.180636:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307798144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.180641:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14103 00000100:00100000:3.0:1746147135.186322:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310606336:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147135.186339:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.186377:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307798272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6040us (6173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.186385:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6142 00000100:00100000:0.0:1746147135.188356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.207050:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.207178:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.207258:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307798656 00000100:00100000:1.0:1746147135.207268:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307798656 00000100:00100000:1.0:1746147135.207304:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307798784 00000100:00100000:1.0:1746147135.207307:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307798784 00000100:00100000:1.0:1746147135.207323:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14104 00000100:00100000:1.0:1746147135.207330:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307798656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.207852:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.207864:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x313993942505507b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7737a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.207888:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310606592:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147135.207916:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00002000:00010000:1.0:1746147135.213667:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147134 -> 1746147135 00002000:00010000:1.0:1746147135.213675:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147134 -> 1746147135 00002000:00010000:1.0:1746147135.213676:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147134 -> 1746147135 00000100:00100000:1.0:1746147135.214020:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310606592:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147135.214047:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x313993942505507b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7737a expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.214061:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x313993942505507b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7737a expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.214479:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95600, rc 0) 00000100:00100000:1.0:1746147135.214524:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307798656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7193us (7479us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147135.214531:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14104 00000100:00100000:0.0:1746147135.218662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.218880:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799040 00000100:00100000:3.0:1746147135.218889:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799040 00002000:00100000:3.0:1746147135.218925:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4198399) req@ffff880096cf9180 x1830967307799040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.218934:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9180 with x1830967307799040 ext(4194304->4198399) 00002000:00010000:3.0:1746147135.218938:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9180 00000100:00100000:3.0:1746147135.218953:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3284 00000100:00100000:3.0:1746147135.218959:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307799040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147135.219134:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307799040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 174us (479us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147135.219140:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3284 00002000:00100000:3.0:1746147135.219146:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4198399) req@ffff880096cf9180 x1830967307799040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746147146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.219152:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9180 with x1830967307799040 ext(4194304->4198399) 00002000:00010000:3.0:1746147135.219159:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9180 00000100:00100000:0.0:1746147135.222403:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.222451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.222619:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799168 00000100:00100000:1.0:1746147135.222628:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799168 00000100:00100000:1.0:1746147135.222661:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799296 00000100:00100000:1.0:1746147135.222662:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799296 00000100:00100000:1.0:1746147135.222689:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14106 00000100:00100000:1.0:1746147135.222696:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307799168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.222710:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.222725:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x3139939425055082 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77388 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.222762:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310606720:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147135.222823:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00010000:00010000:2.0:1746147135.223002:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x3139939425055089 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7738f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147135.223033:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310606848:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147135.223055:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.224392:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310606720:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147135.224411:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x3139939425055082 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77388 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.224422:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x3139939425055082 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77388 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.224444:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:1.0:1746147135.224472:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307799168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1776us (2076us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147135.224479:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14106 00000100:00100000:2.0:1746147135.228013:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310606848:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147135.228042:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x3139939425055089 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7738f expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.228054:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffd800/0x3139939425055089 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7738f expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.228069:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffd800, rc 0) 00000100:00100000:2.0:1746147135.228151:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307799296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5166us (5697us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147135.228158:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14107 00000100:00100000:2.0:1746147135.231586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.231994:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.232929:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799424 00000100:00100000:1.0:1746147135.232937:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799424 00000100:00100000:1.0:1746147135.232983:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799552 00000100:00100000:1.0:1746147135.232986:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799552 00000100:00100000:1.0:1746147135.233144:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14108 00000100:00100000:1.0:1746147135.233152:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307799424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147135.233170:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.233185:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425055090 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77396 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.233246:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310606976:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147135.233312:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147135.233750:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14109 00000100:00100000:0.0:1746147135.233766:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307799552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147135.233773:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147135.233783:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b6800/0x3139939425055097 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7739d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.233806:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310607104:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147135.233830:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147135.235827:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310607104:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147135.235851:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b6800/0x3139939425055097 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7739d expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.235862:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b6800/0x3139939425055097 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7739d expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.235874:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b6800, rc 0) 00000100:00100000:2.0:1746147135.235905:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307799552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2147us (3911us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147135.235913:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14109 00000100:00100000:1.0:1746147135.236019:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310606976:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147135.236034:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425055090 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77396 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.236042:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425055090 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77396 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.236053:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95000, rc 0) 00000100:00100000:1.0:1746147135.236068:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307799424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2918us (4491us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147135.236073:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14108 00000100:00100000:0.0:1746147135.253577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.253648:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799680 00000100:00100000:3.0:1746147135.253657:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799680 00000100:00100000:3.0:1746147135.253698:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15166 00000100:00100000:3.0:1746147135.253706:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32096:x1830967307799680:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147135.253725:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147135.253741:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6200/0x313993942505509e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773a4 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.253792:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253802:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253812:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253823:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253829:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253834:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253888:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253899:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.253903:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.253927:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.253937:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.253949:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310607232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147135.254765:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147135.259470:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.259513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.260262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.260285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.260337:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799808 00000100:00100000:1.0:1746147135.260347:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799808 00000100:00100000:1.0:1746147135.261172:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 180 00000100:00100000:1.0:1746147135.261180:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967307799808:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1746147135.261230:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967307799808:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 52us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.261235:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 180 00000100:00100000:0.0:1746147135.261604:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310607232:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147135.261622:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:2.0:1746147135.261804:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307799936 00000100:00100000:2.0:1746147135.261808:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307799936 00000100:00100000:2.0:1746147135.261839:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 846 00000100:00100000:2.0:1746147135.261846:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967307799936:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147135.261877:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967307799936:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 33us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.261882:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 846 00000100:00100000:2.0:1746147135.261891:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800192 00000100:00100000:2.0:1746147135.261893:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800192 00000100:00100000:2.0:1746147135.261904:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800064 00000100:00100000:2.0:1746147135.261906:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800064 00000100:00100000:2.0:1746147135.261914:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 847 00000100:00100000:2.0:1746147135.261918:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2003:x1830967307800192:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147135.261936:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2003:x1830967307800192:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 17us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.261940:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 847 00000100:00100000:2.0:1746147135.261948:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 848 00000100:00100000:2.0:1746147135.261952:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+5:2003:x1830967307800064:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147135.261967:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+5:2003:x1830967307800064:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 15us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.261972:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 848 00000100:00080000:0.0:1746147135.262465:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147135.263443:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.263542:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800448 00000100:00100000:1.0:1746147135.263547:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800448 00000100:00100000:1.0:1746147135.263576:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5401 00000100:00100000:1.0:1746147135.263582:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:30600:x1830967307800448:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147135.264410:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:30600:x1830967307800448:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 826us (967us total) trans 8589935826 rc 0/0 00000100:00100000:1.0:1746147135.264416:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5401 00000100:00100000:0.0:1746147135.266799:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.266914:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800576 00000100:00100000:3.0:1746147135.266921:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800576 00010000:00010000:3.0:1746147135.266951:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 52 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.266976:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6143 00000100:00100000:3.0:1746147135.266983:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967307800576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.266994:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.266999:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 52 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.267010:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 52 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.267027:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425054e28 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77231 expref: 52 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.267235:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147135.267240:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.267250:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.267255:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.267473:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.267510:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2001:x1830967307800576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 527us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.267516:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6143 00010000:00010000:0.0:1746147135.267565:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267572:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147135.267614:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147135.267617:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147135.267632:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267640:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267648:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267653:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267657:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267662:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147135.267665:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267671:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267678:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147135.267681:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147135.267683:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.267688:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x31399394250550a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268691:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268699:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268704:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268707:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e6600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147135.268710:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268715:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268722:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23300) 00010000:00010000:0.0:1746147135.268724:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147135.268726:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268730:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6600/0x31399394250550ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.268767:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6200/0x313993942505509e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.268778:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.268784:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147135.268785:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147135.268787:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7000, rc 0) 00000100:00100000:0.0:1746147135.268831:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32096:x1830967307799680:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 15125us (15263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.268838:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15166 00000100:00100000:0.0:1746147135.272429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.272460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.272487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.272506:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800704 00000100:00100000:0.0:1746147135.272512:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800704 00000100:00100000:0.0:1746147135.272553:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800832 00000100:00100000:0.0:1746147135.272555:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800832 00000100:00100000:0.0:1746147135.272567:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307800960 00000100:00100000:0.0:1746147135.272568:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307800960 00000100:00100000:0.0:1746147135.272579:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14110 00000100:00100000:0.0:1746147135.272586:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307800704:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147135.272601:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147135.272616:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936b7200/0x31399394250550ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773ab expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.272656:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310607360:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147135.272720:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147135.272754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.274795:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307801088 00000100:00100000:1.0:1746147135.274803:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307801088 00000100:00100000:1.0:1746147135.274846:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14111 00000100:00100000:1.0:1746147135.274853:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307800832:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147135.274867:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.274879:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x31399394250550c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773b2 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.274915:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310607488:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147135.274965:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.274979:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14112 00000100:00100000:1.0:1746147135.274996:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307800960:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147135.275004:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.275012:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773b9 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.275023:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.275025:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.275032:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.275044:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.275054:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95000, rc 0) 00000100:00100000:1.0:1746147135.275082:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307800960:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 89us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.275105:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14112 00000100:00100000:1.0:1746147135.275127:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14113 00000100:00100000:1.0:1746147135.275132:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307801088:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147135.275138:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.275144:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773c0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.275153:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.275155:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.275158:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.275167:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.275179:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95c00, rc 0) 00000100:00100000:1.0:1746147135.275194:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307801088:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 62us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.275198:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14113 00000100:00100000:0.0:1746147135.277341:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310607360:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147135.277365:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7200/0x31399394250550ba lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ab expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.277376:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936b7200/0x31399394250550ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ab expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.277390:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7200, rc 0) 00000100:00100000:0.0:1746147135.277515:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307800704:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4927us (5096us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147135.277522:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14110 00000100:00100000:1.0:1746147135.279706:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013209b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310607488:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147135.279731:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x31399394250550c1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b2 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.279743:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x31399394250550c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b2 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.279764:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:1.0:1746147135.279807:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307800832:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4954us (7345us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147135.279814:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14111 00000100:00100000:0.0:1746147135.282520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.282731:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307801344 00000100:00100000:2.0:1746147135.282738:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307801344 00000100:00100000:2.0:1746147135.283223:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15167 00000100:00100000:2.0:1746147135.283231:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32096:x1830967307801344:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147135.283248:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147135.283264:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250550d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773c7 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.283344:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.283357:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.283364:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.283388:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.283400:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 16 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.283409:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310607616:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.285186:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147135.287667:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310607616:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.287688:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147135.288226:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.288439:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307801472 00000100:00100000:3.0:1746147135.288445:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307801472 00010000:00010000:3.0:1746147135.288474:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 17 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.288934:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6144 00000100:00100000:3.0:1746147135.288943:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307801472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.288955:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.288961:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 17 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.288972:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 17 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.288989:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7000/0x31399394250550b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773a4 expref: 17 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.289496:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147135.289502:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.289511:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.289517:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147135.289537:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147135.289641:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147135.289648:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147135.289664:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147135.289771:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250550d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c7 expref: 18 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.289787:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c7 expref: 17 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.289793:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147135.289795:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147135.289798:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cdc00, rc 0) 00000100:00100000:3.0:1746147135.290167:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307801472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1223us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.290174:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6144 00000100:00100000:0.0:1746147135.291016:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32096:x1830967307801344:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 7783us (8500us total) trans 8589935827 rc 0/0 00000100:00100000:0.0:1746147135.291022:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15167 00000100:00100000:0.0:1746147135.295162:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.295222:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307801728 00000100:00100000:1.0:1746147135.295234:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307801728 00000100:00100000:1.0:1746147135.295302:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15168 00000100:00100000:1.0:1746147135.295314:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32096:x1830967307801728:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147135.295338:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.295341:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147135.295364:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cdc00/0x31399394250550dd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c7 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.295401:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147135.295405:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147135.295416:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250550eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773ce expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.295497:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250550f2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147135.295509:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250550f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147135.295516:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250550f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147135.295524:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147135.295595:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250550eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ce expref: 18 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.295606:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250550f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ce expref: 17 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.295612:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147135.295614:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147135.295616:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94e00, rc 0) 00000100:00100000:1.0:1746147135.295661:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32096:x1830967307801728:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 352us (511us total) trans 8589935828 rc 0/0 00000100:00100000:1.0:1746147135.295666:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15168 00000100:00100000:1.0:1746147135.301432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.301471:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.301486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.301499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.301519:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307801856 00000100:00100000:1.0:1746147135.301526:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307801856 00000100:00100000:1.0:1746147135.301574:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802112 00000100:00100000:1.0:1746147135.301577:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802112 00000100:00100000:1.0:1746147135.301589:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802368 00000100:00100000:1.0:1746147135.301592:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802368 00000100:00100000:1.0:1746147135.301602:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307801984 00000100:00100000:1.0:1746147135.301604:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307801984 00000100:00100000:1.0:1746147135.301618:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14114 00000100:00100000:1.0:1746147135.301625:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307801856:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147135.301669:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301687:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301694:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147135.301695:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147135.301698:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301731:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301744:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 26 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.301757:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132099500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310607744:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.301839:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.301859:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14115 00000100:00100000:1.0:1746147135.301864:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307802112:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147135.301882:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301892:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301899:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.301908:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301914:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.301915:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.301917:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301934:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.301941:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 7 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.301950:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310607872:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.301974:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.301981:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 10 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:1.0:1746147135.301987:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310608000:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.302003:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302010:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.302018:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310608128:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.302030:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.302051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.302066:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802240 00000100:00100000:1.0:1746147135.302070:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802240 00000100:00100000:1.0:1746147135.302120:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14116 00000100:00100000:1.0:1746147135.302125:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307802368:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147135.302140:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302148:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302157:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.302163:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302168:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302172:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147135.302173:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147135.302175:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302186:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302192:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 9 pid: 9585 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.302199:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608256:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.302219:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302225:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 26 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.302231:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608384:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.302248:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.302253:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 12 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:1.0:1746147135.302259:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608512:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.302274:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.302279:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 9 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.302284:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608640:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.302294:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.302345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.302466:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802496 00000100:00100000:2.0:1746147135.302470:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802496 00000100:00100000:2.0:1746147135.302485:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14117 00000100:00100000:2.0:1746147135.302489:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307801984:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147135.302503:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302511:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302516:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147135.302517:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147135.302519:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302532:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302539:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.302545:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310608768:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.302577:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147135.302589:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14118 00000100:00100000:2.0:1746147135.302594:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307802240:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147135.302607:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302616:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302622:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.302628:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302632:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.302633:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.302635:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302647:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302654:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 9 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.302660:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310608896:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.302680:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.302686:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746147135.302693:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310609024:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.302712:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302720:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 26 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.302726:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310609152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.302737:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147135.302751:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14119 00000100:00100000:2.0:1746147135.302756:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307802496:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147135.302769:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302777:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302782:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302788:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.302792:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.302797:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 7 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302801:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147135.302802:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147135.302804:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 8/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302817:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 7 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302824:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 7 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.302830:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609280:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.302850:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.302857:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746147135.302863:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609408:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.302893:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.302900:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746147135.302912:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609536:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.302932:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302938:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 7 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.302945:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609664:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.302963:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.302970:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 24 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.302977:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609792:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.302986:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147135.308451:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608256:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.308463:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608384:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.308472:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608512:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.308479:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310608640:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.308509:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.308540:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132099500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310607744:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147135.308549:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147135.308552:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310607872:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.308567:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310608000:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.308583:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310608128:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.308608:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.308891:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.308953:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802624 00000100:00100000:3.0:1746147135.308959:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802624 00000100:00100000:0.0:1746147135.308965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.308987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147135.309003:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 12 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746147135.309026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.309439:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310608768:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.309576:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147135.310127:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803008 00000100:00100000:3.0:1746147135.310132:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803008 00000100:00100000:2.0:1746147135.310145:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310608896:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147135.310153:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 25 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.310177:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803136 00000100:00100000:3.0:1746147135.310179:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803136 00010000:00010000:3.0:1746147135.310189:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 13 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746147135.310202:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802880 00000100:00100000:3.0:1746147135.310204:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802880 00010000:00010000:3.0:1746147135.310212:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 10 pid: 9585 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.310222:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6145 00000100:00100000:3.0:1746147135.310228:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307802624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.310240:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.310256:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 12 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.310264:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 12 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.310282:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99000/0x3139939425054d1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771a5 expref: 12 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.310298:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.310347:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6146 00000100:00100000:1.0:1746147135.310354:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307803008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.310361:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147135.310367:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 25 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.310374:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 25 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.310385:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425054b88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7709b expref: 25 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.310397:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.310574:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310609024:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.310586:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310609152:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.310602:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147135.310762:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307802624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 476us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.310765:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609280:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147135.310770:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6145 00000100:00100000:2.0:1746147135.310777:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609408:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.310784:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609536:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147135.310787:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6147 00000100:00100000:3.0:1746147135.310793:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307803136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.310801:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.310814:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 13 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.310822:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 13 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746147135.310830:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6148 00010000:00010000:3.0:1746147135.310838:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x31399394250550c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773b9 expref: 13 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746147135.310839:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307802880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.310848:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147135.310856:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147135.310964:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967307803008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 609us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.310969:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6146 00000100:00100000:3.0:1746147135.311046:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307803136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 253us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.311050:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6147 00000100:00100000:0.0:1746147135.311084:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.311167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.311202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.311220:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307802752 00000100:00100000:3.0:1746147135.311224:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307802752 00010000:00010000:3.0:1746147135.311237:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 8 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.311250:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6149 00000100:00100000:3.0:1746147135.311254:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307802752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147135.311257:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147135.311259:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.311266:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 8 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.311274:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 8 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746147135.311276:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147135.311284:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425054b8f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770a2 expref: 8 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746147135.311289:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147135.311291:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147135.311293:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147135.311297:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.311301:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803776 00010000:00010000:3.0:1746147135.311303:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.311305:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803776 00010000:00010000:3.0:1746147135.311322:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147135.311325:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 11 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746147135.311339:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803904 00000100:00100000:3.0:1746147135.311342:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307802752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.311342:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803904 00000100:00100000:3.0:1746147135.311346:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6149 00010000:00010000:0.0:1746147135.311352:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 8 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.311354:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804032 00000100:00100000:3.0:1746147135.311357:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804032 00000100:00100000:0.0:1746147135.311365:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6150 00010000:00010000:3.0:1746147135.311366:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746147135.311371:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307803776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147135.311376:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6151 00010000:00010000:0.0:1746147135.311378:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147135.311380:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307803904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.311386:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147135.311390:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 11 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.311394:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 7 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.311400:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 11 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.311402:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 7 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.311412:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093730e00/0x3139939425054f01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77293 expref: 7 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.311421:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425054ba4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b7 expref: 11 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.311425:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147135.311438:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.311440:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+6:2000:x1830967307803904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.311445:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6151 00000100:00100000:3.0:1746147135.311457:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6152 00000100:00100000:3.0:1746147135.311462:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307804032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147135.311463:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307803776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.311469:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6150 00000100:00100000:0.0:1746147135.311501:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.311510:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804160 00000100:00100000:0.0:1746147135.311512:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804160 00010000:00010000:0.0:1746147135.311521:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746147135.311530:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6153 00000100:00100000:0.0:1746147135.311535:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307804160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147135.311541:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147135.311550:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311556:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147135.311556:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311564:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746147135.311568:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x31399394250550cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773c0 expref: 11 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311572:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311583:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505506d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77373 expref: 24 pid: 9584 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746147135.311583:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147135.311591:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147135.311595:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307804160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.311599:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6153 00000100:00100000:3.0:1746147135.311608:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967307804032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 146us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.311613:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6152 00000100:00100000:0.0:1746147135.311632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.311635:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803392 00000100:00100000:3.0:1746147135.311638:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803392 00000100:00100000:3.0:1746147135.311659:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803520 00000100:00100000:3.0:1746147135.311661:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803520 00010000:00010000:3.0:1746147135.311670:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746147135.311688:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6154 00000100:00100000:3.0:1746147135.311691:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307803520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.311697:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.311703:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311709:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311718:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425054d25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771ac expref: 12 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746147135.311726:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.311739:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307803520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.311744:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6154 00002000:00100000:3.0:1746147135.311776:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1097727) req@ffff8800a4998e00 x1830967307803392/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.311784:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998e00 with x1830967307803392 ext(1048576->1097727) 00010000:00010000:3.0:1746147135.311789:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 23 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.311793:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803264 00010000:00010000:3.0:1746147135.311796:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 23 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.311797:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803264 00002000:00010000:3.0:1746147135.311805:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4998e00 00000100:00100000:3.0:1746147135.311816:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1047 00000100:00100000:3.0:1746147135.311820:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967307803392:12345-192.168.204.25@tcp:4:cat.0 00002000:00100000:1.0:1746147135.311821:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (57344->1048575) req@ffff8800a499a300 x1830967307803264/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/0 e 0 to 0 dl 1746147146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147135.311834:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499a300 with x1830967307803264 ext(57344->1048575) 00010000:00010000:1.0:1746147135.311841:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.311849:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746147135.311855:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a499a300 00000100:00100000:1.0:1746147135.311868:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1048 00000100:00100000:1.0:1746147135.311873:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307803264:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147135.311913:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609664:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147135.311922:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310609792:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147135.311943:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.311958:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.311963:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.311975:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.311981:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.311988:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.311993:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e0200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147135.311996:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.312002:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.312009:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.312020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147135.312027:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0200/0x3139939425055107 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.312031:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804416 00000100:00100000:1.0:1746147135.312033:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804416 00010000:00010000:1.0:1746147135.312043:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 25 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.312067:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6155 00000100:00100000:1.0:1746147135.312073:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307804416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.312110:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147135.312116:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307802112:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 10251us (10644us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147135.312118:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 25 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.312124:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14115 00010000:00010000:1.0:1746147135.312126:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 25 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.312141:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425054eb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77262 expref: 25 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.312151:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.312164:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967307804416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.312169:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6155 00010000:00010000:2.0:1746147135.313098:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 9 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.313110:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 9 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.313122:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05200/0x3139939425054f4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4198400->4919295) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e772c4 expref: 9 pid: 9585 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.313148:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.313166:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307802880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2329us (4138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.313172:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6148 00000100:00100000:1.0:1746147135.313318:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.313337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.313348:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804288 00000100:00100000:1.0:1746147135.313359:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804288 00010000:00010000:1.0:1746147135.313374:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 29 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.313390:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307803648 00000100:00100000:1.0:1746147135.313392:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307803648 00010000:00010000:1.0:1746147135.313400:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 30 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.313412:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6156 00000100:00100000:1.0:1746147135.313417:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307804288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.313424:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147135.313434:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 30 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313441:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 30 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313454:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425054b9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e770b0 expref: 30 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313463:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.313465:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.313469:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313477:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313496:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.313507:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307804288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.313512:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6156 00000100:00100000:1.0:1746147135.313524:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6157 00000100:00100000:1.0:1746147135.313529:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307803648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.313534:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147135.313540:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 28 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313547:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 28 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313557:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425055043 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77349 expref: 28 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313568:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.313577:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307803648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.313581:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6157 00000100:00100000:1.0:1746147135.313625:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.313635:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804544 00000100:00100000:1.0:1746147135.313638:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804544 00010000:00010000:1.0:1746147135.313647:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 6 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.313661:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6158 00000100:00100000:1.0:1746147135.313664:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+6:2000:x1830967307804544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147135.313672:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147135.313679:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 6 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313686:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 6 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313696:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974a7c00/0x313993942505505f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77365 expref: 6 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746147135.313704:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.313705:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.313707:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313717:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313728:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147135.313738:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967307804544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.313742:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6158 00010000:00010000:3.0:1746147135.313768:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313768:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313775:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313778:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313789:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313796:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313797:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313803:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313803:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313809:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313809:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147135.313812:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313815:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147135.313818:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313824:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313824:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313833:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313836:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147135.313839:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425055123 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.313841:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc000/0x313993942505511c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147135.313872:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307802496:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 11116us (11527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.313885:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14119 00000100:00100000:3.0:1746147135.313887:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307802240:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 11290us (11832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.313894:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14118 00000100:00100000:0.0:1746147135.314966:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.315020:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804672 00000100:00100000:2.0:1746147135.315025:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804672 00010000:00010000:2.0:1746147135.315048:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 8 pid: 9584 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.315107:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6159 00000100:00100000:2.0:1746147135.315114:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307804672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147135.315123:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147135.315136:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 8 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.315144:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 8 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.315159:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x313993942505503c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77342 expref: 8 pid: 9584 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.315170:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.315171:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.315175:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.315187:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.315218:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.315244:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307804672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 131us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.315250:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6159 00010000:00010000:0.0:1746147135.315311:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315319:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315333:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315339:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315345:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315350:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f29e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147135.315353:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315358:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315368:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.315373:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f29e00/0x313993942505510e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.315411:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307802368:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 13284us (13923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.315418:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14116 00000100:00100000:3.0:1746147135.322281:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307803392:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10451us (11197us total) trans 21474841381 rc 0/0 00000100:00100000:3.0:1746147135.322292:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1047 00002000:00100000:3.0:1746147135.322303:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1097727) req@ffff8800a4998e00 x1830967307803392/t21474841381(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/448 e 0 to 0 dl 1746147146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147135.322312:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998e00 with x1830967307803392 ext(1048576->1097727) 00010000:00010000:3.0:1746147135.322321:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.322338:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:3.0:1746147135.322345:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4998e00 00000100:00100000:2.0:1746147135.327846:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307803264:12345-192.168.204.25@tcp:4:cat.0 Request processed in 15957us (16628us total) trans 17179874110 rc 0/0 00000100:00100000:2.0:1746147135.327861:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1048 00002000:00100000:2.0:1746147135.327875:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (57344->1048575) req@ffff8800a499a300 x1830967307803264/t17179874110(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:511/0 lens 488/448 e 0 to 0 dl 1746147146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147135.327886:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499a300 with x1830967307803264 ext(57344->1048575) 00010000:00010000:2.0:1746147135.327897:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.327912:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:2.0:1746147135.327921:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a499a300 00000100:00100000:0.0:1746147135.329853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.330470:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804800 00000100:00100000:2.0:1746147135.330481:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804800 00010000:00010000:2.0:1746147135.330522:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.330576:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6160 00000100:00100000:2.0:1746147135.330585:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307804800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147135.330610:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147135.330630:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.330645:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.330668:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055051 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77357 expref: 24 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.330682:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.330684:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.330689:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330697:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330724:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.330783:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967307804800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 199us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.330789:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6160 00010000:00010000:2.0:1746147135.330813:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330821:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330835:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330842:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330848:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330854:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ffc600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147135.330858:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330866:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330875:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.330880:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425055115 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147135.330923:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2003:x1830967307801984:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 28432us (29422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.330930:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14117 00000100:00100000:0.0:1746147135.331069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.331259:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307804928 00000100:00100000:3.0:1746147135.331263:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307804928 00010000:00010000:3.0:1746147135.331281:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.331299:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6161 00000100:00100000:3.0:1746147135.331304:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307804928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147135.331311:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.331325:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.331334:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.331346:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6400/0x313993942505504a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 57344->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77350 expref: 27 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.331358:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147135.331359:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147135.331362:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.331373:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.331395:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.331413:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307804928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.331418:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6161 00010000:00010000:0.0:1746147135.331432:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331444:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331469:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331476:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331482:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331491:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e572a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147135.331495:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331501:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331515:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.331521:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425055100 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147135.332372:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307801856:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 30742us (30945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.332381:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14114 00000100:00100000:0.0:1746147135.336943:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.339710:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307805184 00000100:00100000:2.0:1746147135.339720:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307805184 00000100:00100000:2.0:1746147135.339845:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15169 00000100:00100000:2.0:1746147135.339853:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32096:x1830967307805184:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147135.339897:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746147135.339937:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425054d72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e771cf expref: 17 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.339958:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425054a70 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fe5 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.339967:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.339971:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147135.339992:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.340001:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340008:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340014:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 50 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340019:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340304:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340310:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340316:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 9/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.340341:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340351:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.340362:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.340436:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340443:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.340451:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610176:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.340473:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340479:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 31 pid: 6215 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.340486:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.340502:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 50 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340508:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 50 pid: 6215 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.340514:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610432:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.340530:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340537:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 31 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.340544:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610560:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147135.340862:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 50 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.340870:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.340877:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610688:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.340900:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147135.340940:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147135.340951:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310609920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147135.341120:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.341197:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310609920 00000100:00100000:2.0:1746147135.341201:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310609920 00000100:00100000:2.0:1746147135.341235:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1746147135.341240:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310609920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746147135.341256:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1169278016 pending 2207744 free 3904991232 avail 3673468928 00000100:00100000:2.0:1746147135.341291:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310609920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.341297:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00080000:0.0:1746147135.341358:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147135.341383:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310609920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746147135.344029:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610048:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.344042:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610176:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.344049:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610304:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147135.344056:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610432:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147135.345346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.345382:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.345424:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307805312 00000100:00100000:3.0:1746147135.345436:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307805312 00010000:00010000:3.0:1746147135.345475:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 32 pid: 6215 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746147135.345511:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6162 00000100:00100000:1.0:1746147135.345512:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307805568 00000100:00100000:2.0:1746147135.345515:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610560:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147135.345517:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307805568 00000100:00100000:3.0:1746147135.345520:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2003:x1830967307805312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147135.345524:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310610688:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147135.345535:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147135.345541:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 32 pid: 6215 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.345552:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 32 pid: 6215 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746147135.345552:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5402 00000100:00100000:1.0:1746147135.345558:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:30600:x1830967307805568:12345-192.168.204.25@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746147135.345562:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.345574:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730800/0x3139939425054a85 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76ffa expref: 32 pid: 6215 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746147135.345593:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147135.345598:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.345608:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147135.345667:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:2003:x1830967307805312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 147us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.345673:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6162 00000100:00100000:1.0:1746147135.345740:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:30600:x1830967307805568:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 181us (357us total) trans 8589935829 rc 0/0 00000100:00100000:1.0:1746147135.345747:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5402 00000100:00100000:2.0:1746147135.345987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.346012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.346026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.346036:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806080 00000100:00100000:1.0:1746147135.346039:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806080 00000100:00100000:2.0:1746147135.346046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.346064:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5403 00000100:00100000:1.0:1746147135.346069:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+31:30749:x1830967307806080:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147135.346211:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307805824 00000100:00100000:2.0:1746147135.346217:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307805824 00010000:00010000:2.0:1746147135.346249:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 52 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.346271:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307805696 00000100:00100000:2.0:1746147135.346274:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307805696 00010000:00010000:2.0:1746147135.346284:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 32 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.346296:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806208 00000100:00100000:2.0:1746147135.346298:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806208 00010000:00010000:2.0:1746147135.346304:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 53 pid: 6215 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.346325:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6163 00000100:00100000:2.0:1746147135.346331:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2003:x1830967307805824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147135.346341:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147135.346346:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 53 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.346355:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 53 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.346371:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425054e52 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7723f expref: 53 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.346386:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.346390:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.346397:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147135.346397:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6164 00000100:00100000:0.0:1746147135.346406:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+32:2003:x1830967307805696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147135.346415:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147135.346418:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6165 00010000:00010000:0.0:1746147135.346421:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 32 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.346424:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967307806208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147135.346430:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 32 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.346431:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147135.346436:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 52 pid: 6215 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.346442:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81000/0x3139939425054e75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77246 expref: 32 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.346443:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 52 pid: 6215 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.346453:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x3139939425054a5b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e76fd7 expref: 52 pid: 6215 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746147135.346457:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147135.346460:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147135.346466:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147135.346471:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.346475:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.346479:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.346569:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2003:x1830967307806208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 144us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.346576:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6165 00000100:00100000:1.0:1746147135.346585:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+32:30749:x1830967307806080:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 514us (598us total) trans 8589935830 rc 0/0 00000100:00100000:1.0:1746147135.346592:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5403 00000100:00100000:2.0:1746147135.346604:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307805824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 274us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.346608:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6163 00000100:00100000:0.0:1746147135.346646:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2003:x1830967307805696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 241us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.346652:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6164 00000100:00100000:0.0:1746147135.350675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.350978:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806336 00000100:00100000:2.0:1746147135.350988:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806336 00000100:00100000:0.0:1746147135.350994:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147135.351024:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.351050:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806464 00000100:00100000:2.0:1746147135.351053:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806464 00010000:00010000:2.0:1746147135.351064:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746147135.351121:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6166 00000100:00100000:2.0:1746147135.351129:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967307806336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147135.351144:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147135.351148:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.351158:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.351181:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f391400/0x3139939425054c29 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77112 expref: 50 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.351195:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.351200:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.351209:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.351270:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2000:x1830967307806336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 141us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.351276:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6166 00000100:00100000:2.0:1746147135.351290:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6167 00000100:00100000:2.0:1746147135.351294:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967307806464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147135.351301:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147135.351304:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.351316:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.351327:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425054ca0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77151 expref: 31 pid: 16099 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746147135.351334:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.351342:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.351349:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.351356:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147135.351376:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147135.351390:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967307806464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.351395:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6167 00010000:00010000:3.0:1746147135.351448:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.351457:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000040:00080000:3.0:1746147135.351925:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].505, 88 off52496 00000004:00080000:3.0:1746147135.351946:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673341856102ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352029:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].451, 88 off47736 00000004:00080000:3.0:1746147135.352035:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673341945852ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352054:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].452, 88 off47824 00000004:00080000:3.0:1746147135.352057:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673341967160ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352066:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].506, 88 off52584 00000004:00080000:3.0:1746147135.352068:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673341978650ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352085:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].507, 88 off52672 00000004:00080000:3.0:1746147135.352128:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342038101ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352140:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].453, 88 off47912 00000004:00080000:3.0:1746147135.352143:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673342053319ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352150:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].454, 88 off48000 00000004:00080000:3.0:1746147135.352151:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673342062081ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352159:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].455, 88 off48088 00000004:00080000:3.0:1746147135.352161:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673342071587ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352201:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].508, 88 off52760 00000004:00080000:3.0:1746147135.352205:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342115356ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352214:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].456, 88 off48176 00000004:00080000:3.0:1746147135.352217:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673342127360ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352223:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].509, 88 off52848 00000004:00080000:3.0:1746147135.352225:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342135857ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352234:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].457, 88 off48264 00000004:00080000:3.0:1746147135.352236:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673342146484ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147135.352242:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].510, 88 off52936 00000004:00080000:3.0:1746147135.352244:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342154700ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352252:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].511, 88 off53024 00000004:00080000:3.0:1746147135.352255:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342166030ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352263:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].512, 88 off53112 00000004:00080000:3.0:1746147135.352266:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342176292ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352274:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].513, 88 off53200 00000004:00080000:3.0:1746147135.352276:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673342186792ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147135.352284:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].458, 88 off48352 00000004:00080000:3.0:1746147135.352286:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673342196204ns, next at 554081490131ns, rc = 0 00000001:00080000:0.0:1746147135.356893:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935831 is committed 00000004:00080000:0.0:1746147135.356907:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 454 committed 00010000:00010000:2.0:1746147135.356936:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.356951:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.356959:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.356966:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12cc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147135.356971:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.356982:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.356999:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.357002:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147135.357006:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.357011:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425054a62 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000004:00080000:0.0:1746147135.357399:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 506 committed 00000004:00080000:0.0:1746147135.357416:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 505 committed 00000004:00080000:0.0:1746147135.357418:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 504 committed 00000004:00080000:0.0:1746147135.357419:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 503 committed 00000004:00080000:0.0:1746147135.357421:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 453 committed 00000004:00080000:0.0:1746147135.357423:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 502 committed 00000004:00080000:0.0:1746147135.357425:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 452 committed 00000004:00080000:0.0:1746147135.357427:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 501 committed 00000004:00080000:0.0:1746147135.357428:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 451 committed 00000004:00080000:0.0:1746147135.357430:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 450 committed 00000004:00080000:0.0:1746147135.357431:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 449 committed 00000004:00080000:0.0:1746147135.357433:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 500 committed 00000004:00080000:0.0:1746147135.357434:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 499 committed 00000004:00080000:0.0:1746147135.357435:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 448 committed 00000004:00080000:0.0:1746147135.357437:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 447 committed 00000004:00080000:0.0:1746147135.357438:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 498 committed 00000001:00080000:0.0:1746147135.357443:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935830 is committed 00000001:00080000:0.0:1746147135.357448:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935829 is committed 00000100:00100000:2.0:1746147135.357622:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147135.357639:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310610816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.357710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.357757:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310610816 00000100:00100000:2.0:1746147135.357764:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310610816 00000100:00100000:2.0:1746147135.357810:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14120 00000100:00100000:2.0:1746147135.357817:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310610816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.357977:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3766:x1830967310610816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (266us total) trans 17179874111 rc 0/0 00000100:00100000:2.0:1746147135.357983:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14120 00000100:00080000:2.0:1746147135.358002:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147135.358084:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310610944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.358110:0:3766:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874097 gen 2 00000004:00080000:2.0:1746147135.358115:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099889500, transno 17179874021 00000004:00080000:2.0:1746147135.358121:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099888e00, transno 17179874022 00000100:00100000:1.0:1746147135.358121:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147135.358123:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094534700, transno 17179874023 00000004:00080000:2.0:1746147135.358126:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094534e00, transno 17179874024 00000004:00080000:2.0:1746147135.358128:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988b800, transno 17179874025 00000004:00080000:2.0:1746147135.358130:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094535f80, transno 17179874026 00000004:00080000:2.0:1746147135.358133:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094535880, transno 17179874027 00000004:00080000:2.0:1746147135.358136:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098820a80, transno 17179874028 00000004:00080000:2.0:1746147135.358138:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094537b80, transno 17179874029 00000004:00080000:2.0:1746147135.358140:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011da9f800, transno 17179874034 00000004:00080000:2.0:1746147135.358143:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5c00, transno 17179874035 00000004:00080000:2.0:1746147135.358145:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094536a00, transno 17179874036 00000004:00080000:2.0:1746147135.358148:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6d80, transno 17179874037 00000004:00080000:2.0:1746147135.358150:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011da9ce00, transno 17179874038 00000004:00080000:2.0:1746147135.358152:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5180, transno 17179874039 00000004:00080000:2.0:1746147135.358155:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094536d80, transno 17179874040 00000004:00080000:2.0:1746147135.358157:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4000, transno 17179874041 00000004:00080000:2.0:1746147135.358159:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988b100, transno 17179874042 00000004:00080000:2.0:1746147135.358161:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ed80, transno 17179874043 00000004:00080000:2.0:1746147135.358163:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897c000, transno 17179874044 00000004:00080000:2.0:1746147135.358165:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ce00, transno 17179874045 00000004:00080000:2.0:1746147135.358167:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897c380, transno 17179874046 00000004:00080000:2.0:1746147135.358169:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ca80, transno 17179874047 00000004:00080000:2.0:1746147135.358171:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ea00, transno 17179874048 00000004:00080000:2.0:1746147135.358174:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897d500, transno 17179874049 00000004:00080000:2.0:1746147135.358176:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009885aa00, transno 17179874050 00000004:00080000:2.0:1746147135.358178:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897c700, transno 17179874051 00000004:00080000:2.0:1746147135.358181:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097096680, transno 17179874058 00000004:00080000:2.0:1746147135.358183:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097b80, transno 17179874059 00000004:00080000:2.0:1746147135.358185:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095500, transno 17179874060 00000004:00080000:2.0:1746147135.358187:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095c00, transno 17179874061 00000004:00080000:2.0:1746147135.358188:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095880, transno 17179874062 00000004:00080000:2.0:1746147135.358190:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097094a80, transno 17179874063 00000004:00080000:2.0:1746147135.358192:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097094e00, transno 17179874064 00000004:00080000:2.0:1746147135.358194:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097096300, transno 17179874065 00000004:00080000:2.0:1746147135.358197:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097800, transno 17179874066 00000004:00080000:2.0:1746147135.358200:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca23b80, transno 17179874067 00000004:00080000:2.0:1746147135.358202:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21c00, transno 17179874068 00000004:00080000:2.0:1746147135.358204:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca22680, transno 17179874069 00000004:00080000:2.0:1746147135.358206:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca22a00, transno 17179874070 00000004:00080000:2.0:1746147135.358208:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70700, transno 17179874071 00000004:00080000:2.0:1746147135.358210:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca22d80, transno 17179874072 00000004:00080000:2.0:1746147135.358212:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca23100, transno 17179874073 00000004:00080000:2.0:1746147135.358214:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21500, transno 17179874074 00000004:00080000:2.0:1746147135.358216:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70a80, transno 17179874075 00000004:00080000:2.0:1746147135.358218:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a1f80, transno 17179874079 00000004:00080000:2.0:1746147135.358220:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a3800, transno 17179874080 00000004:00080000:2.0:1746147135.358222:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f085f80, transno 17179874081 00000004:00080000:2.0:1746147135.358224:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a3480, transno 17179874082 00000004:00080000:2.0:1746147135.358226:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a2300, transno 17179874083 00000004:00080000:2.0:1746147135.358228:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f085180, transno 17179874084 00000004:00080000:2.0:1746147135.358230:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd46680, transno 17179874085 00000004:00080000:2.0:1746147135.358232:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f086d80, transno 17179874086 00000004:00080000:2.0:1746147135.358233:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0000, transno 17179874087 00000004:00080000:2.0:1746147135.358235:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72300, transno 17179874089 00000004:00080000:2.0:1746147135.358238:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70000, transno 17179874090 00000004:00080000:2.0:1746147135.358240:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c71f80, transno 17179874091 00000004:00080000:2.0:1746147135.358242:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9880, transno 17179874092 00000004:00080000:2.0:1746147135.358244:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011da9d180, transno 17179874093 00000004:00080000:2.0:1746147135.358246:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ea680, transno 17179874094 00000004:00080000:2.0:1746147135.358248:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70e00, transno 17179874095 00000004:00080000:2.0:1746147135.358250:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011da9e680, transno 17179874096 00000004:00080000:2.0:1746147135.358252:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151180, transno 17179874097 00000100:00100000:2.0:1746147135.358258:0:3766:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880094529180 x1830967310610816/t17179874111(17179874111) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147151 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746147135.358266:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094529180/2, rc 0, transno 17179874111 00000100:00100000:1.0:1746147135.358267:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.358271:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310610816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.358279:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310611200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.358285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.358295:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.358298:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147135.358302:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.358306:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310611712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.358315:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.358578:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.358594:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.358680:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310610944 00000100:00100000:2.0:1746147135.358687:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310610944 00000100:00100000:1.0:1746147135.358690:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147135.358706:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611456 00000100:00100000:2.0:1746147135.358708:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611456 00000100:00100000:1.0:1746147135.358708:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.358718:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611200 00000100:00100000:2.0:1746147135.358719:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611200 00000100:00100000:1.0:1746147135.358719:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310612480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147135.358728:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611072 00000100:00100000:2.0:1746147135.358730:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611072 00000100:00100000:1.0:1746147135.358731:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.358740:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611584 00000100:00100000:1.0:1746147135.358741:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147135.358742:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611584 00000100:00100000:1.0:1746147135.358745:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310612096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147135.358748:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611968 00000100:00100000:2.0:1746147135.358750:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611968 00000100:00100000:1.0:1746147135.358757:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.358760:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612480 00000100:00100000:2.0:1746147135.358762:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612480 00000100:00100000:1.0:1746147135.358763:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310612608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147135.358768:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612096 00000100:00100000:2.0:1746147135.358770:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612096 00000100:00100000:1.0:1746147135.358775:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.358777:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14121 00000100:00100000:2.0:1746147135.358782:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967310610944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.358794:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612608 00000100:00100000:1.0:1746147135.358796:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612608 00000100:00100000:1.0:1746147135.358810:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14122 00000100:00100000:1.0:1746147135.358814:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967310611456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.358855:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967310610944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (733us total) trans 17179874112 rc 0/0 00000100:00100000:2.0:1746147135.358861:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14121 00000100:00100000:1.0:1746147135.358863:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967310611456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (577us total) trans 17179874113 rc 0/0 00000100:00100000:1.0:1746147135.358869:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14122 00000100:00100000:2.0:1746147135.358871:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14123 00000100:00100000:2.0:1746147135.358875:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3766:x1830967310611200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.358876:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14124 00000100:00100000:1.0:1746147135.358879:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967310611072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.358922:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967310611200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (626us total) trans 17179874114 rc 0/0 00000100:00100000:2.0:1746147135.358927:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14123 00000100:00100000:2.0:1746147135.358936:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14125 00000100:00100000:2.0:1746147135.358939:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967310611584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147135.358977:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147135.358980:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147135.358982:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147135.358983:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147135.358985:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147135.359001:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967310611584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (405us total) trans 17179874115 rc 0/0 00000100:00100000:2.0:1746147135.359005:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14125 00000100:00100000:2.0:1746147135.359013:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14126 00000100:00100000:2.0:1746147135.359017:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3764:x1830967310611968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147135.359052:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967310611072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (736us total) trans 17179874116 rc 0/0 00000100:00100000:1.0:1746147135.359058:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14124 00000100:00100000:1.0:1746147135.359066:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14127 00000100:00100000:1.0:1746147135.359070:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3764:x1830967310612480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147135.359107:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3764:x1830967310611968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (397us total) trans 21474841382 rc 0/0 00000100:00100000:2.0:1746147135.359111:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14126 00000100:00100000:2.0:1746147135.359120:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14128 00000100:00100000:2.0:1746147135.359124:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3764:x1830967310612096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147135.359135:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147135.359138:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147135.359140:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147135.359141:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147135.359143:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147135.359160:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967310612480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (428us total) trans 21474841383 rc 0/0 00000100:00100000:2.0:1746147135.359163:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967310612096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (405us total) trans 21474841384 rc 0/0 00000100:00100000:1.0:1746147135.359165:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14127 00000100:00100000:2.0:1746147135.359167:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14128 00000100:00100000:1.0:1746147135.359173:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14129 00000100:00100000:1.0:1746147135.359177:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3764:x1830967310612608:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746147135.359181:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147135.359225:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3764:x1830967310612608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (449us total) trans 21474841385 rc 0/0 00000100:00100000:1.0:1746147135.359231:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14129 00000100:00100000:1.0:1746147135.359257:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841368 gen 2 00000004:00080000:1.0:1746147135.359261:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd44a80, transno 21474841282 00000004:00080000:1.0:1746147135.359267:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd45c00, transno 21474841283 00000004:00080000:1.0:1746147135.359269:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd45f80, transno 21474841284 00000004:00080000:1.0:1746147135.359272:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd47800, transno 21474841285 00000004:00080000:1.0:1746147135.359275:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098e10000, transno 21474841291 00000004:00080000:1.0:1746147135.359277:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfb480, transno 21474841292 00000004:00080000:1.0:1746147135.359280:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013486a300, transno 21474841293 00000004:00080000:1.0:1746147135.359281:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfb800, transno 21474841294 00000004:00080000:1.0:1746147135.359283:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134868700, transno 21474841295 00000004:00080000:1.0:1746147135.359286:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3dc00, transno 21474841296 00000004:00080000:1.0:1746147135.359288:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098e11880, transno 21474841297 00000004:00080000:1.0:1746147135.359291:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfad80, transno 21474841298 00000004:00080000:1.0:1746147135.359294:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305f0380, transno 21474841303 00000004:00080000:1.0:1746147135.359296:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321f80, transno 21474841304 00000004:00080000:1.0:1746147135.359298:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e320700, transno 21474841305 00000004:00080000:1.0:1746147135.359300:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e323b80, transno 21474841306 00000004:00080000:1.0:1746147135.359302:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305f0000, transno 21474841307 00000004:00080000:1.0:1746147135.359304:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321c00, transno 21474841308 00000004:00080000:1.0:1746147135.359306:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321500, transno 21474841309 00000004:00080000:1.0:1746147135.359307:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e323480, transno 21474841310 00000004:00080000:1.0:1746147135.359310:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8380, transno 21474841311 00000004:00080000:1.0:1746147135.359312:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8000, transno 21474841312 00000004:00080000:1.0:1746147135.359314:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e8e00, transno 21474841313 00000004:00080000:1.0:1746147135.359317:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ebb80, transno 21474841314 00000100:00100000:0.0:1746147135.359317:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310611328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147135.359319:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9c00, transno 21474841315 00000004:00080000:1.0:1746147135.359321:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e9180, transno 21474841316 00000004:00080000:1.0:1746147135.359323:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ead80, transno 21474841317 00000004:00080000:1.0:1746147135.359326:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ea300, transno 21474841318 00000004:00080000:1.0:1746147135.359329:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8700, transno 21474841332 00000004:00080000:1.0:1746147135.359331:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c30bb80, transno 21474841333 00000004:00080000:1.0:1746147135.359333:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9880, transno 21474841334 00000004:00080000:1.0:1746147135.359336:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55c00, transno 21474841335 00000004:00080000:1.0:1746147135.359339:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57b80, transno 21474841336 00000004:00080000:1.0:1746147135.359341:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c30aa00, transno 21474841337 00000004:00080000:1.0:1746147135.359344:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57480, transno 21474841338 00000004:00080000:1.0:1746147135.359346:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8380, transno 21474841339 00000100:00100000:0.0:1746147135.359346:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147135.359349:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155c00, transno 21474841340 00000004:00080000:1.0:1746147135.359351:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca21180, transno 21474841341 00000004:00080000:1.0:1746147135.359353:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154700, transno 21474841342 00000004:00080000:1.0:1746147135.359356:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157100, transno 21474841343 00000004:00080000:1.0:1746147135.359358:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154a80, transno 21474841344 00000004:00080000:1.0:1746147135.359360:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca20a80, transno 21474841345 00000004:00080000:1.0:1746147135.359362:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca20700, transno 21474841346 00000004:00080000:1.0:1746147135.359365:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155180, transno 21474841347 00000004:00080000:1.0:1746147135.359367:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155880, transno 21474841352 00000004:00080000:1.0:1746147135.359368:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157480, transno 21474841353 00000004:00080000:1.0:1746147135.359370:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154e00, transno 21474841354 00000004:00080000:1.0:1746147135.359371:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157b80, transno 21474841355 00000004:00080000:1.0:1746147135.359373:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155f80, transno 21474841356 00000004:00080000:1.0:1746147135.359376:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062a00, transno 21474841357 00000004:00080000:1.0:1746147135.359380:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156300, transno 21474841358 00000004:00080000:1.0:1746147135.359382:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062300, transno 21474841359 00000004:00080000:1.0:1746147135.359385:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14a80, transno 21474841361 00000004:00080000:1.0:1746147135.359388:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e9880, transno 21474841362 00000004:00080000:1.0:1746147135.359390:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f54a80, transno 21474841363 00000004:00080000:1.0:1746147135.359392:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db15880, transno 21474841364 00000004:00080000:1.0:1746147135.359395:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55f80, transno 21474841365 00000004:00080000:1.0:1746147135.359397:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db16680, transno 21474841366 00000004:00080000:1.0:1746147135.359399:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14380, transno 21474841367 00000004:00080000:1.0:1746147135.359400:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e9f80, transno 21474841368 00000100:00100000:1.0:1746147135.359405:0:3764:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801323d7800 x1830967310612096/t21474841384(21474841384) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147151 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147135.359416:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801323d7800/2, rc 0, transno 21474841384 00000100:00100000:1.0:1746147135.359419:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310612096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147135.359419:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310611840:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147135.359428:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095234700/2, rc 0, transno 21474841385 00000100:00100000:0.0:1746147135.359437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147135.359448:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147135.359460:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310612608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147135.359460:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147135.359472:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094537800/2, rc 0, transno 21474841382 00000100:00100000:0.0:1746147135.359473:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147135.359475:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147135.359477:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147135.359481:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf9880/2, rc 0, transno 21474841383 00000100:00100000:1.0:1746147135.359483:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310612480:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147135.359490:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094528000/2, rc 0, transno 17179874116 00000100:00100000:0.0:1746147135.359491:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.359493:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147135.359499:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094527800/2, rc 0, transno 17179874115 00000100:00100000:1.0:1746147135.359502:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147135.359508:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009452b800/2, rc 0, transno 17179874112 00000100:00100000:1.0:1746147135.359510:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310610944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147135.359514:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147135.359515:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524a80/2, rc 0, transno 17179874113 00000100:00100000:1.0:1746147135.359518:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310611456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.359527:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611328 00000100:00100000:0.0:1746147135.359529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.359530:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611328 00000100:00100000:1.0:1746147135.359540:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611840 00000100:00100000:1.0:1746147135.359542:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611840 00000100:00100000:0.0:1746147135.359547:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612352 00000100:00100000:1.0:1746147135.359548:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612224 00000100:00100000:1.0:1746147135.359549:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612224 00000100:00100000:0.0:1746147135.359550:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612352 00000100:00100000:1.0:1746147135.359555:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612736 00000100:00100000:1.0:1746147135.359556:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612736 00000100:00100000:1.0:1746147135.359563:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14130 00000100:00100000:1.0:1746147135.359566:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3767:x1830967310611328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147135.359570:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14131 00000100:00100000:0.0:1746147135.359575:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967310611840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147135.359597:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:1.0:1746147135.359600:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:1.0:1746147135.359602:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147135.359603:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147135.359605:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:1.0:1746147135.359625:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967310611328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (279us total) trans 17179874117 rc 0/0 00000100:00100000:1.0:1746147135.359630:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14130 00000100:00100000:1.0:1746147135.359639:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14132 00000100:00100000:1.0:1746147135.359643:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310612224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147135.359648:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310611840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (209us total) trans 21474841386 rc 0/0 00000100:00100000:0.0:1746147135.359655:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14131 00000100:00100000:0.0:1746147135.359666:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14133 00000100:00100000:0.0:1746147135.359671:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967310612736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147135.359686:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147135.359692:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147135.359694:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147135.359695:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147135.359697:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147135.359712:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14134 00000100:00100000:1.0:1746147135.359715:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310612224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (223us total) trans 21474841387 rc 0/0 00000100:00100000:2.0:1746147135.359717:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310612352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147135.359719:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14132 00000100:00100000:0.0:1746147135.359723:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310612736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (193us total) trans 21474841388 rc 0/0 00000100:00100000:0.0:1746147135.359728:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14133 00000004:00080000:0.0:1746147135.359747:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801323d6d80/2, rc 0, transno 21474841387 00000100:00100000:0.0:1746147135.359750:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147135.359755:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098823100/2, rc 0, transno 21474841388 00000100:00100000:0.0:1746147135.359757:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612736:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147135.359763:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132099500/2, rc 0, transno 17179874117 00000100:00100000:0.0:1746147135.359765:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310611328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147135.359770:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310612352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (308us total) trans 21474841389 rc 0/0 00000004:00080000:0.0:1746147135.359771:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094535500/2, rc 0, transno 21474841386 00000100:00100000:0.0:1746147135.359773:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310611840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147135.359775:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14134 00000004:00080000:0.0:1746147135.359779:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988ad80/2, rc 0, transno 21474841389 00000100:00100000:0.0:1746147135.359782:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612352:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147135.359977:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 60 done 00000004:00080000:3.0:1746147135.361294:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 2 in flight, 63 done 00000100:00100000:3.0:1746147135.361347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147135.361391:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310611712 00000100:00100000:3.0:1746147135.361397:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310611712 00000100:00100000:3.0:1746147135.361434:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14135 00000100:00100000:3.0:1746147135.361441:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3766:x1830967310611712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147135.361516:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:3.0:1746147135.361519:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147135.361521:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147135.361523:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147135.361525:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:3.0:1746147135.361564:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310611712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (218us total) trans 17179874118 rc 0/0 00000100:00100000:3.0:1746147135.361570:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14135 00000004:00010000:3.0:1746147135.361612:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098859f80 reply state ffff88012e20e400 transno 8589935831 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361631:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361640:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147135.361643:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746147135.361646:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147135.361715:0:7238:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147135.361727:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32096:x1830967307805184:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 21874us (24791us total) trans 8589935831 rc 0/0 00000100:00100000:3.0:1746147135.361733:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15169 00010000:00010000:3.0:1746147135.361754:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361761:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361768:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361773:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38ce00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147135.361777:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361783:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361795:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147135.361797:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147135.361800:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147135.361804:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x313993942505512a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147135.362404:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147135.362438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.362473:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612864 00000100:00100000:1.0:1746147135.362479:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612864 00000100:00100000:1.0:1746147135.362503:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14136 00000100:00100000:1.0:1746147135.362508:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310612864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147135.362593:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310612864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (154us total) trans 17179874119 rc 0/0 00000100:00100000:1.0:1746147135.362599:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14136 00000004:00080000:0.0:1746147135.363632:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098820a80/2, rc 0, transno 17179874119 00000100:00100000:0.0:1746147135.363639:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310612864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147135.365731:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525880/2, rc 0, transno 17179874118 00000100:00100000:3.0:1746147135.365745:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310611712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147135.365765:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009452b100/2, rc 0, transno 17179874114 00000100:00100000:3.0:1746147135.365768:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310611200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147135.366337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147135.366391:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806592 00000100:00100000:3.0:1746147135.366397:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806592 00000100:00100000:3.0:1746147135.366440:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15170 00000100:00100000:3.0:1746147135.366447:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32096:x1830967307806592:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147135.366470:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147135.366493:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773d5 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.366551:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.366564:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147135.366579:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147135.366582:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147135.366586:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79ac00, rc 0) 00000100:00100000:3.0:1746147135.366631:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32096:x1830967307806592:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 184us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.366637:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15170 00000100:00100000:0.0:1746147135.374417:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147135.376507:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806720 00000100:00100000:2.0:1746147135.376526:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806720 00000100:00100000:2.0:1746147135.377566:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15171 00000100:00100000:2.0:1746147135.377579:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32096:x1830967307806720:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147135.377603:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147135.377625:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055138 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773dc expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.377715:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.377729:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.377739:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147135.377759:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147135.377763:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147135.377778:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147135.377798:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055138 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.377823:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.377835:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147135.377838:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147135.377841:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7000, rc 0) 00000100:00100000:2.0:1746147135.379684:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32096:x1830967307806720:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 2096us (5267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.379696:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15171 00000100:00100000:0.0:1746147135.381304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.381938:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806848 00000100:00100000:1.0:1746147135.381948:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806848 00000100:00100000:1.0:1746147135.382009:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14137 00000100:00100000:1.0:1746147135.382020:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307806848:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147135.382037:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.382062:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773e3 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147135.382129:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814173f, atime: 0x6814173e, ctime: 0x6814173f, blocks: 0x7c8 00010000:00010000:1.0:1746147135.382151:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.382154:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147135.382158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147135.382163:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147135.382173:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307806976 00000100:00100000:0.0:1746147135.382176:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307806976 00010000:00010000:1.0:1746147135.382178:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.382188:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb800, rc 0) 00000100:00100000:0.0:1746147135.382209:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14138 00000100:00100000:0.0:1746147135.382214:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2001:x1830967307806976:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147135.382222:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147135.382231:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307806848:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 212us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.382237:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14137 00010000:00010000:0.0:1746147135.382237:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773ea expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147135.382251:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6814173f, atime: 0x6814173d, ctime: 0x6814173f, blocks: 0x808 00010000:00010000:0.0:1746147135.382260:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.382261:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.382265:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 8 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382275:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 8 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382281:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7c00, rc 0) 00000100:00100000:0.0:1746147135.382298:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307806976:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 84us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.382303:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14138 00000100:00100000:0.0:1746147135.382332:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.382343:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807232 00000100:00100000:0.0:1746147135.382345:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807232 00000100:00100000:0.0:1746147135.382358:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14139 00000100:00100000:0.0:1746147135.382362:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307807232:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147135.382371:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147135.382382:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773f8 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147135.382392:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814173c, atime: 0x6814173c, ctime: 0x6814173d, blocks: 0x800 00010000:00010000:0.0:1746147135.382399:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.382400:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.382403:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382411:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382418:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7000, rc 0) 00000100:00100000:0.0:1746147135.382433:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307807232:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 70us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.382438:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14139 00000100:00100000:0.0:1746147135.382486:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.382496:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807104 00000100:00100000:0.0:1746147135.382499:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807104 00000100:00100000:1.0:1746147135.382511:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147135.382677:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807360 00000100:00100000:0.0:1746147135.382680:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807360 00000100:00100000:2.0:1746147135.382683:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14140 00000100:00100000:2.0:1746147135.382691:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307807104:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147135.382698:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147135.382702:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14141 00000100:00100000:0.0:1746147135.382706:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307807360:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147135.382707:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773f1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147135.382712:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746147135.382720:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814173c, atime: 0x6814173c, ctime: 0x6814173d, blocks: 0x808 00010000:00010000:0.0:1746147135.382720:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e773ff expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147135.382727:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.382729:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746147135.382733:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x6814173e, atime: 0x6814173e, ctime: 0x6814173e, blocks: 0x1590 00010000:00010000:2.0:1746147135.382734:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382740:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147135.382741:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147135.382743:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382745:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147135.382750:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7c00, rc 0) 00010000:00010000:0.0:1746147135.382754:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147135.382760:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7600, rc 0) 00000100:00100000:2.0:1746147135.382767:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307807104:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.382772:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14140 00000100:00100000:0.0:1746147135.382782:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307807360:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147135.382787:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14141 00000100:00100000:0.0:1746147135.382876:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147135.382886:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807488 00000100:00100000:1.0:1746147135.382889:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807488 00000100:00100000:1.0:1746147135.382905:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14142 00000100:00100000:1.0:1746147135.382910:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307807488:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147135.382917:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147135.382926:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77406 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147135.382935:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x6814173f, atime: 0x6814173f, ctime: 0x6814173f, blocks: 0x1008 00010000:00010000:1.0:1746147135.382943:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.382944:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147135.382947:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.382956:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147135.382962:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb600, rc 0) 00000100:00100000:1.0:1746147135.382978:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307807488:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 68us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147135.383019:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14142 00010000:00010000:0.0:1746147135.610355:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147135.930471:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310613120:0@lo:400:kworker.0 00000100:00100000:1.0:1746147135.930471:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3764:1830967310612992:0@lo:400:kworker.0 00000100:00100000:0.0:1746147135.930582:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310613376:0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.930631:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830967310613248:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.930708:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.930775:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967310613632:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.930801:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.930816:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830967310614144:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.930833:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.930846:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147135.930850:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967310613504:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.930867:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.930878:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310614016:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.930895:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.930925:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613120 00000100:00100000:2.0:1746147135.930932:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613120 00000100:00100000:3.0:1746147135.930952:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.930952:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.930970:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310614016 00000100:00100000:2.0:1746147135.930972:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310614016 00000100:00100000:3.0:1746147135.930977:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613632 00000100:00100000:3.0:1746147135.930980:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613632 00000100:00100000:2.0:1746147135.930985:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1746147135.930993:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310613120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931013:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310614144 00000100:00100000:3.0:1746147135.931015:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310614144 00000100:00100000:3.0:1746147135.931028:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613504 00000100:00100000:3.0:1746147135.931030:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613504 00000100:00100000:3.0:1746147135.931038:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613248 00000100:00100000:3.0:1746147135.931040:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613248 00000100:00100000:2.0:1746147135.931040:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310613120:12345-0@lo:400:kworker.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.931046:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1746147135.931049:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1746147135.931054:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967310613632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.931060:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1746147135.931078:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310614016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.931121:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310614016:12345-0@lo:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.931126:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1746147135.931142:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1746147135.931147:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830967310614144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931149:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967310613632:12345-0@lo:400:kworker.0 Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.931154:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1746147135.931167:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1746147135.931171:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967310613504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.931171:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830967310614144:12345-0@lo:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.931177:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1746147135.931188:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1746147135.931192:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3766:x1830967310613248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931193:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967310613504:12345-0@lo:400:kworker.0 Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.931198:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1746147135.931211:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3766:x1830967310613248:12345-0@lo:400:kworker.0 Request processed in 19us (260us total) trans 0 rc 0/0 00000100:00080000:3.0:1746147135.931214:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147135.931216:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00080000:3.0:1746147135.931218:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746147135.931238:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310612992 00000100:00100000:2.0:1746147135.931239:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967310613504:0@lo:400:kworker.0 00000100:00100000:1.0:1746147135.931240:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830967310613248:0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931241:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310612992 00000100:00100000:1.0:1746147135.931246:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3766:1830967310613760:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.931247:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310614016:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.931253:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967310613632:0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931261:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1746147135.931261:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830967310614144:0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931266:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3764:x1830967310612992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147135.931267:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.931268:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310613120:0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931290:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3764:x1830967310612992:12345-0@lo:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.931292:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613760 00000100:00100000:3.0:1746147135.931295:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1746147135.931295:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613760 00000100:00100000:1.0:1746147135.931296:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3764:1830967310612992:0@lo:400:kworker.0 00000100:00080000:2.0:1746147135.931307:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147135.931321:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1746147135.931326:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830967310613760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.931350:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830967310613760:12345-0@lo:400:kworker.0 Request processed in 24us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.931355:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1746147135.931543:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147135.931561:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3766:1830967310613760:0@lo:400:kworker.0 00000100:00100000:0.0:1746147135.931588:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967310613888:0@lo:400:kworker.0 00000100:00100000:0.0:1746147135.931620:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147135.931708:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613888 00000100:00100000:3.0:1746147135.931712:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613888 00000100:00100000:3.0:1746147135.931744:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1746147135.931748:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967310613888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1746147135.931762:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746147135.931826:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967310613888:0@lo:400:kworker.0 00000100:00100000:3.0:1746147135.931861:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967310613888:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147135.931867:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1746147135.932942:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310613376 00000100:00100000:2.0:1746147135.932947:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310613376 00000100:00100000:2.0:1746147135.933014:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1746147135.933020:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310613376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.933072:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310613376:12345-0@lo:400:kworker.0 Request processed in 43us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.933078:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00080000:0.0:1746147135.933176:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147135.933240:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310613376:0@lo:400:kworker.0 00000100:00100000:2.0:1746147135.945384:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310614272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746147135.945465:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.945521:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147135.945527:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310614400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746147135.945547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147135.945589:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310614272 00000100:00100000:2.0:1746147135.945596:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310614272 00000100:00100000:2.0:1746147135.945650:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310614400 00000100:00100000:2.0:1746147135.945652:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310614400 00000100:00100000:2.0:1746147135.945666:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1746147135.945673:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967310614272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746147135.945708:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445675008 avail 1316212736 00000100:00100000:2.0:1746147135.945747:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967310614272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.945753:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1746147135.945767:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1746147135.945771:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310614400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746147135.945786:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:2.0:1746147135.946036:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310614400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147135.946049:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1746147135.946193:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310614400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746147135.946207:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310614272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746147136.009334:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310614656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147136.009368:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310614528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147136.009391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147136.009516:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310614656 00000100:00100000:0.0:1746147136.009524:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310614656 00000100:00100000:0.0:1746147136.009570:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1746147136.009576:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310614656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147136.009598:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1169278016 pending 2207744 free 3904991232 avail 3673468928 00000100:00100000:0.0:1746147136.009903:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310614656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 326us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.009909:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1746147136.010610:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310614656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147136.011342:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147136.011404:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310614528 00000100:00100000:0.0:1746147136.011409:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310614528 00000100:00100000:0.0:1746147136.011443:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1746147136.011449:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967310614528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746147136.011469:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1216525376 pending 249856 free 3909718016 avail 3678195712 00000100:00100000:0.0:1746147136.011504:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967310614528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.011509:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1746147136.011582:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310614528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147136.391716:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.391751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.392830:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.393174:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807744 00000100:00100000:2.0:1746147136.393181:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807744 00000100:00100000:2.0:1746147136.393231:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14143 00000100:00100000:2.0:1746147136.393238:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307807744:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147136.393311:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307807744:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 75us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.393316:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14143 00000100:00100000:2.0:1746147136.393325:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808000 00000100:00100000:2.0:1746147136.393327:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808000 00000100:00100000:2.0:1746147136.393336:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14144 00000100:00100000:2.0:1746147136.393339:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307808000:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00080000:1.0:1746147136.393390:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147136.393393:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147136.393554:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307808000:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 211us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.393560:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14144 00000100:00100000:0.0:1746147136.393678:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.394513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.395672:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808256 00000100:00100000:0.0:1746147136.395717:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.395761:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807616 00000100:00100000:0.0:1746147136.395768:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807616 00000100:00100000:0.0:1746147136.395799:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307807872 00000100:00100000:0.0:1746147136.395802:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307807872 00000100:00100000:0.0:1746147136.395815:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808128 00000100:00100000:0.0:1746147136.395817:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808128 00000100:00100000:3.0:1746147136.395818:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808256 00000100:00100000:0.0:1746147136.395836:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14145 00000100:00100000:3.0:1746147136.395841:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14146 00000100:00100000:0.0:1746147136.395843:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307807616:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147136.395847:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307807872:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147136.395914:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307807872:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 67us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.395920:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14146 00000100:00100000:3.0:1746147136.395931:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14147 00000100:00100000:3.0:1746147136.395935:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307808128:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147136.395975:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14148 00000100:00100000:1.0:1746147136.395983:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307808256:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147136.396126:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307807616:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 284us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.396130:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307808128:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.396133:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14145 00000100:00100000:3.0:1746147136.396136:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14147 00000100:00100000:1.0:1746147136.396232:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307808256:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 250us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.396238:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14148 00000100:00100000:0.0:1746147136.400229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.400268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.400294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.401820:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808384 00000100:00100000:1.0:1746147136.401831:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808384 00000100:00100000:0.0:1746147136.401834:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.401852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.401875:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808512 00000100:00100000:1.0:1746147136.401878:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808512 00000100:00100000:1.0:1746147136.401892:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808768 00000100:00100000:1.0:1746147136.401894:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808768 00000100:00100000:1.0:1746147136.401904:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808640 00000100:00100000:1.0:1746147136.401906:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808640 00000100:00100000:1.0:1746147136.401914:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307808896 00000100:00100000:1.0:1746147136.401916:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307808896 00000100:00100000:1.0:1746147136.401929:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14149 00000100:00100000:1.0:1746147136.401937:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307808384:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147136.401973:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.401991:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307809024 00000100:00100000:0.0:1746147136.401995:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307809024 00000100:00100000:0.0:1746147136.402010:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14150 00000100:00100000:0.0:1746147136.402015:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307808512:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147136.402024:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307808384:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 87us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.402031:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14149 00000100:00100000:1.0:1746147136.402044:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14151 00000100:00100000:1.0:1746147136.402048:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307808768:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147136.402068:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307808512:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 52us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.402074:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14150 00000100:00100000:0.0:1746147136.402084:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14152 00000100:00100000:0.0:1746147136.402103:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307808640:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147136.402107:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307808768:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 57us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.402112:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14151 00000100:00100000:1.0:1746147136.402120:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14153 00000100:00100000:1.0:1746147136.402124:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307808896:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147136.402138:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307808640:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.402142:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14152 00000100:00100000:1.0:1746147136.402149:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307808896:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.402152:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14154 00000100:00100000:1.0:1746147136.402155:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14153 00000100:00100000:0.0:1746147136.402157:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307809024:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147136.402186:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307809024:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.402190:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14154 00000100:00100000:0.0:1746147136.409368:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.410132:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307809152 00000100:00100000:3.0:1746147136.410141:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307809152 00000100:00100000:3.0:1746147136.410184:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14155 00000100:00100000:3.0:1746147136.410190:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307809152:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:3.0:1746147136.410334:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147136.410337:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147136.410339:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147136.410341:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147136.410343:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:3.0:1746147136.410393:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307809152:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 202us (1032us total) trans 21474841390 rc 0/0 00000100:00100000:3.0:1746147136.410400:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14155 00000100:00100000:0.0:1746147136.414371:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.414991:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307809280 00000100:00100000:2.0:1746147136.414999:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307809280 00000100:00100000:2.0:1746147136.415121:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14156 00000100:00100000:2.0:1746147136.415129:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307809280:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:2.0:1746147136.415591:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147136.415594:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147136.415596:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147136.415598:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147136.415600:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147136.415658:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307809280:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 529us (1294us total) trans 17179874120 rc 0/0 00000100:00100000:2.0:1746147136.415665:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14156 00000100:00100000:0.0:1746147136.423693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.423727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.423757:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.423788:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307809536 00000100:00100000:0.0:1746147136.423796:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307809536 00000100:00100000:0.0:1746147136.423836:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307809792 00000100:00100000:0.0:1746147136.423838:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307809792 00000100:00100000:0.0:1746147136.423861:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307809920 00000100:00100000:0.0:1746147136.423863:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307809920 00000100:00100000:0.0:1746147136.423876:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3285 00000100:00100000:0.0:1746147136.423883:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307809536:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147136.423912:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.423923:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.423925:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.423929:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.423941:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147136.424978:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3286 00000100:00100000:0.0:1746147136.424985:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307809792:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147136.425003:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.425015:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.425017:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.425019:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.425028:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147136.426237:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3287 00000100:00100000:0.0:1746147136.426247:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307809920:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147136.426270:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.426279:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.426281:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.426284:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.426294:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147136.430964:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.432062:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.434079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.434140:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307810560 00000100:00100000:3.0:1746147136.434149:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307810560 00000100:00100000:3.0:1746147136.434199:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3288 00000100:00100000:3.0:1746147136.434206:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307810560:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147136.434240:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.434252:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.434254:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.434258:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.434268:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147136.435661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.435688:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307810944 00000100:00100000:2.0:1746147136.435696:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307810944 00000100:00100000:2.0:1746147136.435735:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307811200 00000100:00100000:2.0:1746147136.435738:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307811200 00000100:00100000:2.0:1746147136.435765:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3289 00000100:00100000:2.0:1746147136.435772:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307810944:12345-192.168.204.25@tcp:3:mirror_io.0 00000100:00100000:1.0:1746147136.435777:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307810304 00000100:00100000:1.0:1746147136.435782:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307810304 00010000:00010000:2.0:1746147136.435794:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.435798:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3290 00010000:00010000:2.0:1746147136.435803:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.435805:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147136.435805:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307811200:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147136.435808:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.435818:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.435824:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.435832:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.435834:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.435837:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.435846:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.436485:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3291 00000100:00100000:1.0:1746147136.436491:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2002:x1830967307810304:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147136.436507:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.436850:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.436852:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.436855:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.436864:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445278:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445296:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445305:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445311:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936b7800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147136.445315:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445322:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445339:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.445347:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936b7800/0x3139939425055170 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147136.445432:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2002:x1830967307809536:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 21543us (21740us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746147136.445441:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3285 00010000:00010000:1.0:1746147136.452637:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.452651:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.452658:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.452664:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55cc800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147136.452667:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.452673:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.452690:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.452696:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055177 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.454533:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307809792:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 29538us (30794us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.454544:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3286 00010000:00010000:1.0:1746147136.454942:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.457320:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.457336:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.457343:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147136.457346:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.457355:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.457372:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.457382:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x313993942505517e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.457469:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307809920:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 31221us (33707us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.457481:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3287 00010000:00010000:1.0:1746147136.458954:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.458965:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.458971:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.458977:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffaa00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147136.458979:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.458985:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.458997:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.459002:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425055193 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.459146:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307811200:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 23337us (23486us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.459154:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3290 00010000:00010000:1.0:1746147136.466260:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.466274:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.466281:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.466287:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffa800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147136.466290:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.466297:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.466312:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.466317:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x313993942505519a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.466510:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307810304:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 30015us (35548us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.466519:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3291 00010000:00010000:3.0:1746147136.474297:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.474311:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.474319:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.474325:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147136.474328:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.474335:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.474349:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.474354:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425055185 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.474572:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307810560:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 40361us (42517us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147136.474581:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3288 00010000:00010000:2.0:1746147136.484225:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.484240:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.484252:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.484258:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147136.484262:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.484269:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.484285:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.484290:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505518c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147136.484779:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307810944:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 49002us (50700us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147136.484789:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3289 00000100:00100000:0.0:1746147136.490857:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.490956:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307811328 00000100:00100000:2.0:1746147136.490964:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307811328 00000100:00100000:2.0:1746147136.491129:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 789 00000100:00100000:2.0:1746147136.491138:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32096:x1830967307811328:12345-192.168.204.25@tcp:103:mirror_io.0 00010000:00010000:2.0:1746147136.491151:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147136.491173:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250550f2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ce expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.491206:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147136.491210:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147136.491249:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32096:x1830967307811328:12345-192.168.204.25@tcp:103:mirror_io.0 Request processed in 112us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.491255:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 789 00000100:00080000:1.0:1746147136.491504:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147136.493313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.493575:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307811584 00000100:00100000:1.0:1746147136.493581:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307811584 00000100:00100000:1.0:1746147136.493631:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5404 00000100:00100000:1.0:1746147136.493637:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32096:x1830967307811584:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147136.494242:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32096:x1830967307811584:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 604us (933us total) trans 8589935832 rc 0/0 00000100:00100000:1.0:1746147136.494248:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5404 00000100:00100000:0.0:1746147136.495748:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.495844:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307811840 00000100:00100000:1.0:1746147136.495850:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307811840 00000100:00100000:1.0:1746147136.495888:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5405 00000100:00100000:1.0:1746147136.495894:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32096:x1830967307811840:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147136.496026:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32096:x1830967307811840:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 130us (280us total) trans 8589935833 rc 0/0 00000100:00100000:1.0:1746147136.496031:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5405 00000100:00100000:0.0:1746147136.516252:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.516361:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307812096 00000100:00100000:3.0:1746147136.516369:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307812096 00000100:00100000:3.0:1746147136.516439:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15172 00000100:00100000:3.0:1746147136.516446:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32111:x1830967307812096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147136.516468:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147136.516483:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250551a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7740d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746147136.516519:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147136.516800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.516928:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307812352 00000100:00100000:2.0:1746147136.516932:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307812352 00000100:00080000:1.0:1746147136.516968:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147136.516972:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15173 00000100:00100000:2.0:1746147136.516978:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:32110:x1830967307812352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147136.516988:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147136.517000:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x31399394250551a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77414 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.517034:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517044:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517063:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517075:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517081:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517087:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517198:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517205:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517211:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147136.517218:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147136.517277:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517283:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517288:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517294:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517299:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38cc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147136.517302:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517307:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517316:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147136.517319:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147136.517323:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517330:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x31399394250551af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517343:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517347:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517351:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517355:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38c800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147136.517357:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517362:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517367:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800930f4100) 00010000:00010000:2.0:1746147136.517369:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147136.517371:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517375:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x31399394250551b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147136.517405:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x31399394250551a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.517414:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.517423:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147136.517425:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147136.517427:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c200, rc 0) 00000100:00100000:2.0:1746147136.517478:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32110:x1830967307812352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 500us (678us total) trans 8589935834 rc 0/0 00000100:00100000:2.0:1746147136.517483:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15173 00010000:00010000:3.0:1746147136.517542:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517549:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517555:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517563:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517568:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517572:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517608:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517614:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517619:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147136.517624:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147136.517650:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517658:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517662:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517666:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517670:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147136.517672:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517677:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517683:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147136.517685:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147136.517687:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517691:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250551cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517701:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517705:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517709:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517713:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147136.517716:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517720:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517725:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23800) 00010000:00010000:3.0:1746147136.517727:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147136.517728:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517732:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250551d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.517750:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250551a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.517757:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.517762:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147136.517763:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147136.517765:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94e00, rc 0) 00000100:00100000:3.0:1746147136.517781:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32111:x1830967307812096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1336us (1537us total) trans 8589935835 rc 0/0 00000100:00100000:3.0:1746147136.517787:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15172 00000100:00100000:0.0:1746147136.522271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.522353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.522664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.522666:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813120 00000100:00100000:3.0:1746147136.522674:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813120 00000100:00100000:2.0:1746147136.522676:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307812480 00000100:00100000:0.0:1746147136.522676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.522680:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307812480 00000100:00100000:3.0:1746147136.522714:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15174 00000100:00100000:3.0:1746147136.522721:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32108:x1830967307813120:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147136.522742:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147136.522758:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x31399394250551e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77437 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.522840:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.522852:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.522858:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.522863:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.522867:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147136.522979:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147136.522983:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.522989:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307812608 00010000:00010000:3.0:1746147136.522991:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 29 pid: 7238 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.522992:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307812608 00000100:00100000:0.0:1746147136.522998:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307812736 00000100:00100000:0.0:1746147136.523001:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307812736 00000100:00100000:3.0:1746147136.523002:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094537b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310614784:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147136.523012:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307812864 00000100:00100000:2.0:1746147136.523015:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307812864 00000100:00100000:0.0:1746147136.523021:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14157 00000100:00100000:0.0:1746147136.523026:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307812480:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147136.523032:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14158 00010000:00010000:0.0:1746147136.523034:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147136.523037:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+6:2003:x1830967307812608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.523044:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7741b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.523045:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147136.523066:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77422 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.523070:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523072:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.523078:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.523079:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523079:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.523084:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147136.523110:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.523112:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.523115:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147136.523119:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 8 pid: 9138 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.523121:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0400, rc 0) 00010000:00010000:2.0:1746147136.523125:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6a00, rc 0) 00000100:00100000:3.0:1746147136.523126:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310614912:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147136.523141:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307812480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 114us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.523145:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307812608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 107us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.523146:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14157 00000100:00100000:2.0:1746147136.523151:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14158 00010000:00010000:3.0:1746147136.523159:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147136.523161:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14159 00000100:00100000:2.0:1746147136.523165:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14160 00010000:00010000:3.0:1746147136.523166:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 9 pid: 16099 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746147136.523167:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+6:2003:x1830967307812736:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147136.523170:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307812864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.523172:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147136.523173:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094536d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310615040:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147136.523176:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.523179:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77429 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.523183:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77430 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.523188:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523189:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147136.523191:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147136.523192:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.523193:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523193:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.523197:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.523201:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.523206:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.523208:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1200, rc 0) 00010000:00010000:2.0:1746147136.523213:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6800, rc 0) 00000100:00100000:3.0:1746147136.523221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.523222:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307812736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 55us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.523228:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14159 00000100:00100000:2.0:1746147136.523229:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307812864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 58us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.523234:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14160 00000100:00100000:0.0:1746147136.523236:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813248 00000100:00100000:0.0:1746147136.523239:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813248 00000100:00100000:0.0:1746147136.523253:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14161 00000100:00100000:0.0:1746147136.523257:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307813248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.523263:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.523269:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7743e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.523278:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147136.523279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147136.523280:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523284:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.523292:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.523304:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:0.0:1746147136.523318:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307813248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.523323:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14161 00000100:00100000:0.0:1746147136.523331:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813376 00000100:00100000:0.0:1746147136.523333:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813376 00000100:00100000:0.0:1746147136.523346:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14162 00000100:00100000:0.0:1746147136.523350:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307813376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.523355:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.523361:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77445 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.523369:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523371:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.523374:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.523381:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.523387:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:0.0:1746147136.523403:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307813376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.523408:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14162 00000100:00080000:1.0:1746147136.523628:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147136.523632:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147136.525183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.525216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.525229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.525831:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.526036:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813504 00000100:00100000:2.0:1746147136.526042:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813504 00000100:00100000:3.0:1746147136.526068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.526128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.526172:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813632 00000100:00100000:3.0:1746147136.526175:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813632 00000100:00100000:0.0:1746147136.526621:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813888 00000100:00100000:0.0:1746147136.526625:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813888 00000100:00100000:0.0:1746147136.526648:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814144 00000100:00100000:0.0:1746147136.526649:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814144 00000100:00100000:0.0:1746147136.526657:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307813760 00000100:00100000:0.0:1746147136.526659:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307813760 00000100:00100000:0.0:1746147136.526667:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814016 00000100:00100000:0.0:1746147136.526669:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814016 00000100:00100000:0.0:1746147136.526681:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14163 00000100:00100000:0.0:1746147136.526687:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307813888:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.526701:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.526713:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77461 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.526730:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526732:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526739:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526750:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526759:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1e00, rc 0) 00000100:00100000:0.0:1746147136.526793:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307813888:12345-192.168.204.25@tcp:101:cat.0 Request processed in 106us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.526798:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14163 00000100:00100000:0.0:1746147136.526810:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14164 00000100:00100000:0.0:1746147136.526815:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307814144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.526822:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.526830:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7746f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.526840:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526841:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526845:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526853:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526860:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0a00, rc 0) 00000100:00100000:0.0:1746147136.526873:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307814144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 58us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.526877:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14164 00000100:00100000:0.0:1746147136.526884:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14165 00000100:00100000:0.0:1746147136.526888:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307813760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.526892:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.526896:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7745a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.526904:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526905:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526908:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526915:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526925:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0000, rc 0) 00000100:00100000:0.0:1746147136.526934:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307813760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 46us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.526938:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14165 00000100:00100000:0.0:1746147136.526945:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14166 00000100:00100000:0.0:1746147136.526948:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307814016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147136.526952:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.526957:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77468 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.526964:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526966:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.526968:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526975:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147136.526981:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1c00, rc 0) 00000100:00100000:0.0:1746147136.526990:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307814016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 41us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.526994:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14166 00000100:00100000:0.0:1746147136.527076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.527099:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814528 00000100:00100000:0.0:1746147136.527101:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814528 00010000:00010000:0.0:1746147136.527116:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 10 pid: 16099 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746147136.527141:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6168 00000100:00100000:0.0:1746147136.527145:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307814528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147136.527152:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147136.527156:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 10 pid: 16099 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527163:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 10 pid: 16099 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527175:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147136.527179:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527185:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527188:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147136.527199:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307814528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.527202:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6168 00000100:00100000:0.0:1746147136.527227:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094537b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310614784:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147136.527234:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310614912:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147136.527240:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505513f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773dc expref: 9 pid: 16099 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746147136.527256:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094536d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310615040:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147136.527270:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147136.527306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.527312:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814400 00000100:00100000:0.0:1746147136.527314:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814400 00010000:00010000:0.0:1746147136.527321:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 9 pid: 9138 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746147136.527333:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6169 00000100:00100000:0.0:1746147136.527336:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307814400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147136.527341:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147136.527344:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 9 pid: 9138 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527351:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 9 pid: 9138 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527361:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x31399394250551bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77414 expref: 9 pid: 9138 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527368:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147136.527370:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527375:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527379:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147136.527391:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307814400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.527395:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6169 00000100:00100000:0.0:1746147136.527431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.527442:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814272 00000100:00100000:0.0:1746147136.527444:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814272 00010000:00010000:0.0:1746147136.527454:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746147136.527469:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6170 00000100:00100000:0.0:1746147136.527474:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307814272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147136.527479:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147136.527482:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527489:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527498:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250551d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7740d expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746147136.527504:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147136.527506:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527511:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527516:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527528:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147136.527539:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307814272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.527544:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6170 00010000:00010000:0.0:1746147136.527556:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.527560:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147136.527572:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147136.527662:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x31399394250551e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.527670:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.527675:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147136.527677:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147136.527678:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94400, rc 0) 00000100:00100000:0.0:1746147136.527694:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32108:x1830967307813120:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4974us (5343us total) trans 8589935836 rc 0/0 00000100:00100000:0.0:1746147136.527698:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15174 00000100:00100000:2.0:1746147136.528070:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14167 00000100:00100000:2.0:1746147136.528077:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307813504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147136.528086:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147136.528105:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7744c expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.528118:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.528119:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.528124:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.528133:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.528140:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7a00, rc 0) 00000100:00100000:2.0:1746147136.528161:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307813504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 84us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.528166:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14167 00000100:00080000:1.0:1746147136.528594:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147136.528597:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147136.528677:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14168 00000100:00100000:3.0:1746147136.528683:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307813632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147136.528690:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147136.528698:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77453 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.528708:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.528710:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.528714:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147136.528722:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147136.528729:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64ae00, rc 0) 00000100:00100000:3.0:1746147136.528745:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307813632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.528749:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14168 00000100:00100000:0.0:1746147136.530117:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.530163:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.530202:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814656 00000100:00100000:0.0:1746147136.530205:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307814912 00000100:00100000:2.0:1746147136.530208:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814656 00000100:00100000:0.0:1746147136.530209:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307814912 00000100:00100000:2.0:1746147136.530240:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15175 00000100:00100000:2.0:1746147136.530245:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32110:x1830967307814656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147136.530259:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147136.530271:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425055250 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77476 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.530311:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425055250 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77476 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.530326:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425055250 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77476 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.530340:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147136.530343:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147136.530345:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7400, rc 0) 00000100:00100000:2.0:1746147136.530520:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:32110:x1830967307814656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 274us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.530526:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15175 00000100:00100000:0.0:1746147136.530634:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15176 00000100:00100000:0.0:1746147136.530641:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32105:x1830967307814912:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147136.530648:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147136.530655:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425055257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7747d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.530699:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.530707:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.530714:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531285:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531293:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531298:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531378:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x313993942505526c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531386:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x313993942505526c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531391:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x313993942505526c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147136.531401:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147136.531458:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531464:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531468:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531473:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531477:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147136.531481:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531486:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531494:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147136.531496:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147136.531499:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531503:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942505525e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531511:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531515:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531522:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531525:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147136.531527:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531530:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531535:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5800) 00010000:00010000:0.0:1746147136.531537:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147136.531544:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531548:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425055265 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147136.531579:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425055257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7747d expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.531587:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x313993942505526c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7747d expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.531591:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147136.531593:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147136.531595:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:0.0:1746147136.531632:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32105:x1830967307814912:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 992us (1468us total) trans 8589935837 rc 0/0 00000100:00100000:0.0:1746147136.531638:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15176 00000100:00100000:0.0:1746147136.533505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.533552:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307815040 00000100:00100000:1.0:1746147136.533559:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307815040 00000100:00100000:1.0:1746147136.533601:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15177 00000100:00100000:1.0:1746147136.533607:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32111:x1830967307815040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147136.533622:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147136.533634:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77484 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.533680:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.533690:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.533703:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147136.533706:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147136.533708:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:1.0:1746147136.533752:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32111:x1830967307815040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 145us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.533759:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15177 00000100:00100000:0.0:1746147136.539420:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.539495:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307815296 00000100:00100000:2.0:1746147136.539505:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307815296 00000100:00100000:2.0:1746147136.539577:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15178 00000100:00100000:2.0:1746147136.539588:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:32105:x1830967307815296:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147136.539610:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147136.539614:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746147136.539640:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425055250 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77476 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539686:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x313993942505526c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7747d expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539697:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147136.539701:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147136.539713:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x3139939425055281 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7748b expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539758:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147136.539771:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539777:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539783:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147136.539811:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539823:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 29 pid: 7238 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.539834:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310615168:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147136.539962:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.539972:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 8 pid: 7238 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.539980:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4998700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310615296:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147136.540008:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147136.544779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.544799:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a499bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310615168:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147136.544810:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4998700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310615296:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147136.544831:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147136.545167:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307815424 00000100:00100000:1.0:1746147136.545175:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307815424 00010000:00010000:1.0:1746147136.545210:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746147136.545255:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6171 00000100:00100000:1.0:1746147136.545262:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307815424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147136.545275:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147136.545936:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.545985:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307815552 00000100:00100000:2.0:1746147136.545989:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307815552 00010000:00010000:2.0:1746147136.546006:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 9 pid: 7238 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.546022:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6172 00000100:00100000:2.0:1746147136.546027:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307815552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147136.546033:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147136.546037:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 9 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.546045:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 9 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.546071:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x3139939425055131 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773d5 expref: 9 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.546113:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147136.546117:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147136.546124:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147136.546128:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147136.546167:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307815552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.546173:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6172 00010000:00010000:1.0:1746147136.546371:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.546381:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.546392:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505527a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77484 expref: 30 pid: 7238 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.546411:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147136.546414:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147136.546420:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147136.546425:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147136.546451:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147136.546457:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147136.546671:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147136.546702:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307815424:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1439us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.546708:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6171 00000040:00080000:2.0:1746147136.546785:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].514, 88 off53288 00000004:00080000:2.0:1746147136.546792:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674536702389ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547559:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].459, 88 off48440 00000004:00080000:2.0:1746147136.547567:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537477189ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547633:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].460, 88 off48528 00000004:00080000:2.0:1746147136.547637:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537547622ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547648:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].515, 88 off53376 00000004:00080000:2.0:1746147136.547651:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537561147ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547671:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].516, 88 off53464 00000004:00080000:2.0:1746147136.547674:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537584177ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547681:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].461, 88 off48616 00000004:00080000:2.0:1746147136.547684:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537594389ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547692:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].462, 88 off48704 00000004:00080000:2.0:1746147136.547695:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537605232ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547701:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].463, 88 off48792 00000004:00080000:2.0:1746147136.547703:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537613321ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547709:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].517, 88 off53552 00000004:00080000:2.0:1746147136.547711:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537621437ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547718:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].464, 88 off48880 00000004:00080000:2.0:1746147136.547721:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537631389ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547727:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].518, 88 off53640 00000004:00080000:2.0:1746147136.547729:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537639919ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547737:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].465, 88 off48968 00000004:00080000:2.0:1746147136.547740:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537650734ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147136.547747:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].519, 88 off53728 00000004:00080000:2.0:1746147136.547749:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537659466ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547756:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].520, 88 off53816 00000004:00080000:2.0:1746147136.547758:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537668771ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547766:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].521, 88 off53904 00000004:00080000:2.0:1746147136.547768:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537679026ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547776:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].522, 88 off53992 00000004:00080000:2.0:1746147136.547779:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674537689686ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147136.547787:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].466, 88 off49056 00000004:00080000:2.0:1746147136.547790:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674537700139ns, next at 554081490131ns, rc = 0 00000001:00080000:2.0:1746147136.549000:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935838 is committed 00000004:00080000:2.0:1746147136.549011:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 462 committed 00000004:00080000:2.0:1746147136.549026:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 515 committed 00000004:00080000:2.0:1746147136.549583:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 514 committed 00000004:00080000:2.0:1746147136.549586:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 513 committed 00000004:00080000:2.0:1746147136.549587:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 512 committed 00000004:00080000:2.0:1746147136.549589:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 461 committed 00000004:00080000:2.0:1746147136.549590:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 511 committed 00000004:00080000:2.0:1746147136.549591:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 460 committed 00000004:00080000:2.0:1746147136.549592:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 510 committed 00000004:00080000:2.0:1746147136.549594:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 459 committed 00000004:00080000:2.0:1746147136.549595:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 458 committed 00000004:00080000:2.0:1746147136.549596:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 457 committed 00000004:00080000:2.0:1746147136.549598:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 509 committed 00000004:00080000:2.0:1746147136.549599:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 508 committed 00000004:00080000:2.0:1746147136.549600:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 456 committed 00000004:00080000:2.0:1746147136.549601:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 455 committed 00000004:00080000:2.0:1746147136.549602:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 507 committed 00000001:00080000:2.0:1746147136.549608:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935836 is committed 00000001:00080000:2.0:1746147136.549620:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935833 is committed 00010000:00010000:2.0:1746147136.549672:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.549683:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147136.549685:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147136.549697:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x3139939425055281 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 9 pid: 16099 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147136.549711:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147136.549737:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310615808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147136.549746:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310615680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147136.549802:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310615424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147136.550505:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.550514:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310615552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147136.550532:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147136.550535:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310616320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147136.550543:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310616064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147136.550554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147136.550566:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310616832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.550566:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310615808 00000100:00100000:1.0:1746147136.550572:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310615808 00000100:00100000:2.0:1746147136.550579:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147136.550590:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147136.550593:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310616704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.550598:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310615552 00000100:00100000:1.0:1746147136.550600:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310615552 00000100:00100000:2.0:1746147136.550604:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.550609:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616320 00000100:00100000:1.0:1746147136.550610:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616320 00000100:00100000:1.0:1746147136.550619:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616832 00000100:00100000:1.0:1746147136.550621:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616832 00010000:00010000:2.0:1746147136.550629:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:1.0:1746147136.550629:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616704 00000100:00100000:1.0:1746147136.550630:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616704 00010000:00010000:2.0:1746147136.550631:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147136.550635:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f972c00, rc 0) 00000100:00100000:1.0:1746147136.550641:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14169 00000100:00100000:1.0:1746147136.550647:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310615808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147136.550672:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:32105:x1830967307815296:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11086us (11260us total) trans 8589935838 rc 0/0 00000100:00100000:2.0:1746147136.550679:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15178 00000100:00100000:2.0:1746147136.550713:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14170 00000100:00100000:2.0:1746147136.550718:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310615552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147136.550740:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147136.550743:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.550744:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147136.550746:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.550748:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147136.550776:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967310615808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (272us total) trans 21474841391 rc 0/0 00000100:00100000:1.0:1746147136.550782:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14169 00000100:00100000:1.0:1746147136.550792:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14171 00000100:00100000:1.0:1746147136.550796:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310616320:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147136.550819:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094570000/2, rc 0, transno 21474841391 00000100:00100000:2.0:1746147136.550823:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310615808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147136.550856:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967310616320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (302us total) trans 21474841392 rc 0/0 00000100:00100000:1.0:1746147136.550861:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14171 00000100:00100000:1.0:1746147136.550870:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14172 00000100:00100000:1.0:1746147136.550874:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310616832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.550934:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967310616832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (353us total) trans 17179874121 rc 0/0 00000100:00100000:1.0:1746147136.550938:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14172 00000100:00100000:1.0:1746147136.550945:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14173 00000100:00100000:1.0:1746147136.550949:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310616704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147136.550981:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147136.550983:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147134 -> 1746147134 00002000:00010000:1.0:1746147136.550985:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147134 -> 1746147134 00002000:00010000:1.0:1746147136.550987:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147134 -> 1746147134 00002000:00010000:1.0:1746147136.550988:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:1.0:1746147136.551009:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967310616704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (403us total) trans 17179874122 rc 0/0 00000100:00100000:0.0:1746147136.551605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147136.551627:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310615936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147136.551644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147136.551655:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310616448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147136.551668:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147136.551685:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310615424 00000100:00100000:0.0:1746147136.551689:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310615424 00000100:00100000:0.0:1746147136.551703:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310615936 00000100:00100000:0.0:1746147136.551705:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310615936 00000100:00100000:0.0:1746147136.551710:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616448 00000100:00100000:0.0:1746147136.551712:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616448 00000100:00100000:0.0:1746147136.551719:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14174 00000100:00100000:0.0:1746147136.551723:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967310615424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147136.551775:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147136.551778:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:0.0:1746147136.551779:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147133 -> 1746147133 00002000:00010000:0.0:1746147136.551781:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:0.0:1746147136.551782:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147136.551802:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967310615424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (198us total) trans 21474841393 rc 0/0 00000100:00100000:0.0:1746147136.551807:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14174 00000100:00100000:0.0:1746147136.551815:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14175 00000100:00100000:0.0:1746147136.551819:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967310615936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147136.551860:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967310615936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (216us total) trans 21474841394 rc 0/0 00000100:00100000:0.0:1746147136.551864:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14175 00000100:00100000:0.0:1746147136.551871:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14176 00000100:00100000:1.0:1746147136.553512:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14173 00000100:00100000:0.0:1746147136.553517:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967310616448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.553539:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.553564:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310616576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.553590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147136.553600:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147136.553602:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:0.0:1746147136.553604:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147134 -> 1746147134 00002000:00010000:0.0:1746147136.553605:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:0.0:1746147136.553607:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147136.553613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.553622:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310616192:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147136.553627:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988b800/2, rc 0, transno 17179874122 00000100:00100000:2.0:1746147136.553632:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310616704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147136.553632:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967310616448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (1962us total) trans 17179874123 rc 0/0 00000100:00100000:1.0:1746147136.553638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147136.553638:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14176 00000004:00080000:2.0:1746147136.553640:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095063100/2, rc 0, transno 21474841392 00000100:00100000:2.0:1746147136.553642:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310616320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147136.553648:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616064 00000004:00080000:2.0:1746147136.553649:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988b100/2, rc 0, transno 17179874121 00000100:00100000:2.0:1746147136.553651:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310616832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.553652:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616576 00000100:00100000:0.0:1746147136.553652:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616064 00000100:00100000:1.0:1746147136.553654:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616576 00000100:00100000:0.0:1746147136.553664:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310615680 00000100:00100000:1.0:1746147136.553665:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616192 00000100:00100000:0.0:1746147136.553666:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310615680 00000100:00100000:1.0:1746147136.553668:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616192 00000100:00100000:0.0:1746147136.553676:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14177 00000100:00100000:1.0:1746147136.553679:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14178 00000100:00100000:0.0:1746147136.553680:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967310616064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147136.553683:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310616576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147136.553709:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147136.553712:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:2.0:1746147136.553714:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:2.0:1746147136.553715:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147133 -> 1746147133 00002000:00010000:2.0:1746147136.553717:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746147136.553720:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147136.553722:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147136.553722:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147136.553723:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147136.553725:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147133 -> 1746147133 00002000:00010000:0.0:1746147136.553725:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.553727:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746147136.553727:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147136.553728:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147136.553730:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:2.0:1746147136.553741:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310615552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3024us (3208us total) trans 21474841395 rc 0/0 00000100:00100000:1.0:1746147136.553743:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967310616576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (152us total) trans 17179874124 rc 0/0 00000100:00100000:2.0:1746147136.553747:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14170 00000100:00100000:1.0:1746147136.553749:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14178 00000100:00100000:0.0:1746147136.553751:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310616064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (211us total) trans 21474841396 rc 0/0 00000100:00100000:0.0:1746147136.553756:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14177 00000100:00100000:1.0:1746147136.553759:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14179 00000100:00100000:1.0:1746147136.553763:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310615680:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147136.553764:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e486a00/2, rc 0, transno 21474841395 00000100:00100000:0.0:1746147136.553766:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14180 00000100:00100000:2.0:1746147136.553767:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310615552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147136.553770:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310616192:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147136.553773:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095062300/2, rc 0, transno 21474841396 00000100:00100000:2.0:1746147136.553775:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310616064:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147136.553781:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099888e00/2, rc 0, transno 17179874124 00000100:00100000:2.0:1746147136.553784:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310616576:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147136.553797:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147136.553799:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:1.0:1746147136.553800:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147135 -> 1746147135 00002000:00010000:1.0:1746147136.553802:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:1.0:1746147136.553803:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147136.553825:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967310616192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (186us total) trans 21474841398 rc 0/0 00000100:00100000:1.0:1746147136.553826:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967310615680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (212us total) trans 21474841397 rc 0/0 00000100:00100000:0.0:1746147136.553830:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14180 00000100:00100000:1.0:1746147136.553833:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14179 00000004:00080000:0.0:1746147136.553857:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099889500/2, rc 0, transno 17179874123 00000100:00100000:0.0:1746147136.553860:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310616448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147136.553867:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e486300/2, rc 0, transno 21474841393 00000100:00100000:0.0:1746147136.553869:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310615424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147136.553875:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930ebb80/2, rc 0, transno 21474841394 00000100:00100000:0.0:1746147136.553878:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310615936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147136.553942:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094570a80/2, rc 0, transno 21474841397 00000100:00100000:1.0:1746147136.553946:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310615680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147136.553952:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095063b80/2, rc 0, transno 21474841398 00000100:00100000:1.0:1746147136.553954:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310616192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147136.554804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.554951:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.555010:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307815936 00000100:00100000:2.0:1746147136.555014:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307815936 00002000:00100000:2.0:1746147136.555041:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801312e8000 x1830967307815936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.555050:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8000 with x1830967307815936 ext(0->1048575) 00002000:00010000:2.0:1746147136.555064:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312e8000 00000100:00100000:2.0:1746147136.555077:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307816064 00000100:00100000:2.0:1746147136.555079:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307816064 00002000:00100000:2.0:1746147136.555106:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801312e8e00 x1830967307816064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.555116:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8e00 with x1830967307816064 ext(1048576->2097151) 00002000:00010000:2.0:1746147136.555119:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8e00 00000100:00100000:2.0:1746147136.555442:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3292 00000100:00100000:0.0:1746147136.555446:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3293 00000100:00100000:2.0:1746147136.555447:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307815936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147136.555451:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307816064:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147136.555455:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310617216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.555482:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.555499:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147136.555503:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310617344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.555517:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.555535:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310617216 00000100:00100000:1.0:1746147136.555538:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310617216 00000100:00100000:1.0:1746147136.555554:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310617344 00000100:00100000:1.0:1746147136.555556:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310617344 00000100:00100000:1.0:1746147136.555565:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14181 00000100:00100000:1.0:1746147136.555569:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967310617216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147136.555632:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147136.555634:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.555636:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147136.555638:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.555640:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147136.555660:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310617216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (177us total) trans 17179874125 rc 0/0 00000100:00100000:1.0:1746147136.555666:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14181 00000100:00100000:1.0:1746147136.555676:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14182 00000100:00100000:1.0:1746147136.555680:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967310617344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147136.555714:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:1.0:1746147136.555716:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.555718:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147136.555720:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147136.555721:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:1.0:1746147136.555736:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310617344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (218us total) trans 17179874126 rc 0/0 00000100:00100000:1.0:1746147136.555741:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14182 00000004:00080000:1.0:1746147136.555765:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897c380/2, rc 0, transno 17179874126 00000100:00100000:1.0:1746147136.555768:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310617344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147136.555774:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897ce00/2, rc 0, transno 17179874125 00000100:00100000:1.0:1746147136.555776:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310617216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.555786:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310616960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.555804:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.555814:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310617472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.555825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.555833:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147136.555837:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310617088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.555849:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147136.555864:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310616960 00000100:00100000:1.0:1746147136.555867:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310616960 00000100:00100000:1.0:1746147136.555878:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310617472 00000100:00100000:1.0:1746147136.555879:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310617472 00000100:00100000:1.0:1746147136.555886:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310617088 00000100:00100000:1.0:1746147136.555888:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310617088 00000100:00100000:1.0:1746147136.555895:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14183 00000100:00100000:1.0:1746147136.555899:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310616960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147136.555931:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:1.0:1746147136.555933:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:1.0:1746147136.555935:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147136.555936:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147136.555938:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:1.0:1746147136.555955:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310616960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (151us total) trans 17179874127 rc 0/0 00000100:00100000:1.0:1746147136.555959:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14183 00000100:00100000:1.0:1746147136.555966:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14184 00000100:00100000:1.0:1746147136.555969:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310617472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.556004:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310617472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (178us total) trans 17179874128 rc 0/0 00000100:00100000:1.0:1746147136.556008:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14184 00000100:00100000:1.0:1746147136.556014:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14185 00000100:00100000:1.0:1746147136.556018:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310617088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.556061:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310617088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (201us total) trans 17179874129 rc 0/0 00000100:00100000:1.0:1746147136.556065:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14185 00000004:00080000:1.0:1746147136.556082:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897c000/2, rc 0, transno 17179874129 00000100:00100000:1.0:1746147136.556084:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310617088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147136.556104:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897ed80/2, rc 0, transno 17179874127 00000100:00100000:1.0:1746147136.556107:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310616960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147136.556111:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a897ca80/2, rc 0, transno 17179874128 00000100:00100000:1.0:1746147136.556113:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310617472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147136.559432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.559455:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307816320 00000100:00100000:1.0:1746147136.559460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.559463:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307816320 00000100:00100000:1.0:1746147136.559476:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307816576 00000100:00100000:1.0:1746147136.559478:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307816576 00002000:00100000:1.0:1746147136.559497:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011e485500 x1830967307816576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.559497:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094570700 x1830967307816320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.559506:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967307816576 ext(1048576->2097151) 00002000:00100000:0.0:1746147136.559506:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094570700 with x1830967307816320 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.559512:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485500 00002000:00010000:0.0:1746147136.559512:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094570700 00000100:00100000:1.0:1746147136.559528:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3294 00000100:00100000:1.0:1746147136.559534:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307816576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147136.559537:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3295 00000100:00100000:0.0:1746147136.559541:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307816320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147136.564409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.565586:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307816832 00000100:00100000:2.0:1746147136.565598:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307816832 00002000:00100000:2.0:1746147136.565646:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801312ead80 x1830967307816832/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.565656:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ead80 with x1830967307816832 ext(0->1048575) 00002000:00010000:2.0:1746147136.565662:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ead80 00000100:00100000:3.0:1746147136.565690:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307815936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10234us (10880us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147136.565697:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3296 00000100:00100000:2.0:1746147136.565705:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307816832:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147136.565707:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3292 00002000:00100000:3.0:1746147136.565716:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801312e8000 x1830967307815936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.565725:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8000 with x1830967307815936 ext(0->1048575) 00002000:00010000:3.0:1746147136.565729:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312e8000 00000100:00100000:0.0:1746147136.567270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.569170:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307817088 00000100:00100000:2.0:1746147136.569181:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307817088 00002000:00100000:2.0:1746147136.569225:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801312e9180 x1830967307817088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.569236:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9180 with x1830967307817088 ext(1048576->2097151) 00002000:00010000:2.0:1746147136.569242:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e9180 00000100:00100000:2.0:1746147136.569270:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3297 00000100:00100000:2.0:1746147136.569278:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307817088:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147136.572413:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.572445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.572641:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307816064:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17176us (17677us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.572651:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3293 00002000:00100000:1.0:1746147136.572661:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801312e8e00 x1830967307816064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.572673:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8e00 with x1830967307816064 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.572679:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8e00 00000100:00100000:1.0:1746147136.572698:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307817344 00000100:00100000:1.0:1746147136.572705:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307817344 00002000:00100000:1.0:1746147136.572730:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801312e8380 x1830967307817344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.572737:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8380 with x1830967307817344 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.572739:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8380 00000100:00100000:1.0:1746147136.572755:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307817600 00000100:00100000:1.0:1746147136.572758:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307817600 00002000:00100000:1.0:1746147136.572768:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801305f0380 x1830967307817600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.572774:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0380 with x1830967307817600 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.572777:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0380 00000100:00100000:1.0:1746147136.572789:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3298 00000100:00100000:1.0:1746147136.572794:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307817344:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147136.572854:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3299 00000100:00100000:0.0:1746147136.572864:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307817600:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147136.575702:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307816320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16150us (16269us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147136.575714:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3295 00002000:00100000:2.0:1746147136.575725:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094570700 x1830967307816320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.575736:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094570700 with x1830967307816320 ext(1048576->2097151) 00002000:00010000:2.0:1746147136.575742:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094570700 00000100:00100000:1.0:1746147136.581227:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307816576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21684us (21757us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.581239:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3294 00002000:00100000:1.0:1746147136.581250:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011e485500 x1830967307816576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.581258:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967307816576 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.581277:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:0.0:1746147136.582954:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.583018:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307817728 00000100:00100000:2.0:1746147136.583028:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307817728 00000100:00100000:1.0:1746147136.583373:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15179 00000100:00100000:1.0:1746147136.583382:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32111:x1830967307817728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147136.583398:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147136.583411:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77492 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.583449:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.583458:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.583468:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147136.583470:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147136.583472:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21400, rc 0) 00000100:00100000:1.0:1746147136.583509:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32111:x1830967307817728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.583513:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15179 00000100:00100000:2.0:1746147136.587203:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307816832:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21487us (22794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147136.587215:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3296 00002000:00100000:2.0:1746147136.587227:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801312ead80 x1830967307816832/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.587236:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ead80 with x1830967307816832 ext(0->1048575) 00002000:00010000:2.0:1746147136.587242:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ead80 00000100:00100000:2.0:1746147136.590158:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307817088:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 20869us (22882us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147136.590171:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3297 00002000:00100000:2.0:1746147136.590183:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801312e9180 x1830967307817088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.590193:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9180 with x1830967307817088 ext(1048576->2097151) 00002000:00010000:2.0:1746147136.590199:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e9180 00000100:00100000:1.0:1746147136.597843:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307817344:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 25037us (25429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.597854:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3298 00002000:00100000:1.0:1746147136.597864:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801312e8380 x1830967307817344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.597873:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8380 with x1830967307817344 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.597878:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8380 00000100:00100000:2.0:1746147136.600983:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307817600:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 28108us (28523us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147136.600995:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3299 00002000:00100000:2.0:1746147136.601007:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801305f0380 x1830967307817600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.601017:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0380 with x1830967307817600 ext(1048576->2097151) 00002000:00010000:2.0:1746147136.601023:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0380 00000100:00100000:0.0:1746147136.602881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.602962:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307817856 00000100:00100000:3.0:1746147136.602973:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307817856 00000100:00100000:3.0:1746147136.603034:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15180 00000100:00100000:3.0:1746147136.603041:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32108:x1830967307817856:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147136.603067:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147136.603082:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425055296 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77499 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.603161:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425055296 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77499 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.603172:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425055296 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77499 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.603185:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147136.603187:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147136.603190:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48c00, rc 0) 00000100:00100000:3.0:1746147136.603242:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32108:x1830967307817856:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 201us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.603247:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15180 00000100:00100000:0.0:1746147136.606907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.606992:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307817984 00000100:00100000:1.0:1746147136.607002:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307817984 00000100:00100000:1.0:1746147136.607062:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14186 00000100:00100000:1.0:1746147136.607069:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:32105:x1830967307817984:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147136.607083:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147136.607125:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774a0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.607158:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.607167:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.607172:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.607177:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.607179:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.607181:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2879488->3051519] (req 2879488->3051519) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.607206:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.607215:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 11 pid: 9586 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746147136.607224:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310617600:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147136.607584:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.607597:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 28 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746147136.607604:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310617728:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147136.607641:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.607647:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 11 pid: 10340 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746147136.607654:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310617856:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147136.607666:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147136.610869:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.610929:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310617600:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147136.610943:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310617728:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147136.611076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.611131:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310617856:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147136.611384:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307818368 00000100:00100000:2.0:1746147136.611393:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307818368 00010000:00010000:2.0:1746147136.611434:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 12 pid: 9586 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746147136.611548:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6173 00000100:00100000:2.0:1746147136.611558:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307818368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147136.611572:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147136.611594:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 12 pid: 9586 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746147136.611604:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 12 pid: 9586 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746147136.611631:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425055211 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7743e expref: 12 pid: 9586 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746147136.611771:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307818496 00000100:00100000:0.0:1746147136.611774:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307818496 00010000:00010000:0.0:1746147136.611789:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 29 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746147136.611831:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2879488->3051519] (req 2879488->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.611847:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20c00, rc 0) 00000100:00100000:1.0:1746147136.611905:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+11:32105:x1830967307817984:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4835us (5007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.611913:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14186 00000100:00100000:1.0:1746147136.612020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.612087:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147136.612428:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147136.612473:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307818368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 915us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.612476:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307818240 00000100:00100000:2.0:1746147136.612480:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6173 00000100:00100000:3.0:1746147136.612481:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307818240 00000100:00100000:0.0:1746147136.614225:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307818624 00000100:00100000:0.0:1746147136.614233:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307818624 00000100:00100000:2.0:1746147136.614239:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6174 00000100:00100000:2.0:1746147136.614251:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307818496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147136.614257:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 12 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746147136.614269:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147136.614288:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6175 00010000:00010000:2.0:1746147136.614289:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 29 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746147136.614294:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307818624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147136.614302:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 29 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746147136.614303:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147136.614312:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 12 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746147136.614323:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425055234 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77468 expref: 29 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746147136.614324:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 12 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746147136.614337:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147136.614337:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936b7600/0x3139939425055162 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ff expref: 12 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746147136.614339:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.614347:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.614354:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147136.614356:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.614366:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307818752 00010000:00010000:0.0:1746147136.614367:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147136.614372:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307818752 00010000:00010000:2.0:1746147136.614392:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147136.614394:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307818624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147136.614400:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6175 00000100:00100000:2.0:1746147136.614405:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310617984:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147136.614407:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 790 00000100:00100000:1.0:1746147136.614414:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307818752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147136.614425:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147136.614445:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425055296 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77499 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147136.614452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.614458:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00010000:00010000:1.0:1746147136.614463:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147136.614466:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147136.614495:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307818752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.614501:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 790 00000100:00100000:0.0:1746147136.614503:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147136.614515:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147136.614522:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307819136 00000100:00100000:1.0:1746147136.614525:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307819136 00002000:00100000:1.0:1746147136.614545:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880097095880 x1830967307819136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147136.614545:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307818880 00000100:00100000:0.0:1746147136.614548:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307818880 00002000:00100000:1.0:1746147136.614554:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095880 with x1830967307819136 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.614558:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097095880 00000100:00100000:0.0:1746147136.614574:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14187 00000100:00100000:1.0:1746147136.614583:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3300 00000100:00100000:1.0:1746147136.614588:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307819136:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147136.614654:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097d75880 x1830967307818240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.614662:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75880 with x1830967307818240 ext(1048576->2097151) 00002000:00010000:3.0:1746147136.614666:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d75880 00000100:00100000:0.0:1746147136.614673:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32108:x1830967307818880:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147136.614685:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147136.614691:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3301 00010000:00010000:0.0:1746147136.614697:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774a7 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.614698:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307818240:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147136.614713:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.614719:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147136.614721:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147136.614723:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2211840->2797567] (req 2211840->2797567) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.614738:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147136.614747:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 9 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746147136.614755:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310618112:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147136.614775:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147136.614790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.614824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.614837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.614874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.614895:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307819392 00000100:00100000:0.0:1746147136.614897:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307819392 00002000:00100000:0.0:1746147136.614913:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880097094e00 x1830967307819392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.614920:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094e00 with x1830967307819392 ext(1048576->2097151) 00002000:00010000:0.0:1746147136.614923:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094e00 00000100:00100000:0.0:1746147136.614932:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307819648 00000100:00100000:0.0:1746147136.614934:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307819648 00002000:00100000:0.0:1746147136.614944:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097096300 x1830967307819648/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.614950:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096300 with x1830967307819648 ext(1048576->2097151) 00002000:00010000:0.0:1746147136.614952:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097096300 00000100:00100000:0.0:1746147136.614959:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307819904 00000100:00100000:0.0:1746147136.614962:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307819904 00002000:00100000:0.0:1746147136.614969:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880097097800 x1830967307819904/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.614975:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097097800 with x1830967307819904 ext(1048576->2097151) 00002000:00010000:0.0:1746147136.614978:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097097800 00000100:00100000:0.0:1746147136.614984:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307820160 00000100:00100000:0.0:1746147136.614986:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307820160 00002000:00100000:0.0:1746147136.614993:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880097094000 x1830967307820160/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.614999:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094000 with x1830967307820160 ext(1048576->2097151) 00002000:00010000:0.0:1746147136.615002:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094000 00000100:00100000:0.0:1746147136.615007:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3302 00000100:00100000:0.0:1746147136.615011:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307819392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147136.615204:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3303 00000100:00100000:1.0:1746147136.615211:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307819648:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147136.615423:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3304 00000100:00100000:3.0:1746147136.615429:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307819904:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147136.615750:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3305 00000100:00100000:1.0:1746147136.615758:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307820160:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147136.627819:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310618112:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147136.627848:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2211840->2797567] (req 2211840->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.627855:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310617984:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147136.627863:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00010000:00010000:3.0:1746147136.627874:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147136.627913:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32108:x1830967307818880:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 13333us (13460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.627923:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14187 00000100:00100000:2.0:1746147136.627964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.628377:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307818496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 14127us (17298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.628389:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6174 00000100:00100000:2.0:1746147136.628403:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307820416 00000100:00100000:2.0:1746147136.628410:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307820416 00002000:00100000:2.0:1746147136.628461:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2879488->2883583) req@ffff88011e501500 x1830967307820416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.628471:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501500 with x1830967307820416 ext(2879488->2883583) 00010000:00010000:2.0:1746147136.628479:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 12 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.628494:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 12 pid: 1854 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746147136.628500:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e501500 00000100:00100000:2.0:1746147136.628773:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1049 00000100:00100000:2.0:1746147136.628784:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307820416:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147136.628880:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307820416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 100us (918us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147136.628885:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1049 00002000:00100000:2.0:1746147136.628891:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2879488->2883583) req@ffff88011e501500 x1830967307820416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746147147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.628898:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501500 with x1830967307820416 ext(2879488->2883583) 00010000:00010000:2.0:1746147136.628904:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 12 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.628914:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 12 pid: 1854 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746147136.628920:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e501500 00000100:00100000:1.0:1746147136.629486:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307819136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14896us (14981us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.629494:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3300 00002000:00100000:1.0:1746147136.629499:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880097095880 x1830967307819136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.629506:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095880 with x1830967307819136 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.629510:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097095880 00000100:00100000:3.0:1746147136.635530:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307818240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20825us (23501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147136.635541:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3301 00002000:00100000:3.0:1746147136.635551:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097d75880 x1830967307818240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.635560:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75880 with x1830967307818240 ext(1048576->2097151) 00002000:00010000:3.0:1746147136.635565:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d75880 00000100:00100000:1.0:1746147136.636313:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307819392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21299us (21520us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.636320:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3302 00002000:00100000:1.0:1746147136.636325:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880097094e00 x1830967307819392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.636332:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094e00 with x1830967307819392 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.636336:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094e00 00000100:00100000:1.0:1746147136.641559:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307819648:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 26337us (26722us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.641571:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3303 00002000:00100000:1.0:1746147136.641583:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097096300 x1830967307819648/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.641593:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096300 with x1830967307819648 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.641600:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097096300 00000100:00100000:3.0:1746147136.645280:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307819904:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 29839us (30429us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147136.645293:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3304 00002000:00100000:3.0:1746147136.645303:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880097097800 x1830967307819904/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.645312:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097097800 with x1830967307819904 ext(1048576->2097151) 00002000:00010000:3.0:1746147136.645318:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097097800 00000100:00100000:1.0:1746147136.648987:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307820160:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 33221us (34103us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147136.648998:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3305 00002000:00100000:1.0:1746147136.649009:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880097094000 x1830967307820160/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.649017:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094000 with x1830967307820160 ext(1048576->2097151) 00002000:00010000:1.0:1746147136.649021:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094000 00000100:00100000:0.0:1746147136.653162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.653202:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.653288:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307820672 00000100:00100000:2.0:1746147136.653293:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307820800 00000100:00100000:1.0:1746147136.653296:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307820672 00000100:00100000:2.0:1746147136.653302:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307820800 00002000:00100000:1.0:1746147136.653332:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3047424->3051519) req@ffff880097096a00 x1830967307820672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.653341:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096a00 with x1830967307820672 ext(3047424->3051519) 00010000:00010000:1.0:1746147136.653356:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 11 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.653360:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14188 00010000:00010000:1.0:1746147136.653369:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 11 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.653370:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+11:32110:x1830967307820800:12345-192.168.204.25@tcp:101:cat.0 00002000:00010000:1.0:1746147136.653380:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097096a00 00010000:00010000:2.0:1746147136.653387:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147136.653403:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1050 00010000:00010000:2.0:1746147136.653405:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774ae expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.653409:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307820672:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:2.0:1746147136.653433:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147136.653439:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2211840->2797567] (req 2211840->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 28 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.653445:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147136.653449:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.653489:0:12201:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2211840->2797567] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 28 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.653503:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.653514:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093708400, rc 0) 00000100:00100000:1.0:1746147136.653519:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307820672:12345-192.168.204.25@tcp:3:cat.0 Request processed in 109us (364us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147136.653524:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1050 00002000:00100000:1.0:1746147136.653529:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3047424->3051519) req@ffff880097096a00 x1830967307820672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746147147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.653535:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096a00 with x1830967307820672 ext(3047424->3051519) 00010000:00010000:1.0:1746147136.653539:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 12 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.653547:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 12 pid: 1854 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746147136.653551:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097096a00 00000100:00100000:2.0:1746147136.653558:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:32110:x1830967307820800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 189us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.653564:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14188 00000100:00100000:0.0:1746147136.658560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.658718:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.658761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.658842:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307821440 00000100:00100000:2.0:1746147136.658854:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307821440 00000100:00100000:3.0:1746147136.658855:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307821184 00000100:00100000:3.0:1746147136.658862:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307821184 00002000:00100000:3.0:1746147136.658911:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2879488->3051519) req@ffff880097094a80 x1830967307821184/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.658920:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094a80 with x1830967307821184 ext(2879488->3051519) 00000100:00100000:2.0:1746147136.658921:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5406 00010000:00010000:3.0:1746147136.658929:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 11 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746147136.658930:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:32105:x1830967307821440:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:3.0:1746147136.658941:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 11 pid: 1854 timeout: 774 lvb_type: 0 00002000:00010000:3.0:1746147136.658948:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097094a80 00000100:00100000:3.0:1746147136.658964:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1051 00000100:00100000:3.0:1746147136.658970:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307821184:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147136.659254:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32105:x1830967307821440:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 325us (490us total) trans 8589935839 rc 0/0 00000100:00100000:2.0:1746147136.659262:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5406 00000100:00100000:1.0:1746147136.659606:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307820928 00000100:00100000:1.0:1746147136.659610:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307820928 00000100:00100000:1.0:1746147136.659644:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14189 00000100:00100000:1.0:1746147136.659649:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307820928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147136.659657:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147136.659671:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x31399394250552b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774b5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.659713:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310618368:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147136.660930:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746147136.662330:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147134 -> 1746147136 00002000:00010000:1.0:1746147136.662334:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147134 -> 1746147136 00002000:00010000:1.0:1746147136.662336:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147134 -> 1746147136 00000100:00100000:1.0:1746147136.662347:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310618368:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147136.662372:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x31399394250552b2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774b5 expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.662385:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x31399394250552b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774b5 expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147136.662409:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21200, rc 0) 00000100:00100000:1.0:1746147136.662452:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307820928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2802us (3733us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147136.662460:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14189 00000100:00100000:3.0:1746147136.662614:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307821184:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3643us (4061us total) trans 17179874130 rc 0/0 00000100:00100000:3.0:1746147136.662622:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1051 00002000:00100000:3.0:1746147136.662630:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2879488->3051519) req@ffff880097094a80 x1830967307821184/t17179874130(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/448 e 0 to 0 dl 1746147147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.662638:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094a80 with x1830967307821184 ext(2879488->3051519) 00010000:00010000:3.0:1746147136.662645:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 13 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.662656:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 13 pid: 1854 timeout: 774 lvb_type: 0 00002000:00010000:3.0:1746147136.662662:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097094a80 00000100:00100000:0.0:1746147136.667144:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.667327:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307821568 00000100:00100000:1.0:1746147136.667334:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307821568 00000100:00100000:1.0:1746147136.667377:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14190 00000100:00100000:1.0:1746147136.667384:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32111:x1830967307821568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147136.667398:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147136.667412:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774bc expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.667435:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147136.667440:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.667451:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.667460:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21600, rc 0) 00000100:00100000:1.0:1746147136.667505:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32111:x1830967307821568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 121us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.667510:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14190 00000100:00100000:0.0:1746147136.667677:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.667774:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307821696 00000100:00100000:3.0:1746147136.667779:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307821696 00010000:00010000:3.0:1746147136.667799:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 13 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.667817:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6176 00000100:00100000:3.0:1746147136.667823:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307821696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147136.667833:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147136.667850:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 13 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.668376:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 13 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.668398:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x313993942505529d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2879488->3051519) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a0 expref: 13 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.668416:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.668417:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.668423:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.668430:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.668455:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.668466:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 29 pid: 12201 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.668475:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310618496:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147136.668531:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147136.670698:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310618496:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147136.670715:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147136.670760:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307821696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2936us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.670769:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6176 00000100:00100000:2.0:1746147136.672375:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.672843:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307822080 00000100:00100000:3.0:1746147136.672852:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307822080 00002000:00100000:3.0:1746147136.672900:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2211840->2215935) req@ffff88011e503800 x1830967307822080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.672909:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503800 with x1830967307822080 ext(2211840->2215935) 00010000:00010000:3.0:1746147136.672919:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.672931:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00002000:00010000:3.0:1746147136.672938:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e503800 00000100:00100000:3.0:1746147136.672958:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1052 00000100:00100000:3.0:1746147136.672966:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307822080:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147136.673142:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307822080:12345-192.168.204.25@tcp:3:cat.0 Request processed in 177us (775us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147136.673148:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1052 00002000:00100000:3.0:1746147136.673153:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2211840->2215935) req@ffff88011e503800 x1830967307822080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746147147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.673160:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503800 with x1830967307822080 ext(2211840->2215935) 00010000:00010000:3.0:1746147136.673165:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.673174:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00002000:00010000:3.0:1746147136.673180:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e503800 00000100:00100000:0.0:1746147136.678828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.679001:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307822336 00000100:00100000:2.0:1746147136.679010:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307822336 00002000:00100000:2.0:1746147136.679057:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2793472->2797567) req@ffff8801349a1f80 x1830967307822336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.679067:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1f80 with x1830967307822336 ext(2793472->2797567) 00010000:00010000:2.0:1746147136.679077:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.679119:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746147136.679127:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801349a1f80 00000100:00100000:2.0:1746147136.679155:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1053 00000100:00100000:2.0:1746147136.679163:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307822336:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147136.680032:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307822336:12345-192.168.204.25@tcp:3:cat.0 Request processed in 867us (1210us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147136.680039:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1053 00002000:00100000:2.0:1746147136.680045:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2793472->2797567) req@ffff8801349a1f80 x1830967307822336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746147147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.680060:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1f80 with x1830967307822336 ext(2793472->2797567) 00010000:00010000:2.0:1746147136.680067:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.680077:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746147136.680082:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801349a1f80 00000100:00100000:0.0:1746147136.686192:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.686395:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307822592 00000100:00100000:2.0:1746147136.686403:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307822592 00002000:00100000:2.0:1746147136.686445:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2211840->2797567) req@ffff8801349a3800 x1830967307822592/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.686455:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3800 with x1830967307822592 ext(2211840->2797567) 00010000:00010000:2.0:1746147136.686464:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.686482:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 30 pid: 12201 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746147136.686489:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801349a3800 00000100:00100000:2.0:1746147136.686520:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1054 00000100:00100000:2.0:1746147136.686527:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307822592:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147136.699814:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307822592:12345-192.168.204.25@tcp:4:cat.0 Request processed in 13278us (13621us total) trans 17179874131 rc 0/0 00000100:00100000:2.0:1746147136.699825:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1054 00002000:00100000:2.0:1746147136.699835:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2211840->2797567) req@ffff8801349a3800 x1830967307822592/t17179874131(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/448 e 0 to 0 dl 1746147147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.699844:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3800 with x1830967307822592 ext(2211840->2797567) 00010000:00010000:2.0:1746147136.699853:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746147136.699867:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746147136.699874:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801349a3800 00000100:00100000:0.0:1746147136.703331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.705818:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307822720 00000100:00100000:3.0:1746147136.705828:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307822720 00010000:00010000:3.0:1746147136.705867:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.705989:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6177 00000100:00100000:3.0:1746147136.705997:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307822720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147136.706011:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147136.706030:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.706042:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.706072:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250552a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->2797567) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774a7 expref: 32 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746147136.706181:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.706183:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.706190:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.706207:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.706215:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.706216:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.706219:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.706226:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.706255:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.706266:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310618624:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147136.706366:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.706374:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310618752:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147136.706610:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147136.711835:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310618752:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147136.717707:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310618624:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147136.717728:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147136.718590:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307822720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 12590us (15264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.718602:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6177 00000100:00100000:0.0:1746147136.721012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.721071:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.721228:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307823104 00000100:00100000:3.0:1746147136.721236:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307823104 00002000:00100000:3.0:1746147136.721273:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801349a3480 x1830967307823104/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.721283:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3480 with x1830967307823104 ext(2097152->4194303) 00002000:00010000:3.0:1746147136.721288:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3480 00000100:00100000:3.0:1746147136.721313:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307823232 00000100:00100000:3.0:1746147136.721316:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307823232 00002000:00100000:3.0:1746147136.721328:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a2300 x1830967307823232/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.721334:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967307823232 ext(2097152->4194303) 00002000:00010000:3.0:1746147136.721336:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2300 00000100:00100000:3.0:1746147136.721348:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3306 00000100:00100000:3.0:1746147136.721354:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307823104:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147136.721593:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3307 00000100:00100000:1.0:1746147136.721602:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307823232:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147136.729119:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.729158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.729243:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307823488 00000100:00100000:1.0:1746147136.729248:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307823744 00000100:00100000:2.0:1746147136.729252:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307823488 00000100:00100000:1.0:1746147136.729253:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307823744 00002000:00100000:2.0:1746147136.729287:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801349a0000 x1830967307823488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.729287:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a3100 x1830967307823744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.729296:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0000 with x1830967307823488 ext(2097152->4194303) 00002000:00100000:1.0:1746147136.729296:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3100 with x1830967307823744 ext(2097152->4194303) 00002000:00010000:2.0:1746147136.729301:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0000 00002000:00010000:1.0:1746147136.729301:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a3100 00000100:00100000:2.0:1746147136.729325:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3308 00000100:00100000:1.0:1746147136.729330:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3309 00000100:00100000:2.0:1746147136.729333:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307823488:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147136.729336:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967307823744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147136.738392:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307823104:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17028us (17378us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147136.738402:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3306 00002000:00100000:2.0:1746147136.738412:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801349a3480 x1830967307823104/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.738420:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3480 with x1830967307823104 ext(2097152->4194303) 00002000:00010000:2.0:1746147136.738425:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3480 00000100:00100000:1.0:1746147136.754941:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307823232:12345-192.168.204.25@tcp:3:cat.0 Request processed in 33329us (33857us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147136.754954:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3307 00002000:00100000:1.0:1746147136.754966:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a2300 x1830967307823232/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.754981:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967307823232 ext(2097152->4194303) 00002000:00010000:1.0:1746147136.754986:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2300 00000100:00100000:2.0:1746147136.763734:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307823488:12345-192.168.204.25@tcp:3:cat.0 Request processed in 34392us (34613us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147136.763745:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3308 00002000:00100000:2.0:1746147136.763755:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801349a0000 x1830967307823488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.763763:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0000 with x1830967307823488 ext(2097152->4194303) 00002000:00010000:2.0:1746147136.763768:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0000 00000100:00100000:1.0:1746147136.777877:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967307823744:12345-192.168.204.25@tcp:3:cat.0 Request processed in 48532us (48710us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147136.777889:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3309 00002000:00100000:1.0:1746147136.777899:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a3100 x1830967307823744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.777908:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3100 with x1830967307823744 ext(2097152->4194303) 00002000:00010000:1.0:1746147136.777912:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a3100 00000100:00100000:0.0:1746147136.791270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.791578:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307824000 00000100:00100000:1.0:1746147136.791587:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307824000 00002000:00100000:1.0:1746147136.791627:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8801349a1180 x1830967307824000/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147136.791637:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1180 with x1830967307824000 ext(4194304->4919295) 00002000:00010000:1.0:1746147136.791642:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a1180 00000100:00100000:1.0:1746147136.791675:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3310 00000100:00100000:1.0:1746147136.791683:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307824000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147136.798164:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.798936:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307824256 00000100:00100000:1.0:1746147136.798944:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307824256 00000100:00100000:1.0:1746147136.798993:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15181 00000100:00100000:1.0:1746147136.799001:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32115:x1830967307824256:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147136.799020:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147136.799035:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x31399394250552c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774c3 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.799118:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799129:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799138:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799148:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799154:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799158:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799275:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799284:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799289:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147136.799297:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147136.799349:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799354:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799363:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799368:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799372:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a20c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147136.799376:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799381:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799389:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147136.799391:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147136.799394:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799398:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x31399394250552c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799418:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799422:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799426:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799430:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a21200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147136.799433:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799440:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799445:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ec09800) 00010000:00010000:1.0:1746147136.799447:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147136.799449:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799453:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21200/0x31399394250552ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147136.799480:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x31399394250552c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.799489:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.799494:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147136.799496:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147136.799498:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20e00, rc 0) 00000100:00100000:1.0:1746147136.799534:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32115:x1830967307824256:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 534us (1379us total) trans 8589935840 rc 0/0 00000100:00100000:1.0:1746147136.799540:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15181 00000100:00100000:0.0:1746147136.800517:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.800919:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307824000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9234us (9654us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147136.800927:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3310 00002000:00100000:3.0:1746147136.800936:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8801349a1180 x1830967307824000/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.800945:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1180 with x1830967307824000 ext(4194304->4919295) 00002000:00010000:3.0:1746147136.800949:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a1180 00000100:00100000:3.0:1746147136.800963:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307824512 00000100:00100000:3.0:1746147136.800967:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307824512 00002000:00100000:3.0:1746147136.800987:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009c30bb80 x1830967307824512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.800993:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30bb80 with x1830967307824512 ext(4194304->4919295) 00002000:00010000:3.0:1746147136.800996:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30bb80 00000100:00100000:3.0:1746147136.801015:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3311 00000100:00100000:3.0:1746147136.801020:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307824512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147136.806689:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307824512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5660us (6167us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147136.806703:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3311 00002000:00100000:3.0:1746147136.806713:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009c30bb80 x1830967307824512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:512/0 lens 488/440 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147136.806722:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30bb80 with x1830967307824512 ext(4194304->4919295) 00002000:00010000:3.0:1746147136.806727:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30bb80 00000100:00100000:0.0:1746147136.818595:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.818665:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307824768 00000100:00100000:2.0:1746147136.818673:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307824768 00000100:00100000:2.0:1746147136.818724:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5407 00000100:00100000:2.0:1746147136.818731:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32110:x1830967307824768:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147136.818898:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:32110:x1830967307824768:12345-192.168.204.25@tcp:35:cat.0 Request processed in 167us (310us total) trans 8589935841 rc 0/0 00000100:00100000:2.0:1746147136.818906:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5407 00000100:00100000:0.0:1746147136.820501:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.820773:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307825024 00000100:00100000:2.0:1746147136.820779:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307825024 00000100:00100000:2.0:1746147136.820817:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5408 00000100:00100000:2.0:1746147136.820827:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32111:x1830967307825024:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147136.821396:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32111:x1830967307825024:12345-192.168.204.25@tcp:35:cat.0 Request processed in 571us (896us total) trans 8589935842 rc 0/0 00000100:00100000:2.0:1746147136.821402:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5408 00000100:00100000:0.0:1746147136.930657:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.936422:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307825280 00000100:00100000:3.0:1746147136.936434:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307825280 00000100:00100000:3.0:1746147136.936500:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15182 00000100:00100000:3.0:1746147136.936509:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32119:x1830967307825280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147136.936530:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147136.936546:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x31399394250552e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774ca expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.936610:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936622:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936635:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936647:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936651:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936655:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936738:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936747:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936753:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147136.936761:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147136.936826:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936831:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936837:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936842:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094182c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147136.936845:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936851:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936860:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147136.936862:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147136.936865:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936869:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x31399394250552ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936899:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936904:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936909:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936912:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147136.936914:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936918:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936923:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23100) 00010000:00010000:3.0:1746147136.936925:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147136.936927:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936931:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x31399394250552f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147136.936965:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x31399394250552e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 32 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.936975:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.936981:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147136.936983:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147136.936984:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2be00, rc 0) 00000100:00100000:3.0:1746147136.937052:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32119:x1830967307825280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 536us (6963us total) trans 8589935843 rc 0/0 00000100:00100000:3.0:1746147136.937058:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15182 00000100:00100000:1.0:1746147136.941612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.941708:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.941762:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307825664 00000100:00100000:3.0:1746147136.941770:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307825664 00000100:00100000:2.0:1746147136.941773:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307825408 00000100:00100000:2.0:1746147136.941778:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307825408 00000100:00100000:2.0:1746147136.941807:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14191 00000100:00100000:2.0:1746147136.941814:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:32115:x1830967307825408:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:3.0:1746147136.941820:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5409 00000100:00100000:3.0:1746147136.941825:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32119:x1830967307825664:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:2.0:1746147136.941829:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147136.941844:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774d1 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.941870:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.941879:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.941887:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.941898:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.941899:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147136.941903:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147136.941928:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.941939:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 13 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746147136.941950:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310618880:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147136.942003:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32119:x1830967307825664:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 173us (290us total) trans 8589935844 rc 0/0 00000100:00100000:3.0:1746147136.942012:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5409 00010000:00010000:2.0:1746147136.942025:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.942033:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 30 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746147136.942040:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619008:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147136.942078:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147136.942085:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 10 pid: 10340 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746147136.942115:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619136:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147136.942151:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147136.950798:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.952194:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310618880:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147136.952388:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307825792 00000100:00100000:3.0:1746147136.952395:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307825792 00010000:00010000:3.0:1746147136.952422:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 14 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746147136.952458:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6178 00000100:00100000:3.0:1746147136.952464:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307825792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147136.952476:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147136.952491:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 14 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746147136.952500:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 14 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746147136.952518:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x313993942505520a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77430 expref: 14 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746147136.952541:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147136.952581:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307825792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.952587:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6178 00000100:00100000:0.0:1746147136.956375:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.956413:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.957563:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307825920 00000100:00100000:1.0:1746147136.957572:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307825920 00010000:00010000:1.0:1746147136.957606:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 31 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746147136.957634:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307826048 00000100:00100000:1.0:1746147136.957636:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307826048 00010000:00010000:1.0:1746147136.957646:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 11 pid: 10340 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746147136.957664:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6179 00000100:00100000:1.0:1746147136.957671:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307825920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147136.957683:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147136.957697:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 31 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746147136.957706:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 31 pid: 9585 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746147136.957708:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619008:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147136.957719:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619136:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147136.957723:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505521f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77461 expref: 31 pid: 9585 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746147136.957738:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147136.957746:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.957757:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09f400, rc 0) 00000100:00100000:1.0:1746147136.957770:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307825920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 99us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.957775:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6179 00000100:00100000:1.0:1746147136.957786:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6180 00000100:00100000:1.0:1746147136.957790:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307826048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147136.957795:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147136.957801:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 11 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746147136.957809:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 11 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746147136.957817:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936b7000/0x3139939425055154 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f8 expref: 11 pid: 10340 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746147136.957824:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.957826:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.957831:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.957838:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.957855:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:32115:x1830967307825408:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 16040us (16249us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147136.957860:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147136.957862:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14191 00000100:00100000:1.0:1746147136.957869:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310619264:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147136.957911:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147136.961349:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310619264:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147136.961372:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147136.961411:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307826048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3619us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.961420:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6180 00000100:00100000:0.0:1746147136.961521:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.961591:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307826304 00000100:00100000:2.0:1746147136.961597:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307826304 00002000:00100000:2.0:1746147136.961631:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1716224->1720319) req@ffff88013209b800 x1830967307826304/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.961639:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209b800 with x1830967307826304 ext(1716224->1720319) 00002000:00010000:2.0:1746147136.961643:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209b800 00000100:00100000:2.0:1746147136.961657:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3312 00000100:00100000:2.0:1746147136.961663:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307826304:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147136.961755:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307826304:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 92us (236us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147136.961760:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3312 00002000:00100000:2.0:1746147136.961764:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1716224->1720319) req@ffff88013209b800 x1830967307826304/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147136.961770:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013209b800 with x1830967307826304 ext(1716224->1720319) 00002000:00010000:2.0:1746147136.961772:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013209b800 00000100:00100000:0.0:1746147136.966327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147136.967152:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307826432 00000100:00100000:3.0:1746147136.967161:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307826432 00000100:00100000:3.0:1746147136.967209:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14192 00000100:00100000:3.0:1746147136.967215:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:32115:x1830967307826432:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147136.967229:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147136.967243:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774d8 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.967266:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.967274:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.967280:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.967281:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147136.967284:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2506751] (req 2097152->2506751) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.967306:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.967315:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 29 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.967325:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619392:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147136.967398:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.967409:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 13 pid: 12201 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.967416:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619520:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147136.967429:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147136.979273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.979358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147136.979674:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307826560 00000100:00100000:1.0:1746147136.979681:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307826560 00010000:00010000:1.0:1746147136.979712:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 30 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746147136.979736:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307826688 00000100:00100000:1.0:1746147136.979738:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307826688 00010000:00010000:1.0:1746147136.979747:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 14 pid: 12201 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746147136.979762:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6181 00000100:00100000:1.0:1746147136.979768:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307826560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147136.979780:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147136.979795:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 30 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.979806:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 30 pid: 1854 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.979826:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147136.979861:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307826560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147136.979867:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6181 00000100:00100000:1.0:1746147136.979880:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6182 00000100:00100000:1.0:1746147136.979884:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307826688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147136.979891:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147136.979896:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 14 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.979905:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 14 pid: 12201 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746147136.979914:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.979916:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147136.979922:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.979929:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147136.979953:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147136.979963:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310619648:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147136.980007:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147136.981060:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21600/0x31399394250552b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774bc expref: 29 pid: 1854 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.981086:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619392:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147136.981115:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x31399394250552ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ae expref: 14 pid: 12201 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746147136.981122:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310619520:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147136.981138:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147136.981147:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b600, rc 0) 00000100:00100000:3.0:1746147136.982027:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+13:32115:x1830967307826432:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 14808us (15705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147136.982035:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14192 00000100:00100000:2.0:1746147136.982513:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310619648:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147136.982523:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147136.982543:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307826688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2658us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147136.982553:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6182 00000100:00100000:3.0:1746147136.986705:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147136.987115:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307826944 00000100:00100000:0.0:1746147136.987122:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307826944 00002000:00100000:0.0:1746147136.987156:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2502656->2506751) req@ffff8800a897d500 x1830967307826944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/0 e 0 to 0 dl 1746147147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.987165:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d500 with x1830967307826944 ext(2502656->2506751) 00002000:00010000:0.0:1746147136.987171:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897d500 00000100:00100000:0.0:1746147136.987196:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3313 00000100:00100000:0.0:1746147136.987201:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307826944:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147136.987310:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307826944:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 108us (613us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147136.987315:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3313 00002000:00100000:0.0:1746147136.987320:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2502656->2506751) req@ffff8800a897d500 x1830967307826944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746147147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147136.987332:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d500 with x1830967307826944 ext(2502656->2506751) 00002000:00010000:0.0:1746147136.987334:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897d500 00000100:00100000:0.0:1746147136.990376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147136.990466:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307827200 00000100:00100000:2.0:1746147136.990473:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307827200 00000100:00100000:2.0:1746147136.990519:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5410 00000100:00100000:2.0:1746147136.990526:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:32115:x1830967307827200:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147136.990684:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:32115:x1830967307827200:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 158us (314us total) trans 8589935845 rc 0/0 00000100:00100000:2.0:1746147136.990691:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5410 00000100:00100000:0.0:1746147137.010640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.010755:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307827328 00000100:00100000:3.0:1746147137.010765:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307827328 00000100:00100000:3.0:1746147137.010828:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14193 00000100:00100000:3.0:1746147137.010839:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32119:x1830967307827328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147137.010859:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.010880:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774df expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.010911:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.010920:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.010927:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.010933:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.010935:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.010939:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.010969:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.010980:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 7 pid: 9586 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.010993:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310619776:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.011128:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.011138:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 27 pid: 9585 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.011146:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310619904:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.011189:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.011196:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 10 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.011203:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310620032:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.011219:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.015941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.015968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.015995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.016123:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307827456 00000100:00100000:0.0:1746147137.016133:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307827456 00010000:00010000:0.0:1746147137.016181:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 11 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.016206:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310619776:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.016209:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307827584 00000100:00100000:0.0:1746147137.016211:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307827584 00000100:00100000:3.0:1746147137.016217:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310619904:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147137.016220:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.016225:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310620032:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.016232:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307827712 00000100:00100000:0.0:1746147137.016234:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307827712 00010000:00010000:0.0:1746147137.016243:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 28 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746147137.016252:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 28 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.016256:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6183 00000100:00100000:0.0:1746147137.016264:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307827456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.016267:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b800, rc 0) 00010000:00010000:0.0:1746147137.016277:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.016297:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 11 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016306:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 11 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.016312:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32119:x1830967307827328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5476us (5686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.016319:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14193 00010000:00010000:0.0:1746147137.016329:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055169 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77406 expref: 11 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016343:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.016364:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307827456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.016370:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6183 00000100:00100000:0.0:1746147137.016379:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6184 00000100:00100000:0.0:1746147137.016384:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307827584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.016390:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.016395:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016403:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016413:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425055218 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77445 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016421:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.016439:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307827584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.016448:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6184 00000100:00100000:0.0:1746147137.016487:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6185 00000100:00100000:0.0:1746147137.016492:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307827712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.016498:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.016505:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 27 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016515:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 27 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016526:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425055226 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7746f expref: 27 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.016535:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.016537:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.016545:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.016553:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.016581:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.016594:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310620160:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147137.016656:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.024493:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.024524:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307827968 00000100:00100000:2.0:1746147137.024531:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307827968 00002000:00100000:2.0:1746147137.024567:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3620864->3624959) req@ffff88011e501f80 x1830967307827968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.024577:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501f80 with x1830967307827968 ext(3620864->3624959) 00002000:00010000:2.0:1746147137.024582:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e501f80 00000100:00100000:2.0:1746147137.024612:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3314 00000100:00100000:2.0:1746147137.024619:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307827968:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147137.024734:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307827968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 115us (249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147137.024734:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310620160:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.024740:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3314 00002000:00100000:2.0:1746147137.024745:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3620864->3624959) req@ffff88011e501f80 x1830967307827968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.024752:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501f80 with x1830967307827968 ext(3620864->3624959) 00002000:00010000:2.0:1746147137.024755:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e501f80 00010000:00010000:0.0:1746147137.024757:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.026727:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307827712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10226us (10721us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.026742:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6185 00000100:00100000:0.0:1746147137.031367:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.031497:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307828096 00000100:00100000:3.0:1746147137.031507:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307828096 00000100:00100000:3.0:1746147137.032141:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14194 00000100:00100000:3.0:1746147137.032153:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32119:x1830967307828096:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147137.032176:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.032196:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774e6 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.032227:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.032235:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.032236:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.032239:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.032271:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.032289:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 11 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.032301:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310620288:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.032613:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147137.034934:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310620288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.034969:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.034994:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ae00, rc 0) 00000100:00100000:3.0:1746147137.035040:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32119:x1830967307828096:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2889us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.035058:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14194 00000100:00100000:0.0:1746147137.035478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.036162:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307828224 00000100:00100000:3.0:1746147137.036170:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307828224 00002000:00100000:3.0:1746147137.036214:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2506751) req@ffff88009cd45f80 x1830967307828224/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.036224:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45f80 with x1830967307828224 ext(2097152->2506751) 00010000:00010000:3.0:1746147137.036232:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 12 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.036247:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 12 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746147137.036255:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd45f80 00000100:00100000:3.0:1746147137.036285:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1055 00000100:00100000:3.0:1746147137.036292:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307828224:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147137.041403:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307828224:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5097us (5911us total) trans 17179874132 rc 0/0 00000100:00100000:0.0:1746147137.041417:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1055 00002000:00100000:0.0:1746147137.041430:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2506751) req@ffff88009cd45f80 x1830967307828224/t17179874132(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/448 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147137.041439:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45f80 with x1830967307828224 ext(2097152->2506751) 00010000:00010000:0.0:1746147137.041451:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.041466:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:0.0:1746147137.041472:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd45f80 00000100:00100000:0.0:1746147137.047256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.047450:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307828352 00000100:00100000:2.0:1746147137.047459:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307828352 00010000:00010000:2.0:1746147137.047578:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.049388:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6186 00000100:00100000:2.0:1746147137.049407:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307828352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.049426:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.049454:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.049471:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.049500:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505530d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d8 expref: 14 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.049536:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.049539:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.049546:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.049554:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.049593:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.049605:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310620416:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.049713:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.057266:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.057379:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.057490:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307828864 00000100:00100000:1.0:1746147137.057500:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307828864 00000100:00100000:1.0:1746147137.057542:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307828736 00000100:00100000:1.0:1746147137.057544:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307828736 00000100:00100000:1.0:1746147137.057561:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15183 00000100:00100000:1.0:1746147137.057570:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32127:x1830967307828864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.057593:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.057614:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x3139939425055322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774ed expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.057695:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057707:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057719:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057730:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057735:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057740:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057837:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425055337 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057846:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425055337 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057852:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425055337 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147137.057858:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147137.057925:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057930:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057939:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057944:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057949:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a21600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147137.057952:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057959:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057968:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147137.057971:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147137.057975:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057979:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x3139939425055329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.057995:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058000:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058004:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058008:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a21e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147137.058010:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058017:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058022:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ec09800) 00010000:00010000:1.0:1746147137.058024:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147137.058026:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058030:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x3139939425055330 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058074:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20c00/0x3139939425055322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ed expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.058084:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425055337 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ed expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.058113:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.058115:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147137.058117:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20600, rc 0) 00000100:00100000:1.0:1746147137.058163:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013209aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32127:x1830967307828864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 594us (909us total) trans 8589935846 rc 0/0 00000100:00100000:1.0:1746147137.058170:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15183 00000100:00100000:1.0:1746147137.058183:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15184 00000100:00100000:1.0:1746147137.058188:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:32126:x1830967307828736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.058198:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.058204:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20400/0x3139939425055345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774f4 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.058231:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058237:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058241:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058250:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058255:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058260:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058287:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72400/0x313993942505535a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058293:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72400/0x313993942505535a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058298:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72400/0x313993942505535a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147137.058302:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147137.058325:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058330:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058336:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058340:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058343:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a20000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147137.058345:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058349:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058354:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147137.058356:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147137.058358:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058362:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20000/0x313993942505534c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058368:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058372:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058376:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058379:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a73800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147137.058381:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058388:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058392:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ec09700) 00010000:00010000:1.0:1746147137.058394:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147137.058396:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058399:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73800/0x3139939425055353 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147137.058417:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20400/0x3139939425055345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774f4 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.058424:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72400/0x313993942505535a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774f4 expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.058430:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.058432:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147137.058433:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a72400, rc 0) 00000100:00100000:1.0:1746147137.058449:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:32126:x1830967307828736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 261us (1070us total) trans 8589935847 rc 0/0 00000100:00100000:1.0:1746147137.058453:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15184 00000100:00100000:2.0:1746147137.059520:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310620416:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.059539:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.059566:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307828352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10168us (12320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.059575:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6186 00000100:00100000:0.0:1746147137.059992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.060063:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307829120 00000100:00100000:2.0:1746147137.060068:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307829120 00002000:00100000:2.0:1746147137.060130:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4222976->4227071) req@ffff880094525c00 x1830967307829120/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.060139:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525c00 with x1830967307829120 ext(4222976->4227071) 00002000:00010000:2.0:1746147137.060144:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094525c00 00000100:00100000:2.0:1746147137.060159:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3315 00000100:00100000:2.0:1746147137.060170:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307829120:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147137.060276:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307829120:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (285us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147137.060282:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3315 00002000:00100000:2.0:1746147137.060286:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4222976->4227071) req@ffff880094525c00 x1830967307829120/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.060293:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525c00 with x1830967307829120 ext(4222976->4227071) 00002000:00010000:2.0:1746147137.060296:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094525c00 00000100:00100000:0.0:1746147137.062051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.062137:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307829248 00000100:00100000:2.0:1746147137.062142:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307829248 00000100:00100000:2.0:1746147137.062184:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 791 00000100:00100000:2.0:1746147137.062190:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307829248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.062201:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.062224:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425055337 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ed expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.062251:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.062255:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.062291:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307829248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.062297:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 791 00000100:00100000:0.0:1746147137.062709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.062744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.062789:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307829376 00000100:00100000:1.0:1746147137.062793:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307829376 00000100:00100000:1.0:1746147137.062815:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 792 00000100:00100000:1.0:1746147137.062820:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307829376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147137.062827:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147137.062838:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72400/0x313993942505535a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774f4 expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.062847:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.062850:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147137.062868:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307829376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.062874:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 792 00000100:00100000:3.0:1746147137.062918:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307829504 00000100:00100000:3.0:1746147137.062922:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307829504 00000100:00100000:3.0:1746147137.062944:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14195 00000100:00100000:3.0:1746147137.062949:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307829504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.062963:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.062979:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425055368 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e774fb expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.063022:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310620544:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147137.063076:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.064605:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.064644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.064712:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307829632 00000100:00100000:1.0:1746147137.064718:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307829632 00000100:00100000:1.0:1746147137.064747:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307829760 00000100:00100000:1.0:1746147137.064749:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307829760 00000100:00100000:1.0:1746147137.064764:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14196 00000100:00100000:1.0:1746147137.064771:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307829632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.064784:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.064797:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x313993942505536f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77502 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.064835:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310620672:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147137.064897:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147137.064986:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14197 00000100:00100000:1.0:1746147137.064992:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307829760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.064999:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.065012:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425055376 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77509 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.065036:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310620800:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147137.065070:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147137.067184:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310620672:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147137.067216:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x313993942505536f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77502 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.067230:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x313993942505536f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77502 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.067239:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73600, rc 0) 00000100:00100000:1.0:1746147137.067276:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307829632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2505us (2674us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147137.067284:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14196 00002000:00010000:3.0:1746147137.067634:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147132 -> 1746147136 00002000:00010000:3.0:1746147137.067638:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147132 -> 1746147136 00002000:00010000:3.0:1746147137.067640:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147133 -> 1746147136 00000100:00100000:3.0:1746147137.067648:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310620544:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147137.067665:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425055368 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774fb expref: 31 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.067673:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425055368 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774fb expref: 31 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.067685:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a400, rc 0) 00000100:00100000:3.0:1746147137.067703:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307829504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4754us (4958us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147137.067708:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14195 00002000:00010000:0.0:1746147137.067808:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147135 -> 1746147136 00002000:00010000:0.0:1746147137.067812:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147135 -> 1746147136 00002000:00010000:0.0:1746147137.067813:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147135 -> 1746147136 00000100:00100000:0.0:1746147137.067825:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310620800:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147137.067841:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425055376 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77509 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.067849:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425055376 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77509 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.067860:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:0.0:1746147137.067878:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307829760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2886us (3233us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147137.067883:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14197 00000100:00100000:1.0:1746147137.073635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.074453:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307830016 00000100:00100000:0.0:1746147137.074463:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307830016 00002000:00100000:0.0:1746147137.074515:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880097d77480 x1830967307830016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147137.074525:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77480 with x1830967307830016 ext(0->1048575) 00002000:00010000:0.0:1746147137.074531:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d77480 00000100:00100000:0.0:1746147137.074568:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3316 00000100:00100000:0.0:1746147137.074577:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307830016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147137.078624:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.079052:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307830272 00000100:00100000:3.0:1746147137.079062:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307830272 00002000:00100000:3.0:1746147137.079130:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009f3e6850 x1830967307830272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.079140:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6850 with x1830967307830272 ext(0->1048575) 00002000:00010000:3.0:1746147137.079146:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e6850 00000100:00100000:3.0:1746147137.079180:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3317 00000100:00100000:3.0:1746147137.079189:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307830272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147137.079225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.079280:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307830528 00000100:00100000:0.0:1746147137.079284:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307830528 00002000:00100000:0.0:1746147137.079300:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1716223) req@ffff880097d76680 x1830967307830528/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147137.079307:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76680 with x1830967307830528 ext(1048576->1716223) 00002000:00010000:0.0:1746147137.079310:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d76680 00000100:00100000:0.0:1746147137.079320:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3318 00000100:00100000:0.0:1746147137.079324:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307830528:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147137.087452:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307830016:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12863us (13816us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147137.087466:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3316 00002000:00100000:2.0:1746147137.087478:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880097d77480 x1830967307830016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.087488:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77480 with x1830967307830016 ext(0->1048575) 00002000:00010000:2.0:1746147137.087495:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d77480 00000100:00100000:2.0:1746147137.095789:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307830528:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16450us (16556us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746147137.095802:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3318 00002000:00100000:2.0:1746147137.095815:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1716223) req@ffff880097d76680 x1830967307830528/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.095832:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76680 with x1830967307830528 ext(1048576->1716223) 00002000:00010000:2.0:1746147137.095838:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d76680 00000100:00100000:3.0:1746147137.098819:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307830272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18229us (18803us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147137.098835:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3317 00002000:00100000:3.0:1746147137.098850:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009f3e6850 x1830967307830272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.098860:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6850 with x1830967307830272 ext(0->1048575) 00002000:00010000:3.0:1746147137.098867:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e6850 00000100:00100000:0.0:1746147137.103451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.103740:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307830656 00000100:00100000:2.0:1746147137.103749:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307830656 00000100:00100000:2.0:1746147137.103811:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14198 00000100:00100000:2.0:1746147137.103820:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32127:x1830967307830656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147137.103840:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.103859:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77510 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.103894:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.103902:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147137.103903:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147137.103907:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.103938:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.103950:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 12 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.103963:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310620928:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147137.104074:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.107826:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310620928:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.107854:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.107870:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f200, rc 0) 00000100:00100000:2.0:1746147137.107927:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32127:x1830967307830656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4107us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.107935:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14198 00000100:00100000:0.0:1746147137.108194:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.108329:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307830784 00000100:00100000:3.0:1746147137.108335:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307830784 00002000:00100000:3.0:1746147137.108365:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1716224->2097151) req@ffff880096cfb480 x1830967307830784/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.108374:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb480 with x1830967307830784 ext(1716224->2097151) 00010000:00010000:3.0:1746147137.108380:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 13 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.108391:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 13 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746147137.108398:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cfb480 00000100:00100000:3.0:1746147137.108422:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1056 00000100:00100000:3.0:1746147137.108427:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307830784:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147137.110728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.112176:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307830912 00000100:00100000:3.0:1746147137.112188:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307830912 00000100:00100000:3.0:1746147137.112232:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14199 00000100:00100000:3.0:1746147137.112241:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:32126:x1830967307830912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.112257:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.112275:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77517 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.112305:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.112310:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.112322:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.112332:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a600, rc 0) 00000100:00100000:3.0:1746147137.112388:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:32126:x1830967307830912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 148us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.112394:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14199 00000100:00100000:2.0:1746147137.114997:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307830784:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6557us (6791us total) trans 17179874133 rc 0/0 00000100:00100000:2.0:1746147137.115009:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1056 00002000:00100000:2.0:1746147137.115022:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1716224->2097151) req@ffff880096cfb480 x1830967307830784/t17179874133(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/448 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.115031:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb480 with x1830967307830784 ext(1716224->2097151) 00010000:00010000:2.0:1746147137.115050:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 16 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.115067:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 16 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.115074:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cfb480 00000100:00100000:0.0:1746147137.118693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.118757:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307831040 00000100:00100000:2.0:1746147137.118766:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307831040 00010000:00010000:2.0:1746147137.118816:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 16 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.118866:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6187 00000100:00100000:2.0:1746147137.118874:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307831040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.118892:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.118913:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 16 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.118925:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 16 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.118951:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f09f400/0x3139939425055306 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774d1 expref: 16 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.119377:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.119380:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.119388:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.119396:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.119404:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.119405:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.119408:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.119414:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.119452:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.119465:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621056:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.119987:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.119996:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621184:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.120018:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.124439:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.124876:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621056:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.124889:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621184:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.124912:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.124957:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307831040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6083us (6271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.124967:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6187 00000100:00100000:3.0:1746147137.125193:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307831296 00000100:00100000:3.0:1746147137.125200:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307831296 00002000:00100000:3.0:1746147137.125240:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880096cfad80 x1830967307831296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.125249:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfad80 with x1830967307831296 ext(1048576->2097151) 00002000:00010000:3.0:1746147137.125253:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cfad80 00000100:00100000:3.0:1746147137.125284:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3319 00000100:00100000:3.0:1746147137.125291:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307831296:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147137.127070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.127126:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307831552 00000100:00100000:2.0:1746147137.127133:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307831552 00002000:00100000:2.0:1746147137.127719:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880096cf9c00 x1830967307831552/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.127728:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9c00 with x1830967307831552 ext(1048576->2097151) 00002000:00010000:2.0:1746147137.127733:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9c00 00000100:00100000:2.0:1746147137.127773:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3320 00000100:00100000:2.0:1746147137.127781:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307831552:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147137.132252:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307831296:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6947us (7810us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147137.132266:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3319 00002000:00100000:3.0:1746147137.132280:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880096cfad80 x1830967307831296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.132289:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfad80 with x1830967307831296 ext(1048576->2097151) 00002000:00010000:3.0:1746147137.132294:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cfad80 00000100:00100000:2.0:1746147137.135001:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307831552:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7208us (7929us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147137.135015:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3320 00002000:00100000:2.0:1746147137.135025:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880096cf9c00 x1830967307831552/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.135035:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9c00 with x1830967307831552 ext(1048576->2097151) 00002000:00010000:2.0:1746147137.135050:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9c00 00000100:00100000:0.0:1746147137.142507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.142701:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307831680 00000100:00100000:2.0:1746147137.142711:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307831680 00000100:00100000:2.0:1746147137.142778:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14200 00000100:00100000:2.0:1746147137.142786:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307831680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147137.142807:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.142829:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x313993942505538b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7751e expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.142891:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310621312:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147137.142992:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.145081:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.145154:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307831808 00000100:00100000:3.0:1746147137.145160:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307831808 00000100:00100000:3.0:1746147137.145211:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14201 00000100:00100000:3.0:1746147137.145218:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307831808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.145235:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.145252:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425055392 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77525 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.145302:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310621440:192.168.204.25@tcp:106: 00002000:00010000:2.0:1746147137.145332:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147136 -> 1746147137 00000100:00100000:2.0:1746147137.145355:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310621312:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147137.145384:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147137.145387:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x313993942505538b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7751e expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.145399:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x313993942505538b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7751e expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.145536:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ae00, rc 0) 00000100:00100000:2.0:1746147137.145577:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307831680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2791us (3079us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147137.145800:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14200 00002000:00010000:3.0:1746147137.147972:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147136 -> 1746147137 00000100:00100000:3.0:1746147137.148000:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310621440:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147137.148032:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425055392 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77525 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.148055:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425055392 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77525 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.148084:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:3.0:1746147137.148159:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307831808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2939us (3084us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147137.148166:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14201 00000100:00100000:0.0:1746147137.148713:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.149548:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307832064 00000100:00100000:2.0:1746147137.149556:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307832064 00002000:00100000:2.0:1746147137.149602:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880096cf8000 x1830967307832064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.149610:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8000 with x1830967307832064 ext(2097152->4194303) 00002000:00010000:2.0:1746147137.149616:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf8000 00000100:00100000:0.0:1746147137.149884:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.150197:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307832320 00000100:00100000:2.0:1746147137.150201:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307832320 00002000:00100000:2.0:1746147137.150220:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3620863) req@ffff880096cfbb80 x1830967307832320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.150227:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfbb80 with x1830967307832320 ext(2097152->3620863) 00002000:00010000:2.0:1746147137.150231:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfbb80 00000100:00100000:2.0:1746147137.150243:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3321 00000100:00100000:2.0:1746147137.150251:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307832064:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147137.150262:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3322 00000100:00100000:1.0:1746147137.150280:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307832320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147137.151383:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.151443:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307832448 00000100:00100000:3.0:1746147137.151448:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307832448 00000100:00100000:3.0:1746147137.151479:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14202 00000100:00100000:3.0:1746147137.151485:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:32126:x1830967307832448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.151496:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.151515:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7752c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.151541:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.151549:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.151551:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.151555:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.151585:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.151597:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 32 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.151609:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310621568:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.151992:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.156941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.157068:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307832576 00000100:00100000:2.0:1746147137.157078:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307832576 00002000:00100000:2.0:1746147137.157133:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4227071) req@ffff880096cfa300 x1830967307832576/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.157143:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa300 with x1830967307832576 ext(4194304->4227071) 00010000:00010000:2.0:1746147137.157152:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 33 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.157165:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 33 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.157172:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cfa300 00000100:00100000:2.0:1746147137.157192:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1057 00000100:00100000:2.0:1746147137.157200:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307832576:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147137.157495:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310621568:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.157522:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.157543:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b000, rc 0) 00000100:00100000:3.0:1746147137.158843:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:32126:x1830967307832448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7347us (7450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.158855:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14202 00000100:00100000:1.0:1746147137.162744:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307832320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12457us (12845us total) trans 0 rc 1523712/1523712 00000100:00100000:1.0:1746147137.162757:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3322 00000100:00100000:0.0:1746147137.162763:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307832576:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5562us (5828us total) trans 17179874134 rc 0/0 00002000:00100000:1.0:1746147137.162767:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3620863) req@ffff880096cfbb80 x1830967307832320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1523712/1523712 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147137.162771:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1057 00002000:00100000:1.0:1746147137.162777:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfbb80 with x1830967307832320 ext(2097152->3620863) 00002000:00100000:0.0:1746147137.162778:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4227071) req@ffff880096cfa300 x1830967307832576/t17179874134(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/448 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746147137.162783:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfbb80 00002000:00100000:0.0:1746147137.162784:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa300 with x1830967307832576 ext(4194304->4227071) 00010000:00010000:0.0:1746147137.162791:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 35 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.162805:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 35 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:0.0:1746147137.162811:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cfa300 00000100:00100000:2.0:1746147137.170141:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307832064:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19881us (21419us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147137.170152:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3321 00002000:00100000:2.0:1746147137.170162:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880096cf8000 x1830967307832064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.170171:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8000 with x1830967307832064 ext(2097152->4194303) 00010000:00010000:2.0:1746147137.170180:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 33 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.170195:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 33 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.170202:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf8000 00000100:00100000:0.0:1746147137.178265:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.178332:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307832704 00000100:00100000:3.0:1746147137.178342:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307832704 00000100:00100000:0.0:1746147137.178359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.178389:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14203 00000100:00100000:3.0:1746147137.178396:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32127:x1830967307832704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.178414:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.178433:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77533 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.178457:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.178459:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.178463:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.178474:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.178478:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307832832 00010000:00010000:3.0:1746147137.178481:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:2.0:1746147137.178490:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307832832 00010000:00010000:2.0:1746147137.178527:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 35 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.178532:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32127:x1830967307832704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.178537:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14203 00000100:00100000:2.0:1746147137.178582:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6188 00000100:00100000:2.0:1746147137.178590:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307832832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.178602:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.178622:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 34 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.178633:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 34 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.178667:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505531b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774e6 expref: 34 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.178693:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.178695:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.178700:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.178708:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.178715:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.178716:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.178718:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.178723:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.178750:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.178761:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621696:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.178843:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.178850:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621824:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.178864:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.182599:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621696:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.182615:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310621824:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.182638:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.182695:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307832832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4103us (4332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.182707:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6188 00000100:00100000:0.0:1746147137.184419:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.184952:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.185295:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307833088 00000100:00100000:1.0:1746147137.185304:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307833088 00002000:00100000:1.0:1746147137.185355:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880098e11c00 x1830967307833088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147137.185365:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11c00 with x1830967307833088 ext(2097152->3145727) 00002000:00010000:1.0:1746147137.185372:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e11c00 00000100:00100000:1.0:1746147137.185399:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307833344 00000100:00100000:1.0:1746147137.185402:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307833344 00002000:00100000:1.0:1746147137.185416:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880098e10380 x1830967307833344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147137.185423:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10380 with x1830967307833344 ext(3145728->4194303) 00002000:00010000:1.0:1746147137.185426:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e10380 00000100:00100000:2.0:1746147137.185430:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3323 00000100:00100000:2.0:1746147137.185442:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307833088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147137.185453:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3324 00000100:00100000:1.0:1746147137.185459:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307833344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147137.201312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.201349:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307833600 00000100:00100000:3.0:1746147137.201360:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307833600 00000100:00100000:1.0:1746147137.201441:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307833344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15979us (16487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147137.201451:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15185 00000100:00100000:1.0:1746147137.201452:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3324 00000100:00100000:3.0:1746147137.201460:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32131:x1830967307833600:12345-192.168.204.25@tcp:101:multiop.0 00002000:00100000:1.0:1746147137.201464:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880098e10380 x1830967307833344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147137.201475:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10380 with x1830967307833344 ext(3145728->4194303) 00002000:00010000:1.0:1746147137.201481:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e10380 00010000:00010000:3.0:1746147137.201483:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.201503:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x31399394250553a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7753a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.202140:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202154:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202164:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202178:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202182:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202186:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202283:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x31399394250553bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202293:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x31399394250553bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202299:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x31399394250553bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147137.202310:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147137.202382:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202388:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202394:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202400:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098e6c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147137.202403:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202409:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202420:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147137.202423:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147137.202426:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202431:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x31399394250553ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202461:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202466:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202471:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202479:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09f400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147137.202481:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202485:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202491:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23400) 00010000:00010000:3.0:1746147137.202493:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147137.202495:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202499:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x31399394250553b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147137.202537:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x31399394250553a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7753a expref: 36 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.202548:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x31399394250553bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7753a expref: 35 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.202554:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147137.202555:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147137.202557:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09f000, rc 0) 00000100:00100000:3.0:1746147137.202597:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32131:x1830967307833600:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1138us (1301us total) trans 8589935848 rc 0/0 00000100:00100000:3.0:1746147137.202603:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15185 00000100:00100000:1.0:1746147137.204392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.204657:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307833088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19215us (20240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147137.204669:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3323 00002000:00100000:2.0:1746147137.204680:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880098e11c00 x1830967307833088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.204696:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11c00 with x1830967307833088 ext(2097152->3145727) 00002000:00010000:2.0:1746147137.204703:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e11c00 00000100:00100000:1.0:1746147137.204892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.205038:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307833984 00000100:00100000:3.0:1746147137.205054:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307833984 00000100:00100000:3.0:1746147137.205118:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5411 00000100:00100000:3.0:1746147137.205125:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32131:x1830967307833984:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147137.205267:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307833728 00000100:00100000:2.0:1746147137.205270:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307833728 00000100:00100000:2.0:1746147137.205307:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 793 00000100:00100000:2.0:1746147137.205313:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307833728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.205323:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.205347:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x31399394250553bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7753a expref: 36 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.205365:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.205370:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.205401:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307833728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.205407:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 793 00000100:00100000:3.0:1746147137.205673:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32131:x1830967307833984:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 548us (1289us total) trans 8589935849 rc 0/0 00000100:00100000:3.0:1746147137.205680:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5411 00000100:00100000:0.0:1746147137.217677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.217731:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.217747:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307834112 00000100:00100000:3.0:1746147137.217756:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307834112 00000100:00100000:3.0:1746147137.217804:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14204 00000100:00100000:3.0:1746147137.217813:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:32126:x1830967307834112:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147137.217815:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307834368 00000100:00100000:1.0:1746147137.217819:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307834368 00010000:00010000:3.0:1746147137.217834:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147137.217852:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15186 00010000:00010000:3.0:1746147137.217855:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77541 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.217858:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:32133:x1830967307834368:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147137.217874:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.217886:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250553d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77548 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.217887:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.217894:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.217897:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.217900:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.217931:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.217943:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 25 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.217953:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147137.217959:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310621952:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.217965:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.217975:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.217994:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.217999:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.218005:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147137.218050:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147137.218135:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250553e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.218144:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250553e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.218149:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250553e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147137.218156:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147137.219019:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219027:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219032:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219046:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219052:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0de00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147137.219056:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219062:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219073:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147137.219076:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147137.219079:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.219083:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x31399394250553d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147137.219676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.219849:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307834624 00000100:00100000:3.0:1746147137.219855:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307834624 00002000:00100000:3.0:1746147137.219893:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880098e12680 x1830967307834624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.219902:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12680 with x1830967307834624 ext(4194304->4919295) 00002000:00010000:3.0:1746147137.219906:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e12680 00000100:00100000:3.0:1746147137.219924:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3325 00000100:00100000:3.0:1746147137.219930:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307834624:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147137.220136:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220143:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220148:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220153:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147137.220157:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220162:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220172:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ec09e00) 00010000:00010000:1.0:1746147137.220174:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147137.220177:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220181:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x31399394250553df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.220232:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250553d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77548 expref: 17 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.220244:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250553e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77548 expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.220251:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.220253:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147137.220255:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:1.0:1746147137.220298:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:32133:x1830967307834368:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2438us (2564us total) trans 8589935850 rc 0/0 00000100:00100000:1.0:1746147137.220306:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15186 00000100:00100000:0.0:1746147137.225526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.225811:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310621952:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.225842:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.225842:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307834752 00000100:00100000:1.0:1746147137.225850:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307834752 00010000:00010000:3.0:1746147137.225860:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09f400, rc 0) 00002000:00100000:1.0:1746147137.225891:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3620864->4194303) req@ffff880098e11500 x1830967307834752/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147137.225905:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:32126:x1830967307834112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8093us (8238us total) trans 0 rc 0/0 00002000:00100000:1.0:1746147137.225910:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11500 with x1830967307834752 ext(3620864->4194303) 00000100:00100000:3.0:1746147137.225915:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14204 00010000:00010000:1.0:1746147137.225917:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 26 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.225930:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 26 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:1.0:1746147137.225936:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098e11500 00000100:00100000:1.0:1746147137.225955:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1058 00000100:00100000:1.0:1746147137.225963:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307834752:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147137.227934:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.228203:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307834624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8270us (8527us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147137.228208:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307834880 00000100:00100000:2.0:1746147137.228217:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307834880 00000100:00100000:3.0:1746147137.228219:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3325 00002000:00100000:3.0:1746147137.228233:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880098e12680 x1830967307834624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.228249:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12680 with x1830967307834624 ext(4194304->4919295) 00002000:00010000:3.0:1746147137.228253:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e12680 00000100:00100000:2.0:1746147137.228281:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 794 00000100:00100000:2.0:1746147137.228290:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307834880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.228305:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.228332:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250553e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77548 expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.228978:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.228984:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.229010:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307834880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 721us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.229017:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 794 00000100:00100000:1.0:1746147137.242621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.242665:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.242748:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307835008 00000100:00100000:3.0:1746147137.242757:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307835008 00000100:00100000:3.0:1746147137.242796:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307835136 00000100:00100000:3.0:1746147137.242797:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307835136 00000100:00100000:3.0:1746147137.242814:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14205 00000100:00100000:3.0:1746147137.242821:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307835008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.242841:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.242861:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x31399394250553f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7754f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.242914:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310622080:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147137.243103:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14206 00000100:00100000:1.0:1746147137.243110:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32131:x1830967307835136:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147137.243118:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.243129:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77556 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.243147:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.243155:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.243161:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.243163:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.243166:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3362816->3416063] (req 3362816->3416063) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.243183:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.243192:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 34 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.243200:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622208:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.244078:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147137.246048:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.246066:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 15 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.246080:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622336:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.246172:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.247521:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307834752:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 21554us (22004us total) trans 21474841399 rc 0/0 00000100:00100000:0.0:1746147137.247533:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1058 00002000:00100000:0.0:1746147137.247547:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (3620864->4194303) req@ffff880098e11500 x1830967307834752/t21474841399(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/448 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147137.247557:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11500 with x1830967307834752 ext(3620864->4194303) 00010000:00010000:0.0:1746147137.247567:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 30 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.247580:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 30 pid: 12201 timeout: 775 lvb_type: 0 00002000:00010000:0.0:1746147137.247592:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098e11500 00000100:00100000:1.0:1746147137.253508:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622208:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.253628:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310622080:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147137.253663:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x31399394250553f4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7754f expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.253679:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x31399394250553f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7754f expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.253705:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182000, rc 0) 00000100:00100000:3.0:1746147137.253761:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307835008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10939us (11153us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147137.253770:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14205 00000100:00100000:2.0:1746147137.255350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.255382:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.255403:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307835392 00000100:00100000:2.0:1746147137.255408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.255410:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307835392 00010000:00010000:3.0:1746147137.255441:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 16 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.255707:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307835264 00000100:00100000:3.0:1746147137.255710:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307835264 00000100:00100000:2.0:1746147137.255713:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307835520 00000100:00100000:2.0:1746147137.255719:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307835520 00010000:00010000:3.0:1746147137.255723:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 35 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.255739:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6189 00010000:00010000:2.0:1746147137.255742:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 28 pid: 12201 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.255746:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307835392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.255759:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147137.255768:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6190 00000100:00100000:2.0:1746147137.255776:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307835264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.255778:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 16 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.255786:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147137.255787:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 16 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.255797:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 35 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746147137.255837:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6191 00000100:00100000:0.0:1746147137.255846:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307835520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.255854:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.255867:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 28 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.255879:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 28 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.255893:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425055314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774df expref: 28 pid: 12201 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.255913:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.255915:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.255923:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.255932:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.255970:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.255984:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310622464:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147137.256059:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147137.256198:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055399 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7752c expref: 16 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.256213:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622336:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.256267:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 35 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.256281:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x31399394250553a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77533 expref: 35 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.256293:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.256295:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.256299:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.256310:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.256329:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.256337:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310622592:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147137.256364:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147137.256440:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147137.256456:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.256471:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ce00, rc 0) 00000100:00100000:3.0:1746147137.256477:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307835392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 729us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.256484:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6189 00000100:00100000:1.0:1746147137.256492:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32131:x1830967307835136:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 13382us (13826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.256498:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14206 00000100:00100000:0.0:1746147137.262715:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.262839:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307835648 00000100:00100000:1.0:1746147137.262848:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307835648 00000100:00100000:1.0:1746147137.262913:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14207 00000100:00100000:1.0:1746147137.262923:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32127:x1830967307835648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.262943:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.262969:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7755d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.263003:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.263011:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147137.263012:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147137.263016:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.263058:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.263070:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 35 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.263086:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622720:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.263193:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.263362:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310622464:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.263381:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.263424:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307835520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7579us (8015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.263433:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6191 00000100:00100000:2.0:1746147137.263722:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310622592:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.263733:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.263753:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307835264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7979us (8370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.263760:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6190 00000100:00100000:1.0:1746147137.264193:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622720:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.264304:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.264320:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c600, rc 0) 00000100:00100000:1.0:1746147137.264350:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32127:x1830967307835648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1429us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.264356:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14207 00000100:00100000:0.0:1746147137.267275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.267338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.267353:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307836160 00000100:00100000:2.0:1746147137.267362:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307836160 00002000:00100000:2.0:1746147137.267409:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880098e10700 x1830967307836160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.267419:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10700 with x1830967307836160 ext(2097152->3145727) 00002000:00010000:2.0:1746147137.267425:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e10700 00000100:00100000:2.0:1746147137.267460:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307836032 00000100:00100000:2.0:1746147137.267463:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307836032 00002000:00100000:2.0:1746147137.267478:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3362816->3366911) req@ffff880098e12300 x1830967307836032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.267485:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12300 with x1830967307836032 ext(3362816->3366911) 00010000:00010000:2.0:1746147137.267493:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.267507:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.267513:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098e12300 00000100:00100000:2.0:1746147137.267544:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1059 00000100:00100000:2.0:1746147137.267552:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307836032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147137.267574:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3326 00000100:00100000:3.0:1746147137.267582:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307836160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147137.267734:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307836032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 179us (391us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147137.267741:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1059 00002000:00100000:2.0:1746147137.267748:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3362816->3366911) req@ffff880098e12300 x1830967307836032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.267755:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12300 with x1830967307836032 ext(3362816->3366911) 00010000:00010000:2.0:1746147137.267761:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.267772:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.267783:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098e12300 00000100:00100000:0.0:1746147137.272378:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.272527:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307836416 00000100:00100000:3.0:1746147137.272536:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307836416 00002000:00100000:3.0:1746147137.272578:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3411968->3416063) req@ffff880098e13100 x1830967307836416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.272588:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e13100 with x1830967307836416 ext(3411968->3416063) 00010000:00010000:3.0:1746147137.272597:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.272610:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746147137.272618:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098e13100 00000100:00100000:3.0:1746147137.272636:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1060 00000100:00100000:3.0:1746147137.272643:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307836416:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147137.273543:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307836416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 897us (1174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147137.273550:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1060 00002000:00100000:3.0:1746147137.273557:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3411968->3416063) req@ffff880098e13100 x1830967307836416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.273565:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e13100 with x1830967307836416 ext(3411968->3416063) 00010000:00010000:3.0:1746147137.273570:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.273580:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746147137.273585:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098e13100 00000100:00100000:2.0:1746147137.277162:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307836160:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9572us (9890us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147137.277173:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3326 00002000:00100000:2.0:1746147137.277185:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880098e10700 x1830967307836160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.277194:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10700 with x1830967307836160 ext(2097152->3145727) 00002000:00010000:2.0:1746147137.277200:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e10700 00000100:00100000:3.0:1746147137.277479:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.278795:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307836672 00000100:00100000:2.0:1746147137.278805:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307836672 00002000:00100000:2.0:1746147137.278847:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3362816->3416063) req@ffff8801312eb800 x1830967307836672/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.278856:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb800 with x1830967307836672 ext(3362816->3416063) 00010000:00010000:2.0:1746147137.278866:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.278881:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 34 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.278887:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eb800 00000100:00100000:2.0:1746147137.278927:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1061 00000100:00100000:2.0:1746147137.278935:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967307836672:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147137.284245:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307836672:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5296us (6752us total) trans 17179874135 rc 0/0 00000100:00100000:3.0:1746147137.284259:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1061 00002000:00100000:3.0:1746147137.284272:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3362816->3416063) req@ffff8801312eb800 x1830967307836672/t17179874135(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/448 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.284282:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb800 with x1830967307836672 ext(3362816->3416063) 00010000:00010000:3.0:1746147137.284292:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 36 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.284309:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 36 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746147137.284316:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eb800 00000100:00100000:0.0:1746147137.292197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.292245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.292995:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307836800 00000100:00100000:1.0:1746147137.293006:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307836800 00000100:00100000:1.0:1746147137.293077:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307836928 00000100:00100000:1.0:1746147137.293079:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307836928 00000100:00100000:1.0:1746147137.293121:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14208 00000100:00100000:1.0:1746147137.293129:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:32126:x1830967307836800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.293150:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.293171:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77564 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293200:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147137.293201:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147137.293206:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293223:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293233:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0dc00, rc 0) 00000100:00100000:1.0:1746147137.293283:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:32126:x1830967307836800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 155us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.293290:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14208 00000100:00100000:1.0:1746147137.293306:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14209 00000100:00100000:1.0:1746147137.293311:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:32133:x1830967307836928:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147137.293317:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.293323:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7756b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293337:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293345:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293350:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.293352:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.293354:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1220608->1769471] (req 1220608->1769471) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293384:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293395:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.293406:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622848:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.293483:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.293492:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 35 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.293500:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622976:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.293520:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.293773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.296246:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307837056 00000100:00100000:2.0:1746147137.296259:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307837056 00010000:00010000:2.0:1746147137.296304:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 36 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.297169:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6192 00000100:00100000:3.0:1746147137.297181:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307837056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.297196:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147137.297214:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147136 -> 1746147137 00002000:00010000:3.0:1746147137.297217:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147136 -> 1746147137 00010000:00010000:3.0:1746147137.297222:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 36 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.297234:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 36 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.297256:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250553fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3362816->3416063) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77556 expref: 36 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.297278:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.297280:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.297287:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.297294:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.297300:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.297301:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.297304:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.297310:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.297341:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.297353:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310623104:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147137.298435:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.298446:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310623232:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147137.298492:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.300111:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622976:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.301362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.301527:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310622848:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.301561:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1220608->1769471] (req 1220608->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.301582:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:3.0:1746147137.301637:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:32133:x1830967307836928:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8325us (9390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.301647:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14209 00000100:00100000:0.0:1746147137.301752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.301925:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307837184 00000100:00100000:2.0:1746147137.301933:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307837184 00010000:00010000:2.0:1746147137.301958:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 36 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.301975:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307837312 00000100:00100000:2.0:1746147137.301977:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307837312 00010000:00010000:2.0:1746147137.301983:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.301996:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6193 00000100:00100000:2.0:1746147137.302001:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307837184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.302012:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.302029:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 36 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.302046:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 36 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.302067:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x313993942505537d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77510 expref: 36 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.302080:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.302125:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307837184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.302131:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6193 00000100:00100000:2.0:1746147137.302143:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6194 00000100:00100000:2.0:1746147137.302148:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307837312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.302154:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.302161:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.302170:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.302181:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425055384 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77517 expref: 17 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.302189:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.302191:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147137.302488:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310623232:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.302804:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.302813:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.302842:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.302854:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310623360:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147137.305788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.305821:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.306362:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147137.306585:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307837440 00000100:00100000:3.0:1746147137.306594:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307837440 00000100:00100000:3.0:1746147137.306636:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307837568 00000100:00100000:3.0:1746147137.306638:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307837568 00000100:00100000:3.0:1746147137.306656:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14210 00000100:00100000:3.0:1746147137.306664:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307837440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147137.306686:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.306705:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425055417 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77572 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.306720:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14211 00000100:00100000:1.0:1746147137.306729:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307837568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147137.306738:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.306750:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77579 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.306757:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310623488:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147137.306765:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.306766:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.306776:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.306791:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.306806:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d800, rc 0) 00000100:00100000:3.0:1746147137.306826:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147137.306834:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307837568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 106us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.306840:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14211 00000100:00100000:2.0:1746147137.307690:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310623104:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.307707:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.307732:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307837056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10554us (13959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.307740:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6192 00000100:00100000:2.0:1746147137.309414:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310623360:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147137.309433:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.309445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.310577:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307837312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8424us (8820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.310591:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6194 00000100:00100000:3.0:1746147137.310708:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307837952 00000100:00100000:3.0:1746147137.310717:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307837952 00002000:00100000:3.0:1746147137.310765:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012e321f80 x1830967307837952/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147137.310818:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.311051:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.311059:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307838080 00000100:00100000:0.0:1746147137.311062:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307838080 00002000:00100000:0.0:1746147137.311082:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011e502680 x1830967307838080/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147137.311106:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502680 with x1830967307838080 ext(3145728->4194303) 00002000:00010000:0.0:1746147137.311112:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e502680 00000100:00100000:0.0:1746147137.311132:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307838336 00000100:00100000:0.0:1746147137.311135:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307838336 00002000:00010000:2.0:1746147137.311144:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147136 -> 1746147137 00002000:00100000:0.0:1746147137.311146:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1220608->1224703) req@ffff88011e503480 x1830967307838336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746147137.311147:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147136 -> 1746147137 00002000:00010000:2.0:1746147137.311149:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147136 -> 1746147137 00002000:00100000:0.0:1746147137.311152:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503480 with x1830967307838336 ext(1220608->1224703) 00002000:00010000:0.0:1746147137.311155:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e503480 00000100:00100000:2.0:1746147137.311167:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310623488:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147137.311171:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3327 00000100:00100000:0.0:1746147137.311178:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307838080:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147137.311195:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425055417 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77572 expref: 35 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.311207:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425055417 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77572 expref: 35 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.311226:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:2.0:1746147137.311253:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307837440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4590us (5476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147137.311260:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14210 00000100:00100000:2.0:1746147137.311285:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3328 00000100:00100000:2.0:1746147137.311291:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307838336:12345-192.168.204.25@tcp:3:multiop.0 00002000:00100000:3.0:1746147137.311457:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321f80 with x1830967307837952 ext(3145728->4194303) 00002000:00010000:3.0:1746147137.311462:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e321f80 00000100:00100000:3.0:1746147137.311494:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3329 00000100:00100000:3.0:1746147137.311500:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307837952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147137.313747:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967307838336:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 2444us (2684us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147137.313759:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3328 00002000:00100000:2.0:1746147137.313771:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1220608->1224703) req@ffff88011e503480 x1830967307838336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.313780:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503480 with x1830967307838336 ext(1220608->1224703) 00002000:00010000:2.0:1746147137.313786:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e503480 00000100:00100000:0.0:1746147137.317283:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.317350:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307838592 00000100:00100000:2.0:1746147137.317361:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307838592 00002000:00100000:2.0:1746147137.317411:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff88012e320700 x1830967307838592/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.317421:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e320700 with x1830967307838592 ext(4915200->4919295) 00002000:00010000:2.0:1746147137.317427:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e320700 00000100:00100000:2.0:1746147137.317460:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3330 00000100:00100000:2.0:1746147137.317467:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307838592:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147137.317617:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307838592:12345-192.168.204.25@tcp:3:cat.0 Request processed in 149us (346us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147137.317623:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3330 00002000:00100000:2.0:1746147137.317629:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff88012e320700 x1830967307838592/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.317641:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e320700 with x1830967307838592 ext(4915200->4919295) 00002000:00010000:2.0:1746147137.317644:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e320700 00000100:00100000:2.0:1746147137.319606:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307838080:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8417us (8777us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147137.319616:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3327 00002000:00100000:2.0:1746147137.319625:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011e502680 x1830967307838080/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.319634:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502680 with x1830967307838080 ext(3145728->4194303) 00002000:00010000:2.0:1746147137.319640:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e502680 00000100:00100000:0.0:1746147137.321649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.321840:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307838848 00000100:00100000:2.0:1746147137.321850:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307838848 00002000:00100000:2.0:1746147137.321895:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1765376->1769471) req@ffff88012e323b80 x1830967307838848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.321906:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e323b80 with x1830967307838848 ext(1765376->1769471) 00002000:00010000:2.0:1746147137.321912:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e323b80 00000100:00100000:3.0:1746147137.322123:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307837952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10587us (12642us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147137.322132:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3329 00002000:00100000:3.0:1746147137.322139:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012e321f80 x1830967307837952/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.322146:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321f80 with x1830967307837952 ext(3145728->4194303) 00002000:00010000:3.0:1746147137.322150:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e321f80 00000100:00100000:3.0:1746147137.322168:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3331 00000100:00100000:3.0:1746147137.322176:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307838848:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147137.322302:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307838848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 128us (663us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147137.322307:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3331 00002000:00100000:3.0:1746147137.322311:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1765376->1769471) req@ffff88012e323b80 x1830967307838848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147137.322318:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e323b80 with x1830967307838848 ext(1765376->1769471) 00002000:00010000:3.0:1746147137.322320:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e323b80 00000100:00100000:0.0:1746147137.323385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.323477:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307839104 00000100:00100000:3.0:1746147137.323481:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307839104 00000100:00100000:3.0:1746147137.326214:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5412 00000100:00100000:3.0:1746147137.326236:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32127:x1830967307839104:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147137.326504:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32127:x1830967307839104:12345-192.168.204.25@tcp:35:cat.0 Request processed in 276us (3121us total) trans 8589935851 rc 0/0 00000100:00100000:3.0:1746147137.326511:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5412 00000100:00100000:0.0:1746147137.327122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.327479:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307839360 00000100:00100000:3.0:1746147137.327487:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307839360 00000100:00100000:3.0:1746147137.327529:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5413 00000100:00100000:3.0:1746147137.327535:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:32133:x1830967307839360:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147137.327644:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:32133:x1830967307839360:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 109us (523us total) trans 8589935852 rc 0/0 00000100:00100000:3.0:1746147137.327650:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5413 00000100:00100000:0.0:1746147137.328329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.328390:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307839616 00000100:00100000:2.0:1746147137.328394:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307839616 00002000:00100000:2.0:1746147137.328427:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012e321500 x1830967307839616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.328438:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321500 with x1830967307839616 ext(4194304->4919295) 00002000:00010000:2.0:1746147137.328444:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e321500 00000100:00100000:2.0:1746147137.328470:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3332 00000100:00100000:2.0:1746147137.328476:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307839616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147137.337934:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307839616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9444us (9592us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147137.337948:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3332 00002000:00100000:2.0:1746147137.337961:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012e321500 x1830967307839616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/440 e 0 to 0 dl 1746147148 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.337971:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321500 with x1830967307839616 ext(4194304->4919295) 00002000:00010000:2.0:1746147137.337977:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e321500 00000100:00100000:0.0:1746147137.345477:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.345589:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307839872 00000100:00100000:3.0:1746147137.345599:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307839872 00000100:00100000:3.0:1746147137.345659:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5414 00000100:00100000:3.0:1746147137.345668:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:32126:x1830967307839872:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147137.345896:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:32126:x1830967307839872:12345-192.168.204.25@tcp:35:cat.0 Request processed in 228us (430us total) trans 8589935853 rc 0/0 00000100:00100000:3.0:1746147137.345903:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5414 00000100:00100000:0.0:1746147137.353491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.353592:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307840000 00000100:00100000:1.0:1746147137.353602:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307840000 00000100:00100000:1.0:1746147137.353763:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15187 00000100:00100000:1.0:1746147137.353771:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:32138:x1830967307840000:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147137.353799:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.353817:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425055425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77580 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.353873:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.353887:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.353898:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.353910:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.353915:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.353920:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.353993:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.354004:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.354011:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.354052:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.354064:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 35 pid: 7238 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.354076:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310623616:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.354808:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147137.356268:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310623616:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.356288:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147137.356421:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.356647:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307840256 00000100:00100000:2.0:1746147137.356654:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307840256 00000100:00100000:2.0:1746147137.356705:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5415 00000100:00100000:2.0:1746147137.356712:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:30749:x1830967307840256:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147137.361248:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:30749:x1830967307840256:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 4521us (4812us total) trans 8589935854 rc 0/0 00000100:00100000:2.0:1746147137.361262:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5415 00000100:00100000:2.0:1746147137.364886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.365127:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307840384 00000100:00100000:3.0:1746147137.365138:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307840384 00010000:00010000:3.0:1746147137.365178:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.365217:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6195 00000100:00100000:3.0:1746147137.365226:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307840384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.365239:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147137.365246:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.365259:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.365283:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x31399394250551ee lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77437 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746147137.365300:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147137.365305:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147137.365315:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147137.365322:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147137.365348:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147137.365377:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365385:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147137.365391:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307840384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 167us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.365398:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6195 00000004:00200000:0.0:1746147137.365448:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147137.365452:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147137.365473:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365485:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365494:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365500:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365505:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365510:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365516:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147137.365520:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365527:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365536:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147137.365540:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147137.365544:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365548:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942505542c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365562:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365567:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365571:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365576:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147137.365578:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365582:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365587:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ec09c00) 00010000:00010000:0.0:1746147137.365590:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147137.365592:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365596:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055433 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.365632:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425055425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.365645:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.365650:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147137.365652:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147137.365654:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0da00, rc 0) 00000100:00100000:1.0:1746147137.365875:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32138:x1830967307840000:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 12103us (12395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.365882:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15187 00000100:00100000:0.0:1746147137.368381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.368889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.369146:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307840512 00000100:00100000:3.0:1746147137.369156:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307840512 00000100:00100000:3.0:1746147137.369206:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307840768 00000100:00100000:3.0:1746147137.369209:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307840768 00000100:00100000:3.0:1746147137.369228:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14212 00000100:00100000:3.0:1746147137.369234:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307840512:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147137.369253:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.369271:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x3139939425055441 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77587 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.369321:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310623744:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147137.369395:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147137.369424:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14213 00000100:00100000:3.0:1746147137.369430:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307840768:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147137.369439:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.369449:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77595 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.369460:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.369462:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.369471:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 11 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.369485:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 11 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.369494:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81000, rc 0) 00000100:00100000:3.0:1746147137.369515:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307840768:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 85us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.369520:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14213 00000100:00100000:0.0:1746147137.369596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.369608:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307840640 00000100:00100000:1.0:1746147137.369612:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307840640 00000100:00100000:1.0:1746147137.369631:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14214 00000100:00100000:1.0:1746147137.369636:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307840640:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147137.369643:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.369651:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7758e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.369666:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.369667:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.369672:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.369682:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.369688:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:1.0:1746147137.369708:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307840640:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 71us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.369713:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14214 00000100:00100000:2.0:1746147137.371591:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310623744:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147137.371621:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x3139939425055441 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77587 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.371634:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x3139939425055441 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77587 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.371709:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80a00, rc 0) 00000100:00100000:2.0:1746147137.371759:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307840512:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 2523us (3386us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147137.371767:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14212 00000100:00100000:0.0:1746147137.374075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.374267:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841024 00000100:00100000:1.0:1746147137.374277:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841024 00000100:00100000:1.0:1746147137.374333:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15188 00000100:00100000:1.0:1746147137.374341:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32138:x1830967307841024:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147137.374358:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.374377:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425055456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7759c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.374477:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.374492:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.374500:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.374530:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.374541:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 8 pid: 7237 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.374553:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310623872:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.374631:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147137.377952:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310623872:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.377983:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147137.378643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.378909:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841152 00000100:00100000:2.0:1746147137.378917:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841152 00010000:00010000:2.0:1746147137.378951:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 9 pid: 7237 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.379202:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6196 00000100:00100000:2.0:1746147137.379212:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307841152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.379225:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.379231:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 9 pid: 7237 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.379243:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 9 pid: 7237 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.379266:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x313993942505543a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77580 expref: 9 pid: 7237 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.379280:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.379284:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147137.379295:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147137.379301:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147137.379328:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.379372:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307841152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 161us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.379378:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6196 00010000:00010000:1.0:1746147137.379570:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.379578:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147137.379596:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147137.379965:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425055456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7759c expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.379994:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7759c expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.380000:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.380004:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147137.380006:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:1.0:1746147137.380048:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307841024:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 5708us (5982us total) trans 8589935855 rc 0/0 00000100:00100000:1.0:1746147137.380054:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15188 00000100:00100000:0.0:1746147137.382608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.383894:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841408 00000100:00100000:1.0:1746147137.383905:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841408 00000100:00100000:1.0:1746147137.383974:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15189 00000100:00100000:1.0:1746147137.383984:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307841408:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147137.384015:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147137.384019:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147137.384059:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942505545d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7759c expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.384076:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.384080:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147137.384111:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x313993942505546b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775a3 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.384216:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425055472 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.384231:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425055472 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.384240:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425055472 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147137.384249:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147137.384354:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x313993942505546b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775a3 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.384368:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425055472 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775a3 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.384374:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.384376:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147137.384378:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12cc00, rc 0) 00000100:00100000:1.0:1746147137.384436:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32138:x1830967307841408:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 454us (1857us total) trans 8589935856 rc 0/0 00000100:00100000:1.0:1746147137.384442:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15189 00000100:00100000:0.0:1746147137.390543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.390650:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841536 00000100:00100000:3.0:1746147137.390661:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841536 00000100:00100000:3.0:1746147137.390726:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15190 00000100:00100000:3.0:1746147137.390735:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32138:x1830967307841536:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147137.390763:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147137.390785:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425055480 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775aa expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.390845:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425055480 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775aa expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.390859:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425055480 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775aa expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.390876:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147137.390879:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147137.390883:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:3.0:1746147137.390931:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32138:x1830967307841536:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 197us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.390937:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15190 00000100:00100000:0.0:1746147137.393293:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.393318:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.393337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.393349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.393366:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.393385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.394241:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841920 00000100:00100000:0.0:1746147137.394241:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841664 00000100:00100000:2.0:1746147137.394248:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841920 00000100:00100000:0.0:1746147137.394248:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841664 00000100:00100000:0.0:1746147137.394282:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842176 00000100:00100000:0.0:1746147137.394284:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842176 00000100:00100000:2.0:1746147137.394378:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307841792 00000100:00100000:0.0:1746147137.394379:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842048 00000100:00100000:2.0:1746147137.394381:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307841792 00000100:00100000:0.0:1746147137.394381:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842048 00000100:00100000:0.0:1746147137.394392:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842304 00000100:00100000:0.0:1746147137.394394:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842304 00000100:00100000:2.0:1746147137.394402:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14215 00000100:00100000:0.0:1746147137.394407:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14216 00000100:00100000:2.0:1746147137.394409:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307841664:12345-192.168.204.25@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147137.394411:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307841920:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147137.394446:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.394446:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.394463:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.394463:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.394471:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 33 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.394472:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.394478:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.394478:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.394483:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.394483:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.394485:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.394485:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.394488:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.394488:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.394514:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.394514:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.394526:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 15 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.394526:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 7 pid: 9586 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.394539:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310624000:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.394539:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310624128:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147137.394606:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147137.394611:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14217 00010000:00010000:0.0:1746147137.394614:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 27 pid: 9585 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746147137.394617:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307842176:12345-192.168.204.25@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147137.394621:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310624256:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.394635:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.394644:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.394651:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.394657:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.394661:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.394662:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.394664:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.394678:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.394685:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 15 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.394692:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310624384:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.394734:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14218 00000100:00100000:3.0:1746147137.394741:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307842048:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147137.394755:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.394764:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.394768:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.394769:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147137.394771:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.394785:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.394792:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 15 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.394798:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310624512:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.395008:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 33 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395015:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 33 pid: 9584 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395022:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310624640:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.395249:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395256:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 13 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395263:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310624768:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147137.395281:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.395302:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14219 00000100:00100000:2.0:1746147137.395308:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307841792:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147137.395324:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.395338:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395345:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395351:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395356:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.395358:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.395359:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.395373:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395381:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 7 pid: 9585 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395388:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310624896:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.395411:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395419:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395431:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310625024:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.395453:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395461:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 13 pid: 10340 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395468:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310625152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147137.395481:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00010000:00010000:0.0:1746147137.395489:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.395497:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 13 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.395504:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310625280:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.395518:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147137.395519:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14220 00000100:00100000:2.0:1746147137.395524:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307842304:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147137.395540:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.395549:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.395555:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395561:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395565:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.395567:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.395569:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.395583:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395590:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 27 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395598:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310625408:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.395621:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147137.395627:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 13 pid: 12201 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.395633:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310625536:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.395653:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.395659:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.395665:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310625664:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147137.395677:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147137.395741:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147137.395749:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 13 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746147137.395757:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310625792:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.395781:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.395788:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 33 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.395795:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310625920:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.395808:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147137.395859:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147137.406889:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.406935:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310624000:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.406966:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842432 00000100:00100000:3.0:1746147137.406972:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842432 00010000:00010000:3.0:1746147137.407012:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.407334:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310624128:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.407343:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6197 00000100:00100000:1.0:1746147137.407353:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307842432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147137.407366:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147137.407387:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746147137.407399:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746147137.407422:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425055203 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77429 expref: 8 pid: 9586 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.407436:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147137.407450:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147137.407500:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307842432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 148us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.407502:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842560 00000100:00100000:2.0:1746147137.407505:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842560 00000100:00100000:1.0:1746147137.407507:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6197 00010000:00010000:2.0:1746147137.407522:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 16 pid: 9586 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.407539:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6198 00000100:00100000:0.0:1746147137.407710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.407783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.407798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.407811:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842688 00000100:00100000:0.0:1746147137.407814:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842688 00000100:00100000:3.0:1746147137.407820:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310624640:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147137.407828:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 14 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.407829:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310624768:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.407844:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842944 00000100:00100000:0.0:1746147137.407846:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842944 00010000:00010000:3.0:1746147137.407852:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.407856:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 14 pid: 10340 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.407867:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843200 00000100:00100000:0.0:1746147137.407868:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843200 00010000:00010000:0.0:1746147137.407877:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 28 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.408000:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6199 00000100:00100000:0.0:1746147137.408005:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6200 00000100:00100000:3.0:1746147137.408007:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307842688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147137.408010:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307842944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.408016:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.408017:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.408027:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 14 pid: 10340 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746147137.408028:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 14 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746147137.408046:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 14 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.408047:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 14 pid: 10340 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746147137.408059:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x3139939425055146 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773e3 expref: 14 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.408060:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147137.408073:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.408079:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307842944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.408085:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6200 00000100:00100000:0.0:1746147137.408110:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6201 00000100:00100000:3.0:1746147137.408111:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307842688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.408115:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307843200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147137.408118:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6199 00010000:00010000:0.0:1746147137.408124:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.408133:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 28 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.408148:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310625024:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.408158:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7c00/0x313993942505514d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773ea expref: 13 pid: 10340 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746147137.408167:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310625152:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.408188:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310624256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147137.408195:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310625280:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.408210:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.408221:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 28 pid: 1853 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.408233:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.408250:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307843200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.408256:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6201 00010000:00010000:1.0:1746147137.408474:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x313993942505541e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77579 expref: 27 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746147137.408483:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310625408:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.408491:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310625536:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.408498:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310625664:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.408512:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.408598:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.408616:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307842560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.408625:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.408635:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 16 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.408646:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 16 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.408659:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x31399394250551f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7741b expref: 16 pid: 9586 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.408670:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.408694:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307842560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1150us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.408700:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6198 00000100:00100000:2.0:1746147137.408931:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843456 00000100:00100000:3.0:1746147137.408932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.408933:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843456 00010000:00010000:2.0:1746147137.408943:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.408955:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307842816 00000100:00100000:2.0:1746147137.408958:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307842816 00000100:00100000:3.0:1746147137.408965:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147137.408967:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 34 pid: 9584 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.408977:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843072 00000100:00100000:2.0:1746147137.408979:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843072 00000100:00100000:3.0:1746147137.408980:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147137.408986:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 13 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.408993:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843328 00000100:00100000:2.0:1746147137.408995:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843328 00010000:00010000:2.0:1746147137.409001:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 14 pid: 12201 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.409010:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6202 00000100:00100000:2.0:1746147137.409014:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307843456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.409019:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.409025:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409033:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409055:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425055249 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77453 expref: 27 pid: 12225 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409065:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.409077:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967307843456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.409083:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6202 00000100:00100000:2.0:1746147137.409104:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6203 00000100:00100000:2.0:1746147137.409108:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307842816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.409115:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.409121:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 34 pid: 9584 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409129:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 34 pid: 9584 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409139:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425055242 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7744c expref: 34 pid: 9584 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409146:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.409148:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.409152:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.409153:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6204 00010000:00010000:2.0:1746147137.409160:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.409160:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307843072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.409167:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.409175:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147137.409175:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 14 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746147137.409186:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307842816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.409190:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6203 00000100:00100000:2.0:1746147137.409197:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6205 00000100:00100000:2.0:1746147137.409202:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307843328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.409207:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.409212:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 14 pid: 12201 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409220:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 14 pid: 12201 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409229:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425055448 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77595 expref: 14 pid: 12201 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409235:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.409244:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307843328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 42us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.409249:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6205 00010000:00010000:2.0:1746147137.409264:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409271:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409284:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409291:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409304:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409310:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098887c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147137.409314:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409321:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.409327:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 12 pid: 1853 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746147137.409328:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.409334:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098887c00/0x3139939425055487 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.409339:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x313993942505515b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e773f1 expref: 12 pid: 1853 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.409352:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.409368:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307843072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 210us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.409369:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307841664:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 14961us (16083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.409376:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14215 00000100:00100000:0.0:1746147137.409377:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6204 00000100:00100000:3.0:1746147137.409890:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310624896:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.409912:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.409937:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.409967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.409982:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.409997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.410170:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843712 00000100:00100000:0.0:1746147137.410174:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843712 00010000:00010000:0.0:1746147137.410191:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 33 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746147137.410208:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843584 00000100:00100000:0.0:1746147137.410210:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843584 00010000:00010000:0.0:1746147137.410222:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 12 pid: 1853 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.410236:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843840 00000100:00100000:0.0:1746147137.410238:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843840 00010000:00010000:0.0:1746147137.410247:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746147137.410258:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6206 00000100:00100000:0.0:1746147137.410263:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307843712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.410270:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.410280:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 33 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.410288:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 33 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.410300:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.410319:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307843712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 55us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.410325:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6206 00000100:00100000:0.0:1746147137.410336:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6207 00000100:00100000:0.0:1746147137.410340:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307843584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.410404:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.410412:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 12 pid: 1853 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410420:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 12 pid: 1853 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410430:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147137.410444:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307843584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.410448:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310624384:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.410448:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6207 00000100:00100000:0.0:1746147137.410455:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6208 00000100:00100000:0.0:1746147137.410458:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307843840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147137.410460:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942505544f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7758e expref: 11 pid: 1853 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410463:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.410468:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.410470:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310625792:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147137.410473:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.410477:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425055402 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7755d expref: 32 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746147137.410481:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250553ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77541 expref: 7 pid: 1136 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.410485:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310625920:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147137.410490:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.410491:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.410494:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.410498:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.410500:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.410508:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147137.410516:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.410517:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+6:2000:x1830967307843840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.410520:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6208 00010000:00010000:1.0:1746147137.410521:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.410534:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.410540:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.410545:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.410553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147137.410554:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0ae000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147137.410556:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.410561:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.410561:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844096 00000100:00100000:0.0:1746147137.410563:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844096 00010000:00010000:1.0:1746147137.410569:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.410569:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 6 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746147137.410574:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250554aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.410578:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6209 00000100:00100000:0.0:1746147137.410580:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+6:2000:x1830967307844096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147137.410584:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147137.410588:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 6 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410592:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 6 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410602:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x31399394250551fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77422 expref: 6 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410608:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.410609:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.410611:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.410612:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307842304:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 15087us (17225us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147137.410615:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.410618:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14220 00000100:00100000:2.0:1746147137.410673:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310624512:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147137.410686:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.410702:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307843968 00000100:00100000:2.0:1746147137.410705:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307843968 00002000:00100000:2.0:1746147137.410730:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1220608->1769471) req@ffff8801312eb100 x1830967307843968/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/0 e 0 to 0 dl 1746147148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.410739:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb100 with x1830967307843968 ext(1220608->1769471) 00010000:00010000:2.0:1746147137.410745:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 15 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.410753:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 15 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.410759:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eb100 00010000:00010000:0.0:1746147137.410771:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.410778:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1062 00000100:00100000:2.0:1746147137.410784:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307843968:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147137.410785:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967307844096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 203us (230us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147137.410787:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410794:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410806:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410812:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410817:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410822:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0afe00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147137.410824:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410829:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.410839:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.410844:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6209 00010000:00010000:3.0:1746147137.410845:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x31399394250554a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.410875:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307841792:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 15567us (17524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.410881:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14219 00000100:00100000:0.0:1746147137.410882:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.410899:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844224 00000100:00100000:1.0:1746147137.410902:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844224 00010000:00010000:1.0:1746147137.410915:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 26 pid: 9585 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.410932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.410935:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6210 00000100:00100000:1.0:1746147137.410940:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307844224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147137.410942:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844352 00000100:00100000:0.0:1746147137.410945:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844352 00010000:00010000:1.0:1746147137.410946:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147137.410952:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 26 pid: 9585 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746147137.410955:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.410960:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 26 pid: 9585 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.410968:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6211 00010000:00010000:1.0:1746147137.410970:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0000/0x313993942505522d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7745a expref: 26 pid: 9585 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746147137.410973:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307844352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147137.410977:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147137.410978:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.410979:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147137.410981:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.410984:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.410987:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.410992:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.410997:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147137.411003:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x3139939425055409 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77564 expref: 17 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.411007:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.411010:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307844224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 71us (128us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147137.411011:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.411012:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.411014:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147137.411015:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6210 00010000:00010000:0.0:1746147137.411015:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.411021:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.411026:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.411033:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.411033:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147137.411048:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411048:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411054:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.411058:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147137.411060:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.411060:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307844352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 86us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147137.411065:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.411065:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6211 00010000:00010000:2.0:1746147137.411066:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.411074:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411075:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.411079:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505548e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411080:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411084:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12c400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147137.411086:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411107:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411115:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.411119:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f12c400/0x3139939425055495 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147137.411124:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307841920:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 16712us (17804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.411130:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14216 00000100:00100000:1.0:1746147137.411152:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307842176:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 16535us (17813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.411157:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14217 00000100:00100000:2.0:1746147137.419971:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307843968:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9174us (9989us total) trans 17179874136 rc 0/0 00000100:00100000:2.0:1746147137.419984:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1062 00002000:00100000:2.0:1746147137.419995:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1220608->1769471) req@ffff8801312eb100 x1830967307843968/t17179874136(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:513/0 lens 488/448 e 0 to 0 dl 1746147148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147137.420004:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb100 with x1830967307843968 ext(1220608->1769471) 00010000:00010000:2.0:1746147137.420014:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.420046:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746147137.420053:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eb100 00000100:00100000:0.0:1746147137.422930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.423151:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844480 00000100:00100000:2.0:1746147137.423161:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844480 00010000:00010000:2.0:1746147137.423198:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.423238:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6212 00000100:00100000:2.0:1746147137.423246:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967307844480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.423269:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.423289:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.423301:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.423325:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425055410 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7756b expref: 16 pid: 1854 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.423353:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.423356:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.423360:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.423373:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.423397:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147137.423467:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423476:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423491:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423499:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423505:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423511:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db80a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147137.423515:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423523:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423533:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.423539:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505549c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147137.423597:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307842048:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 28856us (30229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.423604:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14218 00000100:00100000:2.0:1746147137.424115:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307844480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 868us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.424122:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6212 00000100:00100000:0.0:1746147137.425766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147137.425828:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844736 00000100:00100000:1.0:1746147137.425836:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844736 00000100:00100000:1.0:1746147137.425965:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15191 00000100:00100000:1.0:1746147137.425974:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32138:x1830967307844736:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147137.426023:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147137.426059:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425055480 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775aa expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426109:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.426114:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147137.426140:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.426153:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426161:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 35 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426167:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426173:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426179:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.426209:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426222:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 35 pid: 7238 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.426241:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626048:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.426339:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426348:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 16 pid: 16099 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.426355:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626176:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.426379:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 35 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426386:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 35 pid: 16099 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.426393:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626304:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147137.426695:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147137.426704:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.426711:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626432:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.426783:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147137.429414:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626048:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147137.429425:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626176:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.429491:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.429629:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.429717:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.429720:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844864 00000100:00100000:2.0:1746147137.429728:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844864 00000100:00100000:3.0:1746147137.429756:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845120 00000100:00100000:3.0:1746147137.429763:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845120 00010000:00010000:3.0:1746147137.429798:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 36 pid: 16099 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.429829:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307844992 00000100:00100000:3.0:1746147137.429832:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307844992 00010000:00010000:3.0:1746147137.429843:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746147137.429860:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6213 00000100:00100000:3.0:1746147137.429867:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307845120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147137.429880:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147137.429881:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6214 00010000:00010000:3.0:1746147137.429886:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 37 pid: 16099 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746147137.429887:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307844992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147137.429893:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147137.429895:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 37 pid: 16099 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.429897:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.429904:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.430042:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 17 pid: 16099 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.430067:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6215 00000100:00100000:2.0:1746147137.430074:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967307844864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.430081:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.430084:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 17 pid: 16099 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746147137.430219:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626304:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147137.430227:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967310626432:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147137.430446:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x31399394250552f8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774ca expref: 37 pid: 16099 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.430450:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21400/0x313993942505528f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77492 expref: 37 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746147137.430460:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147137.430465:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147137.430735:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147137.430739:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 17 pid: 16099 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.430750:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055288 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7748b expref: 17 pid: 16099 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.430762:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.430765:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147137.430771:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147137.430772:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307844992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 885us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147137.430779:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6214 00000100:00100000:2.0:1746147137.430783:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307844864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 713us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.430788:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6215 00000100:00100000:1.0:1746147137.430843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.431147:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845248 00000100:00100000:2.0:1746147137.431151:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845248 00010000:00010000:2.0:1746147137.431164:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746147137.431183:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6216 00000100:00100000:2.0:1746147137.431189:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307845248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147137.431196:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147137.431200:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.431209:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.431219:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250552d5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e774c3 expref: 16 pid: 7238 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746147137.431228:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.431231:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147137.431237:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147137.431446:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.431519:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147137.431526:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147137.431529:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147137.431549:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307845120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1682us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.431555:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6213 00010000:00010000:2.0:1746147137.431632:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147137.431648:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307845248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 460us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.431654:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6216 00010000:00010000:0.0:1746147137.431762:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.431775:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000040:00080000:0.0:1746147137.432025:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].523, 88 off54080 00000004:00080000:0.0:1746147137.432033:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675421942961ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.434975:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].468, 88 off49240 00000004:00080000:0.0:1746147137.434990:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675424899709ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435025:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].469, 88 off49328 00000004:00080000:0.0:1746147137.435029:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675424939137ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435055:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].524, 88 off54168 00000004:00080000:0.0:1746147137.435058:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675424968117ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435083:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].525, 88 off54256 00000004:00080000:0.0:1746147137.435086:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675424996542ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435121:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].470, 88 off49416 00000004:00080000:0.0:1746147137.435124:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675425034392ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435135:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].471, 88 off49504 00000004:00080000:0.0:1746147137.435137:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675425047697ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435145:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].472, 88 off49592 00000004:00080000:0.0:1746147137.435147:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675425057577ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435154:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].526, 88 off54344 00000004:00080000:0.0:1746147137.435157:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675425067951ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435164:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].473, 88 off49680 00000004:00080000:0.0:1746147137.435166:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675425076457ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435178:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].527, 88 off54432 00000004:00080000:0.0:1746147137.435181:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675425091489ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435189:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].474, 88 off49768 00000004:00080000:0.0:1746147137.435196:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675425106707ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147137.435215:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].528, 88 off54520 00000004:00080000:0.0:1746147137.435219:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675425129324ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435234:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].529, 88 off54608 00000004:00080000:0.0:1746147137.435238:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675425148141ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435245:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].530, 88 off54696 00000004:00080000:0.0:1746147137.435248:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675425158284ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435255:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].531, 88 off54784 00000004:00080000:0.0:1746147137.435257:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675425167937ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147137.435265:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].475, 88 off49856 00000004:00080000:0.0:1746147137.435267:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 675425177959ns, next at 554081490131ns, rc = 0 00000001:00080000:2.0:1746147137.439285:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935857 is committed 00000004:00080000:2.0:1746147137.439295:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 470 committed 00000004:00080000:2.0:1746147137.439313:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 524 committed 00000004:00080000:2.0:1746147137.439325:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 523 committed 00000004:00080000:2.0:1746147137.439327:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 522 committed 00000004:00080000:2.0:1746147137.439329:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 521 committed 00000004:00080000:2.0:1746147137.439330:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 469 committed 00000004:00080000:2.0:1746147137.439332:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 520 committed 00000004:00080000:2.0:1746147137.439333:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 468 committed 00000004:00080000:2.0:1746147137.439334:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 519 committed 00000004:00080000:2.0:1746147137.439336:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 467 committed 00000004:00080000:2.0:1746147137.439337:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 466 committed 00000004:00080000:2.0:1746147137.439338:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 465 committed 00000004:00080000:2.0:1746147137.439340:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 518 committed 00000004:00080000:2.0:1746147137.439341:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 517 committed 00000004:00080000:2.0:1746147137.439342:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 464 committed 00000004:00080000:2.0:1746147137.439344:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 463 committed 00000004:00080000:2.0:1746147137.439345:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 516 committed 00000001:00080000:2.0:1746147137.439354:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935854 is committed 00000001:00080000:2.0:1746147137.439360:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935853 is committed 00000100:00100000:1.0:1746147137.439435:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147137.439450:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310626560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147137.439476:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310626688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147137.439503:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147137.439517:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310627072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147137.439535:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310626816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147137.440294:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310626560 00000100:00100000:0.0:1746147137.440301:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310626560 00000100:00100000:1.0:1746147137.440332:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310626944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147137.440347:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14221 00000100:00100000:1.0:1746147137.440352:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147137.440355:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310626560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147137.440361:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310627456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147137.440363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147137.440377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147137.440383:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310627328:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1746147137.440394:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147137.440400:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147137.440417:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147137.440428:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310627200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147137.440441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147137.440452:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310627712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147137.440463:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310626944 00000100:00100000:1.0:1746147137.440465:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310626944 00000100:00100000:3.0:1746147137.440466:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147137.440477:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310628224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147137.440481:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3766:x1830967310626560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (976us total) trans 17179874137 rc 0/0 00000100:00100000:1.0:1746147137.440485:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310626816 00000100:00100000:1.0:1746147137.440486:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310626816 00000100:00100000:0.0:1746147137.440487:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14221 00000100:00100000:3.0:1746147137.440488:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147137.440494:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627456 00000100:00100000:1.0:1746147137.440496:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627456 00000100:00100000:3.0:1746147137.440498:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147137.440501:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310627840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147137.440502:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627328 00000100:00100000:1.0:1746147137.440503:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627328 00000100:00100000:0.0:1746147137.440503:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310626688 00000100:00100000:0.0:1746147137.440506:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310626688 00000100:00100000:1.0:1746147137.440509:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627200 00000100:00100000:1.0:1746147137.440511:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627200 00000100:00100000:3.0:1746147137.440514:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147137.440515:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627712 00000100:00100000:0.0:1746147137.440517:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627712 00000100:00100000:1.0:1746147137.440518:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310628224 00000100:00100000:1.0:1746147137.440520:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310628224 00000100:00100000:3.0:1746147137.440521:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310628352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147137.440526:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627840 00000100:00100000:1.0:1746147137.440528:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627840 00000100:00100000:3.0:1746147137.440531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147137.440531:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14222 00000100:00100000:1.0:1746147137.440535:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310628352 00000100:00100000:0.0:1746147137.440535:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3766:x1830967310626944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147137.440537:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310628352 00000100:00100000:1.0:1746147137.440546:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14223 00000100:00100000:1.0:1746147137.440550:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967310626816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147137.440585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147137.440585:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967310626944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (233us total) trans 17179874138 rc 0/0 00000100:00100000:2.0:1746147137.440605:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310627584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147137.440628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147137.440637:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310628096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147137.440648:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147137.440655:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147137.440659:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310627968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147137.440669:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147137.440675:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310628480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147137.440686:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147137.440700:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627072 00000100:00100000:2.0:1746147137.440702:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627072 00000100:00100000:3.0:1746147137.440796:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14224 00000100:00100000:3.0:1746147137.440805:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3766:x1830967310627456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147137.440807:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967310626816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (444us total) trans 17179874139 rc 0/0 00000100:00100000:1.0:1746147137.440813:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14223 00000100:00100000:1.0:1746147137.440822:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627584 00000100:00100000:1.0:1746147137.440823:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627584 00000100:00100000:1.0:1746147137.440830:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310628096 00000100:00100000:1.0:1746147137.440831:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310628096 00000100:00100000:1.0:1746147137.440836:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310627968 00000100:00100000:1.0:1746147137.440838:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310627968 00000100:00100000:1.0:1746147137.440842:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310628480 00000100:00100000:1.0:1746147137.440843:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310628480 00000100:00100000:1.0:1746147137.440849:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14225 00000100:00100000:1.0:1746147137.440853:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967310627328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147137.440854:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:3.0:1746147137.440857:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147137.440859:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147137.440860:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147137.440862:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:3.0:1746147137.440883:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3766:x1830967310627456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (504us total) trans 17179874140 rc 0/0 00002000:00010000:1.0:1746147137.440885:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147137.440887:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00000100:00100000:3.0:1746147137.440888:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14224 00002000:00010000:1.0:1746147137.440889:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147137.440891:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147137.440892:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:3.0:1746147137.440898:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14226 00000100:00100000:3.0:1746147137.440902:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310626688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147137.440910:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967310627328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (509us total) trans 17179874141 rc 0/0 00000100:00100000:1.0:1746147137.440914:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14225 00000100:00100000:1.0:1746147137.440924:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14227 00000100:00100000:1.0:1746147137.440928:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310627200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147137.440952:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310626688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (534us total) trans 17179874142 rc 0/0 00000100:00100000:3.0:1746147137.440957:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14226 00000100:00100000:3.0:1746147137.440966:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14228 00000100:00100000:3.0:1746147137.440970:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310628224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147137.440979:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310627200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (537us total) trans 17179874143 rc 0/0 00000100:00100000:1.0:1746147137.440984:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14227 00000100:00100000:1.0:1746147137.440993:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14229 00000100:00100000:1.0:1746147137.440997:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310627712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147137.441016:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147137.441018:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147137.441020:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147137.441021:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147137.441023:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:3.0:1746147137.441056:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310628224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (567us total) trans 21474841400 rc 0/0 00000100:00100000:1.0:1746147137.441057:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310627712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (589us total) trans 21474841401 rc 0/0 00000100:00100000:3.0:1746147137.441061:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14228 00000100:00100000:1.0:1746147137.441067:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14229 00000100:00100000:3.0:1746147137.441071:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14230 00000100:00100000:1.0:1746147137.441075:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14231 00000100:00100000:3.0:1746147137.441076:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310627840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147137.441139:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967310627840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (623us total) trans 21474841402 rc 0/0 00000100:00100000:1.0:1746147137.441172:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967310628352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147137.441193:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14222 00000100:00100000:0.0:1746147137.441203:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14232 00000100:00100000:0.0:1746147137.441207:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310627584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147137.441222:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14233 00000100:00100000:2.0:1746147137.441227:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310628096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147137.441231:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310628352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (700us total) trans 21474841403 rc 0/0 00000100:00100000:1.0:1746147137.441235:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14231 00000100:00100000:1.0:1746147137.441244:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14234 00000100:00100000:1.0:1746147137.441248:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310627968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147137.441264:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967310627584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (635us total) trans 21474841404 rc 0/0 00000100:00100000:0.0:1746147137.441268:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14232 00000100:00100000:0.0:1746147137.441276:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14235 00000100:00100000:2.0:1746147137.441279:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967310628096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (629us total) trans 21474841405 rc 0/0 00002000:00010000:1.0:1746147137.441279:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746147137.441280:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967310628480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147137.441281:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147137.441283:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746147137.441284:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14233 00002000:00010000:1.0:1746147137.441285:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147137.441286:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147137.441293:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14236 00000100:00100000:2.0:1746147137.441297:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310627072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147137.441300:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310627968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (629us total) trans 21474841406 rc 0/0 00000100:00100000:1.0:1746147137.441304:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14234 00000100:00080000:1.0:1746147137.441314:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147137.441318:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310628480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (631us total) trans 21474841407 rc 0/0 00000100:00100000:0.0:1746147137.441323:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14235 00000004:00080000:1.0:1746147137.441340:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312eaa00/2, rc 0, transno 17179874138 00000100:00100000:1.0:1746147137.441349:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310626944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147137.441356:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8380/2, rc 0, transno 17179874140 00000004:00010000:0.0:1746147137.441356:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ca22680 reply state ffff88009a97e800 transno 8589935857 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147137.441359:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310627456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147137.441365:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ea680/2, rc 0, transno 17179874137 00000100:00100000:1.0:1746147137.441367:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310626560:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147137.441369:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.441376:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147137.441379:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147137.441381:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746147137.441439:0:7237:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147137.441449:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307844736:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 15475us (15688us total) trans 8589935857 rc 0/0 00000100:00100000:1.0:1746147137.441453:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147137.441458:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15191 00000100:00100000:1.0:1746147137.441459:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310628608:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147137.441463:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:2.0:1746147137.441465:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:2.0:1746147137.441466:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147137.441468:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147137.441469:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00010000:00010000:0.0:1746147137.441473:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147137.441476:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147137.441479:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.441484:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147137.441485:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967310627072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (900us total) trans 17179874144 rc 0/0 00010000:00010000:0.0:1746147137.441489:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12ca00 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:1.0:1746147137.441491:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310628608 00010000:00010000:0.0:1746147137.441492:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147137.441493:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310628608 00000100:00100000:2.0:1746147137.441496:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14236 00010000:00010000:0.0:1746147137.441498:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147137.441505:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14237 00010000:00010000:0.0:1746147137.441506:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147137.441508:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147137.441509:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3766:x1830967310628608:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147137.441511:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.441516:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250554b1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147137.441555:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3766:x1830967310628608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (78us total) trans 17179874145 rc 0/0 00000100:00100000:2.0:1746147137.441560:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14237 00000004:00080000:1.0:1746147137.441563:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74380/2, rc 0, transno 17179874145 00000100:00100000:1.0:1746147137.441567:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310628608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147137.441577:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76a00/2, rc 0, transno 21474841406 00000100:00100000:2.0:1746147137.441580:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310627968:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147137.441585:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77100/2, rc 0, transno 21474841407 00000100:00100000:2.0:1746147137.441587:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310628480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147137.441592:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74700/2, rc 0, transno 21474841404 00000100:00100000:2.0:1746147137.441595:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310627584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147137.441600:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75f80/2, rc 0, transno 21474841405 00000100:00100000:2.0:1746147137.441602:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310628096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147137.441609:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8000/2, rc 0, transno 17179874144 00000100:00100000:2.0:1746147137.441612:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310627072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147137.441885:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14230 00000004:00080000:3.0:1746147137.441908:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ebb80/2, rc 0, transno 17179874139 00000100:00100000:3.0:1746147137.441911:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310626816:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147137.441916:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ead80/2, rc 0, transno 17179874141 00000100:00100000:3.0:1746147137.441919:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310627328:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147137.441933:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75180/2, rc 0, transno 21474841402 00000100:00100000:3.0:1746147137.441935:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310627840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147137.441941:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74a80/2, rc 0, transno 21474841403 00000100:00100000:3.0:1746147137.441943:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310628352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147137.441949:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77800/2, rc 0, transno 21474841401 00000100:00100000:3.0:1746147137.441951:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310627712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147137.441957:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75c00/2, rc 0, transno 21474841400 00000100:00100000:3.0:1746147137.441959:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310628224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147137.441965:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8700/2, rc 0, transno 17179874142 00000100:00100000:3.0:1746147137.441967:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310626688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147137.441973:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8e00/2, rc 0, transno 17179874143 00000100:00100000:3.0:1746147137.441975:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310627200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147137.443570:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147137.444190:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845376 00000100:00100000:2.0:1746147137.444197:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845376 00000100:00100000:2.0:1746147137.444243:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15192 00000100:00100000:2.0:1746147137.444250:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32138:x1830967307845376:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147137.444270:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.444815:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775b1 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.444864:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.444879:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.444894:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147137.444896:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147137.444898:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e400, rc 0) 00000100:00100000:2.0:1746147137.444953:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307845376:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 703us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.444959:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15192 00000100:00100000:2.0:1746147137.450867:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.451314:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845504 00000100:00100000:0.0:1746147137.451322:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845504 00000100:00100000:0.0:1746147137.451368:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15193 00000100:00100000:0.0:1746147137.451375:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307845504:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147137.451391:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147137.451409:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x31399394250554bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775b8 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.451479:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.451491:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.451500:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147137.451526:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147137.451530:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147137.451543:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147137.451562:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x31399394250554bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.451591:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.451598:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147137.451600:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147137.451603:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:0.0:1746147137.451642:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32138:x1830967307845504:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 267us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.451647:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15193 00000100:00100000:0.0:1746147137.455767:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.455798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.455820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.455827:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845632 00000100:00100000:0.0:1746147137.455833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.455835:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845632 00000100:00100000:0.0:1746147137.455844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147137.455865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147137.455895:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845888 00000100:00100000:3.0:1746147137.455897:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845888 00000100:00100000:0.0:1746147137.455907:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846144 00000100:00100000:0.0:1746147137.455910:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846144 00000100:00100000:3.0:1746147137.455912:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307845760 00000100:00100000:3.0:1746147137.455914:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307845760 00000100:00100000:0.0:1746147137.455925:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846016 00000100:00100000:0.0:1746147137.455926:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846016 00000100:00100000:3.0:1746147137.455983:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846272 00000100:00100000:0.0:1746147137.455985:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14238 00000100:00100000:3.0:1746147137.455986:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846272 00000100:00100000:2.0:1746147137.455992:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14239 00000100:00100000:0.0:1746147137.455992:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307845632:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147137.456000:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307845888:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147137.456007:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.456009:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.456022:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775cd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147137.456022:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775bf expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147137.456044:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14240 00002000:00010000:2.0:1746147137.456049:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814173c, atime: 0x6814173c, ctime: 0x6814173d, blocks: 0x808 00002000:00010000:0.0:1746147137.456049:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814173f, atime: 0x6814173e, ctime: 0x6814173f, blocks: 0x7c8 00000100:00100000:3.0:1746147137.456051:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307846144:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147137.456058:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.456064:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.456064:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.456066:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.456066:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.456069:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775db expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147137.456073:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.456073:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147137.456082:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141741, atime: 0x68141741, ctime: 0x68141741, blocks: 0x1590 00010000:00010000:2.0:1746147137.456085:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.456085:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.456108:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.456109:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ce00, rc 0) 00010000:00010000:3.0:1746147137.456110:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.456110:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f200, rc 0) 00010000:00010000:3.0:1746147137.456115:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.456125:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.456132:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730e00, rc 0) 00000100:00100000:0.0:1746147137.456145:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307845632:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 153us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.456146:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307845888:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 146us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147137.456151:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14238 00000100:00100000:2.0:1746147137.456154:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14239 00000100:00100000:3.0:1746147137.456156:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307846144:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 105us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.456162:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14240 00000100:00100000:0.0:1746147137.456165:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14241 00000100:00100000:2.0:1746147137.456168:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14242 00000100:00100000:0.0:1746147137.456169:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307845760:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147137.456172:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14243 00000100:00100000:2.0:1746147137.456174:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307846016:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147137.456175:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147137.456177:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307846272:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147137.456179:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147137.456182:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775c6 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147137.456186:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147137.456187:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775d4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147137.456190:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6814173f, atime: 0x6814173d, ctime: 0x6814173f, blocks: 0x808 00010000:00010000:3.0:1746147137.456193:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775e2 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147137.456196:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141741, atime: 0x68141740, ctime: 0x68141741, blocks: 0x800 00010000:00010000:0.0:1746147137.456196:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.456198:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147137.456201:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147137.456202:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141740, atime: 0x68141741, ctime: 0x68141740, blocks: 0x1008 00010000:00010000:2.0:1746147137.456203:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.456204:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.456207:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.456210:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.456211:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147137.456212:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147137.456215:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147137.456216:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147137.456216:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c000, rc 0) 00010000:00010000:2.0:1746147137.456222:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f600, rc 0) 00010000:00010000:3.0:1746147137.456224:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147137.456227:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307845760:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 58us (394us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147137.456231:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730400, rc 0) 00000100:00100000:0.0:1746147137.456232:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14241 00000100:00100000:2.0:1746147137.456238:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307846016:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 65us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147137.456243:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14242 00000100:00100000:3.0:1746147137.456247:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307846272:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 70us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147137.456252:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14243 00010000:00010000:0.0:1746147137.617281:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147138.462187:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.462229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.462258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.462286:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.462299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.462327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.462344:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846528 00000100:00100000:0.0:1746147138.462346:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846784 00000100:00100000:1.0:1746147138.462352:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846528 00000100:00100000:0.0:1746147138.462352:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846784 00000100:00100000:1.0:1746147138.462394:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847040 00000100:00100000:1.0:1746147138.462396:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847040 00000100:00100000:2.0:1746147138.462427:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846400 00000100:00100000:2.0:1746147138.462431:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846400 00000100:00100000:3.0:1746147138.462482:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846656 00000100:00100000:3.0:1746147138.462486:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846656 00000100:00100000:1.0:1746147138.462525:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307846912 00000100:00100000:1.0:1746147138.462526:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307846912 00000100:00100000:0.0:1746147138.462538:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14244 00000100:00100000:1.0:1746147138.462543:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14245 00000100:00100000:0.0:1746147138.462545:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307846528:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147138.462548:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307847040:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00080000:1.0:1746147138.462561:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147138.462563:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147138.462629:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307847040:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.462629:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307846528:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.462634:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14244 00000100:00100000:1.0:1746147138.462637:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14245 00000100:00100000:1.0:1746147138.462646:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14246 00000100:00100000:0.0:1746147138.462650:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14247 00000100:00100000:1.0:1746147138.462651:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307846784:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147138.462655:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307846912:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147138.462676:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307846784:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.462681:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14246 00000100:00100000:0.0:1746147138.462684:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307846912:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.462689:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14247 00000100:00100000:2.0:1746147138.462812:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14248 00000100:00100000:2.0:1746147138.462818:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307846400:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147138.462869:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307846400:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 52us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.462874:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14248 00000100:00100000:3.0:1746147138.462986:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14249 00000100:00100000:3.0:1746147138.462991:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307846656:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147138.463044:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307846656:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 52us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.463048:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14249 00000100:00100000:0.0:1746147138.469312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.469344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.470766:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.470903:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847296 00000100:00100000:2.0:1746147138.470911:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847296 00000100:00100000:2.0:1746147138.470952:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847552 00000100:00100000:2.0:1746147138.470954:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847552 00000100:00100000:3.0:1746147138.471926:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847808 00000100:00100000:3.0:1746147138.471932:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847808 00000100:00100000:3.0:1746147138.471956:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14250 00000100:00100000:3.0:1746147138.471963:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307847296:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147138.472064:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307847296:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 101us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.472070:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14250 00000100:00100000:3.0:1746147138.472083:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14251 00000100:00100000:3.0:1746147138.472099:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307847552:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147138.472133:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307847552:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 45us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.472138:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14251 00000100:00100000:3.0:1746147138.472147:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14252 00000100:00100000:3.0:1746147138.472151:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307847808:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147138.472180:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307847808:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 28us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.472184:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14252 00000100:00100000:1.0:1746147138.472325:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.472369:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.472396:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.472703:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847168 00000100:00100000:2.0:1746147138.472706:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847168 00000100:00100000:2.0:1746147138.472724:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847424 00000100:00100000:2.0:1746147138.472725:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847424 00000100:00100000:2.0:1746147138.472739:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847680 00000100:00100000:2.0:1746147138.472740:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847680 00000100:00100000:2.0:1746147138.472752:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14253 00000100:00100000:2.0:1746147138.472757:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307847168:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147138.472794:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307847168:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 37us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.472799:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14253 00000100:00100000:2.0:1746147138.472807:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14254 00000100:00100000:2.0:1746147138.472811:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307847424:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147138.472835:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307847424:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.472840:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14254 00000100:00100000:2.0:1746147138.472847:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14255 00000100:00100000:2.0:1746147138.472851:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307847680:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147138.472885:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307847680:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.472891:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14255 00000100:00100000:0.0:1746147138.477083:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.477173:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307847936 00000100:00100000:3.0:1746147138.477181:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307847936 00000100:00100000:3.0:1746147138.477219:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14256 00000100:00100000:3.0:1746147138.477225:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307847936:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:3.0:1746147138.477386:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147138.477389:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147138.477391:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147138.477393:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147138.477395:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:3.0:1746147138.477446:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307847936:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 220us (371us total) trans 21474841408 rc 0/0 00000100:00100000:3.0:1746147138.477453:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14256 00000100:00100000:0.0:1746147138.481619:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.481694:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307848064 00000100:00100000:2.0:1746147138.481702:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307848064 00000100:00100000:2.0:1746147138.481739:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14257 00000100:00100000:2.0:1746147138.481746:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307848064:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:2.0:1746147138.481902:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147138.481905:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.481907:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147138.481909:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.481911:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147138.481949:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307848064:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 203us (337us total) trans 17179874146 rc 0/0 00000100:00100000:2.0:1746147138.481955:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14257 00000100:00100000:0.0:1746147138.493175:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.493216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.493245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.493270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.493305:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307848448 00000100:00100000:0.0:1746147138.493313:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307848448 00000100:00100000:0.0:1746147138.493359:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307848576 00000100:00100000:0.0:1746147138.493361:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307848576 00000100:00100000:3.0:1746147138.494162:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307848960 00000100:00100000:0.0:1746147138.494163:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307848832 00000100:00100000:3.0:1746147138.494167:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307848960 00000100:00100000:0.0:1746147138.494167:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307848832 00000100:00100000:2.0:1746147138.494169:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3333 00000100:00100000:1.0:1746147138.494178:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3334 00000100:00100000:2.0:1746147138.494179:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307848448:12345-192.168.204.25@tcp:3:mirror_io.0 00000100:00100000:1.0:1746147138.494185:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307848576:12345-192.168.204.25@tcp:3:mirror_io.0 00000100:00100000:0.0:1746147138.494190:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3335 00000100:00100000:0.0:1746147138.494194:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307848832:12345-192.168.204.25@tcp:3:mirror_io.0 00000100:00100000:3.0:1746147138.494197:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3336 00000100:00100000:3.0:1746147138.494203:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307848960:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147138.494210:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.494210:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.494211:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.494218:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.494222:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.494222:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.494222:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.494223:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.494223:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.494223:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.494226:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.494227:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.494227:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.494227:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.494227:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.494231:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.494240:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.494240:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.494240:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.494240:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.498718:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.498766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.499253:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307849344 00000100:00100000:1.0:1746147138.499253:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307849600 00000100:00100000:3.0:1746147138.499260:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307849344 00000100:00100000:1.0:1746147138.499261:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307849600 00000100:00100000:3.0:1746147138.499314:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3337 00000100:00100000:3.0:1746147138.499321:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307849344:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147138.499349:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.499360:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.499362:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.499367:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.499722:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3338 00000100:00100000:1.0:1746147138.499729:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307849600:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147138.499745:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.499754:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.499755:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.499758:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.499769:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.499934:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.501961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.503043:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.503161:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307850112 00000100:00100000:2.0:1746147138.503169:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307850112 00000100:00100000:2.0:1746147138.503242:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3339 00000100:00100000:2.0:1746147138.503254:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2002:x1830967307850112:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147138.503290:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.503302:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.503304:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.503312:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.503323:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.503488:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307849856 00000100:00100000:0.0:1746147138.503492:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307849856 00000100:00100000:0.0:1746147138.503514:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3340 00000100:00100000:0.0:1746147138.503520:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2003:x1830967307849856:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147138.503536:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.503545:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.503546:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.503549:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.503558:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509574:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509589:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509597:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509603:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093731800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147138.509607:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509613:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509629:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.509635:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x313993942505550c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.509742:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307848960:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 15534us (16491us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.509752:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3336 00010000:00010000:1.0:1746147138.519626:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.519642:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.519649:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.519660:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0d600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147138.519664:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.519671:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.519690:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.519696:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425055505 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.519791:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307848832:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 25591us (26514us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.519800:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3335 00010000:00010000:1.0:1746147138.530942:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.530958:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.530966:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.530972:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38fe00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147138.530977:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.530989:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.531005:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.531010:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x31399394250554fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.531080:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2003:x1830967307848576:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 36892us (37859us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.531108:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3334 00010000:00010000:3.0:1746147138.532830:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.532845:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.532851:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.532857:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147138.532861:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.532867:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.532881:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.532887:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x31399394250554f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.532958:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2003:x1830967307848448:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 38777us (39788us total) trans 0 rc 1019904/1019904 00000100:00100000:3.0:1746147138.532967:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3333 00010000:00010000:1.0:1746147138.537909:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.537924:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.537932:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.537939:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38f600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147138.537943:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.537950:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.537967:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.537972:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38f600/0x313993942505551a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.538062:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307849600:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 38328us (39290us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.538071:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3338 00010000:00010000:3.0:1746147138.546156:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.546172:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.546180:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.546186:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093731e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147138.546189:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.546195:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.546212:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.546217:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425055513 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.546320:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307849344:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 46996us (47607us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.546329:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3337 00010000:00010000:2.0:1746147138.557714:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.557728:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.557735:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.557741:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098e6c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147138.557745:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.557752:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.557767:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.557772:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098e6c000/0x3139939425055521 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.557869:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307850112:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 54616us (55908us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.557879:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3339 00010000:00010000:1.0:1746147138.562418:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.562434:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.562442:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.562448:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a2e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147138.562452:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.562459:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.562475:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.562485:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2e00/0x3139939425055528 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.562565:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307849856:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 59041us (59519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.562573:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3340 00000100:00100000:0.0:1746147138.575551:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.575620:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307850240 00000100:00100000:2.0:1746147138.575629:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307850240 00000100:00100000:2.0:1746147138.576801:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 795 00000100:00100000:2.0:1746147138.576816:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32138:x1830967307850240:12345-192.168.204.25@tcp:103:mirror_io.0 00010000:00010000:2.0:1746147138.576833:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147138.576860:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425055472 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775a3 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.576905:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.576909:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147138.576965:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307850240:12345-192.168.204.25@tcp:103:mirror_io.0 Request processed in 155us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.576971:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 795 00000100:00080000:1.0:1746147138.577207:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147138.582389:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.582490:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307850496 00000100:00100000:2.0:1746147138.582499:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307850496 00000100:00100000:2.0:1746147138.586302:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5416 00000100:00100000:2.0:1746147138.586328:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32138:x1830967307850496:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147138.586591:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32138:x1830967307850496:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 274us (4210us total) trans 8589935858 rc 0/0 00000100:00100000:2.0:1746147138.586596:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5416 00000100:00100000:0.0:1746147138.588738:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.588811:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307850752 00000100:00100000:3.0:1746147138.588821:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307850752 00000100:00100000:3.0:1746147138.588874:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5417 00000100:00100000:3.0:1746147138.588882:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32138:x1830967307850752:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147138.589191:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32138:x1830967307850752:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 308us (461us total) trans 8589935859 rc 0/0 00000100:00100000:3.0:1746147138.589197:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5417 00010000:00010000:3.0:1746147138.619347:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147138.624407:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.624464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.624493:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307851008 00000100:00100000:3.0:1746147138.624502:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307851008 00000100:00100000:3.0:1746147138.624585:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307851264 00000100:00100000:3.0:1746147138.624588:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307851264 00000100:00100000:3.0:1746147138.624621:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15194 00000100:00100000:3.0:1746147138.624628:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:32152:x1830967307851008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147138.624649:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147138.624665:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505552f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775e9 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.624727:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624739:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624748:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624758:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624763:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624767:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00080000:0.0:1746147138.624865:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147138.624867:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624876:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624882:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147138.624890:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15195 00000004:00200000:3.0:1746147138.624891:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:0.0:1746147138.624897:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32151:x1830967307851264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.624906:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.624914:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775f0 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.624943:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.624950:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.624957:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147138.624958:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624964:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.624965:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147138.624970:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.624970:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147138.624975:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0aea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147138.624975:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147138.624978:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.624990:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625000:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147138.625003:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147138.625007:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625023:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425055536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.625024:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625030:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625040:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147138.625046:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147138.625079:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625084:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625119:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625124:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625128:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256f800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147138.625131:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625135:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625142:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147138.625144:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147138.625146:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625151:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625163:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625171:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625175:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625179:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256e800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147138.625181:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625185:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625191:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f027700) 00010000:00010000:0.0:1746147138.625193:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147138.625195:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625199:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x3139939425055560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147138.625226:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.625236:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.625242:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.625244:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147138.625245:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ec00, rc 0) 00000100:00100000:0.0:1746147138.625297:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32151:x1830967307851264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 400us (831us total) trans 8589935861 rc 0/0 00010000:00010000:3.0:1746147138.625302:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147138.625303:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15195 00010000:00010000:3.0:1746147138.625307:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625312:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625315:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0aec00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147138.625317:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625321:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625326:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f027700) 00010000:00010000:3.0:1746147138.625328:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147138.625330:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625333:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505553d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.625362:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505552f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.625371:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.625377:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.625379:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147138.625381:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae600, rc 0) 00000100:00100000:3.0:1746147138.625399:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:32152:x1830967307851008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 772us (1000us total) trans 8589935860 rc 0/0 00000100:00100000:3.0:1746147138.625405:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15194 00000100:00100000:0.0:1746147138.633726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.633772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.633802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.633834:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.633850:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.634984:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307851648 00000100:00100000:2.0:1746147138.634992:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307851648 00000100:00100000:0.0:1746147138.635024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147138.635041:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147138.635051:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307851776 00000100:00100000:2.0:1746147138.635054:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307851904 00000100:00100000:2.0:1746147138.635056:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307851904 00000100:00100000:0.0:1746147138.635059:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307851776 00000100:00100000:2.0:1746147138.635073:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852032 00000100:00100000:2.0:1746147138.635075:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852032 00000100:00100000:0.0:1746147138.635082:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14258 00000100:00100000:0.0:1746147138.635103:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307851648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.635123:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147138.635133:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307851520 00000100:00100000:3.0:1746147138.635137:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307851520 00010000:00010000:0.0:1746147138.635139:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775fe expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.635158:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853312 00000100:00100000:3.0:1746147138.635160:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853312 00010000:00010000:0.0:1746147138.635162:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.635164:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.635172:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147138.635180:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15196 00000100:00100000:3.0:1746147138.635186:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32148:x1830967307851520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147138.635186:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.635195:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f600, rc 0) 00010000:00010000:3.0:1746147138.635198:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147138.635210:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x313993942505557c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e775f7 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.635232:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307851648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 143us (1464us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147138.635301:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.635313:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635320:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635332:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635338:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.635377:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635387:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 28 pid: 9138 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.635397:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310628736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.635786:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635795:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 10 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.635803:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310628864:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.635828:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635835:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 9 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.635842:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310628992:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147138.635857:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.635872:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15197 00000100:00100000:3.0:1746147138.635878:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32150:x1830967307853312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147138.635888:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147138.635895:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x313993942505558a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77652 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.635930:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.635937:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.635943:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147138.636110:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14258 00000100:00100000:0.0:1746147138.636126:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14259 00000100:00100000:0.0:1746147138.636132:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307851904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.636139:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.636148:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7760c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.636153:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14260 00010000:00010000:0.0:1746147138.636159:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147138.636160:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307851776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.636161:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.636166:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.636167:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.636174:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77605 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.636175:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.636182:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e600, rc 0) 00010000:00010000:2.0:1746147138.636184:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.636185:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.636190:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.636199:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147138.636199:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307851904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 67us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.636204:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14259 00010000:00010000:2.0:1746147138.636206:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ffc00, rc 0) 00000100:00100000:0.0:1746147138.636213:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14261 00000100:00100000:0.0:1746147138.636218:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307852032:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147138.636224:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307851776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 65us (2390us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147138.636224:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147138.636229:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14260 00010000:00010000:0.0:1746147138.636230:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77613 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.636239:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.636241:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.636244:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.636251:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.636257:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f400, rc 0) 00000100:00100000:0.0:1746147138.636270:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307852032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 52us (1260us total) trans 0 rc 0/0 00000100:00080000:2.0:1746147138.636272:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147138.636274:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14261 00000100:00100000:2.0:1746147138.636300:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.636337:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852160 00000100:00100000:0.0:1746147138.636341:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852160 00000100:00100000:0.0:1746147138.636358:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14262 00000100:00100000:0.0:1746147138.636362:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307852160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.636368:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.636374:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77621 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.636384:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.636385:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.636389:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 35 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.636396:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 35 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.636402:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099149a00, rc 0) 00000100:00100000:0.0:1746147138.636416:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307852160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.636421:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14262 00000100:00100000:2.0:1746147138.636721:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.636735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.637192:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.637219:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.637231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.637243:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852288 00000100:00100000:2.0:1746147138.637246:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852288 00000100:00100000:2.0:1746147138.637265:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852416 00000100:00100000:0.0:1746147138.637266:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852544 00000100:00100000:2.0:1746147138.637267:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852416 00000100:00100000:0.0:1746147138.637270:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852544 00000100:00100000:2.0:1746147138.637274:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852672 00000100:00100000:2.0:1746147138.637276:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852672 00000100:00100000:2.0:1746147138.637284:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852800 00000100:00100000:2.0:1746147138.637286:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852800 00000100:00100000:0.0:1746147138.637463:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14263 00000100:00100000:0.0:1746147138.637469:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307852288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.637477:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.637484:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7761a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.637495:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637496:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637500:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637509:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637517:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256fe00, rc 0) 00000100:00100000:0.0:1746147138.637539:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307852288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 71us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.637544:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14263 00000100:00100000:0.0:1746147138.637554:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14264 00000100:00100000:0.0:1746147138.637559:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307852416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.637564:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.637574:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77628 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.637583:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637585:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637588:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637596:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637602:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f588e00, rc 0) 00000100:00100000:0.0:1746147138.637615:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307852416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 57us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.637620:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14264 00000100:00100000:0.0:1746147138.637629:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14265 00000100:00100000:0.0:1746147138.637633:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+6:2003:x1830967307852672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.637638:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.637643:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77636 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.637653:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637654:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637658:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 7 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637665:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 7 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637675:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f588c00, rc 0) 00000100:00100000:0.0:1746147138.637689:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307852672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 56us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.637693:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14265 00000100:00100000:0.0:1746147138.637702:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14266 00000100:00100000:0.0:1746147138.637706:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+6:2002:x1830967307852544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.637711:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.637716:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7762f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.637725:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637726:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637729:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 7 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637737:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 7 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637743:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714200, rc 0) 00000100:00100000:0.0:1746147138.637755:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307852544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 49us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.637759:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14266 00000100:00100000:0.0:1746147138.637768:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14267 00000100:00100000:0.0:1746147138.637772:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967307852800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.637780:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.637785:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7763d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.637794:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637796:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.637799:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637806:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.637813:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714e00, rc 0) 00000100:00100000:0.0:1746147138.637824:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307852800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 52us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.637829:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14267 00000100:00080000:2.0:1746147138.637865:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746147138.637868:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147138.637895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.637909:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307852928 00000100:00100000:2.0:1746147138.637912:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307852928 00000100:00100000:2.0:1746147138.637929:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14268 00000100:00100000:2.0:1746147138.637934:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307852928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147138.637940:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.637947:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77644 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.637957:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.637959:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.637964:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.637973:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.637980:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fec00, rc 0) 00000100:00100000:2.0:1746147138.637995:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967307852928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 61us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.638000:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14268 00000100:00100000:2.0:1746147138.638108:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.638120:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853056 00000100:00100000:2.0:1746147138.638122:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853056 00000100:00100000:2.0:1746147138.638136:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14269 00000100:00100000:2.0:1746147138.638142:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307853056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147138.638148:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.638154:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7764b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.638164:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.638165:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.638169:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.638178:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.638189:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff400, rc 0) 00000100:00100000:2.0:1746147138.638203:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307853056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 61us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.638208:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14269 00000100:00100000:0.0:1746147138.642346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.642376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.642391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.642442:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853824 00000100:00100000:1.0:1746147138.642450:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853824 00000100:00100000:0.0:1746147138.642460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.642484:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853440 00000100:00100000:0.0:1746147138.642487:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853440 00000100:00100000:1.0:1746147138.642491:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15198 00000100:00100000:1.0:1746147138.642498:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32151:x1830967307853824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.642507:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 31 pid: 9138 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.642513:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147138.642528:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250555e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77659 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.642573:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250555e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77659 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.642584:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250555e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77659 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.642597:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.642600:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147138.642602:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38f600, rc 0) 00000100:00100000:1.0:1746147138.642639:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32151:x1830967307853824:12345-192.168.204.25@tcp:101:cat.0 Request processed in 141us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.642648:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15198 00000100:00100000:0.0:1746147138.642718:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853696 00000100:00100000:0.0:1746147138.642721:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853696 00010000:00010000:0.0:1746147138.642731:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 10 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746147138.642743:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853568 00000100:00100000:0.0:1746147138.642744:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853568 00010000:00010000:0.0:1746147138.642750:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 11 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.642754:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6217 00000100:00100000:1.0:1746147138.642760:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307853440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147138.642762:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6218 00000100:00100000:0.0:1746147138.642766:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307853696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.642767:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.642771:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 31 pid: 9138 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.642772:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.642775:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 10 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.642779:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 31 pid: 9138 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.642824:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6219 00000100:00100000:3.0:1746147138.642829:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307853568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.642836:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.642839:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 11 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.643140:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 10 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.643154:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.643158:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.643163:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147138.643387:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310628736:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.643396:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310628864:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.643405:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x31399394250554c6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b8 expref: 10 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.643420:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310628992:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.643896:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.643921:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307853696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1154us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.643929:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6218 00000100:00100000:0.0:1746147138.643975:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.644043:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307853952 00000100:00100000:0.0:1746147138.644046:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307853952 00000100:00100000:0.0:1746147138.644065:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15199 00000100:00100000:0.0:1746147138.644069:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:32152:x1830967307853952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.644079:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.644114:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77660 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.644163:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x3139939425055567 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f0 expref: 31 pid: 9138 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.644181:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.644187:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.644196:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.644203:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.644222:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307853440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1463us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.644228:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6217 00010000:00010000:3.0:1746147138.645946:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 13 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.646171:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.646219:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.646233:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.646265:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.646268:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147138.646270:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715800, rc 0) 00000100:00100000:0.0:1746147138.646322:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:32152:x1830967307853952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2251us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.646329:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15199 00010000:00010000:3.0:1746147138.646421:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x3139939425055544 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e9 expref: 12 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.646431:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.646435:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.646441:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.646446:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.646451:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.646456:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.646460:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.646489:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.646513:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307853568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3683us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.646520:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6219 00010000:00010000:2.0:1746147138.646533:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147138.646540:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147138.646555:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147138.646641:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x313993942505557c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.646650:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.646660:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.646662:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147138.646664:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afe00, rc 0) 00000100:00100000:2.0:1746147138.646684:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32148:x1830967307851520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11498us (12966us total) trans 8589935862 rc 0/0 00000100:00100000:2.0:1746147138.646689:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15196 00010000:00010000:0.0:1746147138.646690:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.646696:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147138.646706:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147138.646751:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x313993942505558a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.646765:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.646771:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.646773:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147138.646775:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731400, rc 0) 00000100:00100000:0.0:1746147138.646878:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32150:x1830967307853312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10999us (13074us total) trans 8589935863 rc 0/0 00000100:00100000:0.0:1746147138.646884:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15197 00000100:00100000:0.0:1746147138.661305:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.661339:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.661380:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.661443:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307854208 00000100:00100000:3.0:1746147138.661452:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307854208 00000100:00100000:2.0:1746147138.661459:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307854464 00000100:00100000:2.0:1746147138.661463:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307854464 00002000:00100000:3.0:1746147138.661491:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f55c00 x1830967307854208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.661491:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f57b80 x1830967307854464/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.661499:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55c00 with x1830967307854208 ext(0->1048575) 00002000:00100000:2.0:1746147138.661500:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967307854464 ext(0->1048575) 00002000:00010000:3.0:1746147138.661504:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55c00 00002000:00010000:2.0:1746147138.661504:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f57b80 00000100:00100000:2.0:1746147138.661525:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307854720 00000100:00100000:2.0:1746147138.661527:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307854720 00000100:00100000:3.0:1746147138.661533:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3341 00002000:00100000:2.0:1746147138.661539:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f57480 x1830967307854720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147138.661541:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307854464:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:2.0:1746147138.661546:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57480 with x1830967307854720 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.661549:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57480 00000100:00100000:2.0:1746147138.661560:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3342 00000100:00100000:2.0:1746147138.661566:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307854208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147138.661607:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3343 00000100:00100000:2.0:1746147138.661612:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307854720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147138.669415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.669455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.669770:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307855488 00000100:00100000:2.0:1746147138.669780:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307855488 00000100:00100000:2.0:1746147138.669832:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15200 00000100:00100000:2.0:1746147138.669839:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32150:x1830967307855488:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147138.669862:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.669865:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147138.669886:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250555e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77659 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.669905:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.669910:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147138.669921:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055601 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77667 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.669960:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.669970:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.669976:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.669981:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.670003:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.670026:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 10 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.670040:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310629120:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.670132:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.670139:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 8 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.670146:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310629248:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.670163:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.670306:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.671072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.671363:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.671382:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307854976 00000100:00100000:1.0:1746147138.671386:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307854976 00002000:00100000:1.0:1746147138.671411:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f55f80 x1830967307854976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.671425:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55f80 with x1830967307854976 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.671429:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55f80 00000100:00100000:1.0:1746147138.671440:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307855616 00000100:00100000:1.0:1746147138.671442:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307855616 00002000:00100000:1.0:1746147138.671449:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011db15c00 x1830967307855616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.671455:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15c00 with x1830967307855616 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.671457:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15c00 00000100:00100000:1.0:1746147138.671464:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307855744 00000100:00100000:1.0:1746147138.671466:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307855744 00002000:00100000:1.0:1746147138.671474:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db17b80 x1830967307855744/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.671479:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17b80 with x1830967307855744 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.671482:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17b80 00000100:00100000:1.0:1746147138.671489:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3344 00000100:00100000:1.0:1746147138.671494:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307854976:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147138.672050:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3345 00000100:00100000:1.0:1746147138.672055:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307855616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147138.672569:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3346 00000100:00100000:1.0:1746147138.672575:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307855744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147138.674373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.674402:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307856128 00000100:00100000:0.0:1746147138.674408:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307856128 00002000:00100000:0.0:1746147138.674439:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011db16300 x1830967307856128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.674448:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16300 with x1830967307856128 ext(1048576->2097151) 00002000:00010000:0.0:1746147138.674453:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db16300 00000100:00100000:0.0:1746147138.674466:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307856256 00000100:00100000:0.0:1746147138.674468:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307856256 00002000:00100000:0.0:1746147138.674480:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db14e00 x1830967307856256/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.674493:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14e00 with x1830967307856256 ext(1048576->2097151) 00002000:00010000:0.0:1746147138.674496:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14e00 00000100:00100000:0.0:1746147138.674513:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3347 00000100:00100000:0.0:1746147138.674518:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307856128:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147138.674932:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3348 00000100:00100000:0.0:1746147138.674937:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307856256:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147138.675142:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.675258:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967307854464:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13717us (13918us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147138.675265:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3341 00002000:00100000:0.0:1746147138.675271:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f57b80 x1830967307854464/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.675278:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967307854464 ext(0->1048575) 00002000:00010000:0.0:1746147138.675281:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f57b80 00000100:00100000:0.0:1746147138.675358:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307856512 00000100:00100000:0.0:1746147138.675362:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307856512 00000100:00100000:0.0:1746147138.675385:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15201 00000100:00100000:0.0:1746147138.675390:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32148:x1830967307856512:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147138.675405:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.675408:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147138.675418:0:7238:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 11 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.675443:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.675447:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.675454:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.675459:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147138.675468:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x313993942505560f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7766e expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.675499:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.675507:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.675512:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.675523:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147138.675531:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147138.681445:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307854720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19821us (20054us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.681457:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3343 00002000:00100000:2.0:1746147138.681468:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f57480 x1830967307854720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.681477:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57480 with x1830967307854720 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.681482:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57480 00000100:00100000:0.0:1746147138.681924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147138.681998:0:16099:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from blocking AST (req@ffff88011e502a00 x1830967310629120) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 12 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.682022:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250555ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77660 expref: 12 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.682037:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310629120:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.682048:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310629248:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.682066:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.682071:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00000100:00100000:3.0:1746147138.682075:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307856640 00010000:00010000:2.0:1746147138.682077:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00000100:00100000:3.0:1746147138.682082:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307856640 00010000:00010000:2.0:1746147138.682083:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.682125:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 9 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.682218:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6220 00000100:00100000:3.0:1746147138.682226:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307856640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.682237:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.682242:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 9 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.682252:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 9 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.682268:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250554b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775b1 expref: 9 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.682280:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.682283:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.682290:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.682296:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.682303:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.682308:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147138.682322:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147138.682339:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.682345:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00000100:00100000:3.0:1746147138.682354:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307856640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 128us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.682360:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6220 00000040:00080000:2.0:1746147138.682701:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].532, 88 off54872 00000004:00080000:2.0:1746147138.682707:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672617462ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.682744:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].476, 88 off49944 00000004:00080000:2.0:1746147138.682749:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672659701ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.682794:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].477, 88 off50032 00000004:00080000:2.0:1746147138.682797:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672707867ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.682805:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].533, 88 off54960 00000004:00080000:2.0:1746147138.682807:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672717761ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.682930:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].534, 88 off55048 00000004:00080000:2.0:1746147138.682934:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672844262ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.682942:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].478, 88 off50120 00000004:00080000:2.0:1746147138.682944:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672854867ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.682953:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].479, 88 off50208 00000004:00080000:2.0:1746147138.682955:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672865967ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.682963:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].480, 88 off50296 00000004:00080000:2.0:1746147138.682965:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672875343ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.682972:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].535, 88 off55136 00000004:00080000:2.0:1746147138.682974:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672884742ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.682981:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].481, 88 off50384 00000004:00080000:2.0:1746147138.682983:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672893889ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.682990:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].536, 88 off55224 00000004:00080000:2.0:1746147138.682992:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672902716ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.682999:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].482, 88 off50472 00000004:00080000:2.0:1746147138.683001:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672911797ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.683008:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].537, 88 off55312 00000004:00080000:2.0:1746147138.683021:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672920691ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.683031:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].538, 88 off55400 00000004:00080000:2.0:1746147138.683034:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672944329ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.683040:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].539, 88 off55488 00000004:00080000:2.0:1746147138.683042:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672952739ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.683049:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].540, 88 off55576 00000004:00080000:2.0:1746147138.683051:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676672961431ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.683058:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].483, 88 off50560 00000004:00080000:2.0:1746147138.683060:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676672970669ns, next at 554081490131ns, rc = 0 00000100:00100000:3.0:1746147138.686111:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307854208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 24522us (24792us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.686121:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3342 00002000:00100000:3.0:1746147138.686131:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f55c00 x1830967307854208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.686140:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55c00 with x1830967307854208 ext(0->1048575) 00002000:00010000:3.0:1746147138.686146:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55c00 00000001:00080000:3.0:1746147138.690323:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935864 is committed 00000004:00080000:3.0:1746147138.690334:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 478 committed 00000004:00080000:3.0:1746147138.690350:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 533 committed 00000004:00080000:3.0:1746147138.690664:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 532 committed 00000004:00080000:3.0:1746147138.690666:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 531 committed 00000004:00080000:3.0:1746147138.690668:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 530 committed 00000004:00080000:3.0:1746147138.690669:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 477 committed 00000004:00080000:3.0:1746147138.690671:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 529 committed 00000004:00080000:3.0:1746147138.690672:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 476 committed 00000004:00080000:3.0:1746147138.690674:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 528 committed 00000004:00080000:3.0:1746147138.690675:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 475 committed 00000004:00080000:3.0:1746147138.690676:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 474 committed 00000004:00080000:3.0:1746147138.690678:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 473 committed 00000004:00080000:3.0:1746147138.690679:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 527 committed 00000004:00080000:3.0:1746147138.690680:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 526 committed 00000004:00080000:3.0:1746147138.690681:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 472 committed 00000004:00080000:3.0:1746147138.690683:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 471 committed 00000004:00080000:3.0:1746147138.690684:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 525 committed 00000001:00080000:3.0:1746147138.690692:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935862 is committed 00000001:00080000:3.0:1746147138.690700:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935859 is committed 00000100:00100000:3.0:1746147138.690721:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310629504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147138.690777:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147138.690897:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310629632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.690986:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310629760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147138.691527:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310629504 00000100:00100000:1.0:1746147138.691534:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310629504 00000100:00100000:1.0:1746147138.691566:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14270 00000100:00100000:1.0:1746147138.691571:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967310629504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147138.691674:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147138.691677:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147138.691679:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147138.691681:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147133 -> 1746147133 00002000:00010000:1.0:1746147138.691682:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147138.692628:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3765:x1830967310629504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1053us (1848us total) trans 21474841409 rc 0/0 00000100:00100000:1.0:1746147138.692635:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14270 00000100:00100000:1.0:1746147138.692661:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.692694:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310630272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.692714:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.692727:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310630784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147138.692741:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.692753:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310631296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147138.692764:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.692781:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147138.692786:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310630656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147138.692801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.692810:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310631168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147138.692820:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.692836:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310629760 00000100:00100000:1.0:1746147138.692840:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310629760 00000100:00100000:1.0:1746147138.692857:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630272 00000100:00100000:1.0:1746147138.692859:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630272 00000100:00100000:1.0:1746147138.692869:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630784 00000100:00100000:1.0:1746147138.692870:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630784 00000100:00100000:1.0:1746147138.692878:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310631296 00000100:00100000:1.0:1746147138.692879:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310631296 00000100:00100000:1.0:1746147138.692887:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630656 00000100:00100000:1.0:1746147138.692889:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630656 00000100:00100000:1.0:1746147138.692894:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310631168 00000100:00100000:1.0:1746147138.692895:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310631168 00000100:00100000:1.0:1746147138.692902:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14271 00000100:00100000:1.0:1746147138.692906:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3767:x1830967310629760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147138.692974:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147138.692977:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:1.0:1746147138.692979:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147134 -> 1746147134 00002000:00010000:1.0:1746147138.692980:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:1.0:1746147138.692982:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147138.693002:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967310629760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (340us total) trans 17179874147 rc 0/0 00000100:00100000:1.0:1746147138.693006:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14271 00000100:00100000:1.0:1746147138.693033:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14272 00000100:00100000:1.0:1746147138.693038:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310630272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.693106:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967310630272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (391us total) trans 21474841410 rc 0/0 00000100:00100000:1.0:1746147138.693111:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14272 00000100:00100000:1.0:1746147138.693120:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14273 00000100:00100000:1.0:1746147138.693124:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3767:x1830967310630784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147138.693410:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310629376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.693434:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693451:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310629888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.693464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693471:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.693484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693492:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147138.693504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693514:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746147138.693518:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.693530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693536:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147138.693547:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693553:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310631040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147138.693564:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.693579:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310629376 00000100:00100000:2.0:1746147138.693582:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310629376 00000100:00100000:2.0:1746147138.693594:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310629888 00000100:00100000:2.0:1746147138.693596:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310629888 00000100:00100000:2.0:1746147138.693601:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630400 00000100:00100000:2.0:1746147138.693603:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630400 00000100:00100000:2.0:1746147138.693608:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630912 00000100:00100000:2.0:1746147138.693610:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630912 00000100:00100000:2.0:1746147138.693616:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630016 00000100:00100000:2.0:1746147138.693617:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630016 00000100:00100000:2.0:1746147138.693623:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630528 00000100:00100000:2.0:1746147138.693625:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630528 00000100:00100000:2.0:1746147138.693631:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310631040 00000100:00100000:2.0:1746147138.693632:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310631040 00000100:00100000:2.0:1746147138.693639:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14274 00000100:00100000:2.0:1746147138.693643:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967310631296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147138.693685:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:2.0:1746147138.693687:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.693689:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147138.693691:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.693693:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:2.0:1746147138.693711:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310631296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (945us total) trans 17179874148 rc 0/0 00000100:00100000:2.0:1746147138.693716:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14274 00000100:00100000:2.0:1746147138.693725:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14275 00000100:00100000:2.0:1746147138.693729:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967310630656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147138.693763:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:2.0:1746147138.693765:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147137 -> 1746147137 00002000:00010000:2.0:1746147138.693766:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147137 -> 1746147137 00002000:00010000:2.0:1746147138.693768:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147137 -> 1746147137 00002000:00010000:2.0:1746147138.693770:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:2.0:1746147138.693787:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310630656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (985us total) trans 17179874149 rc 0/0 00000100:00100000:2.0:1746147138.693792:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14275 00000100:00100000:2.0:1746147138.693801:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14276 00000100:00100000:2.0:1746147138.693805:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967310631168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147138.693841:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147138.693843:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.693845:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147138.693847:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.693848:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147138.693865:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310631168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1044us total) trans 17179874150 rc 0/0 00000100:00100000:2.0:1746147138.693870:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14276 00000100:00100000:2.0:1746147138.693879:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14277 00000100:00100000:2.0:1746147138.693882:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967310629376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.694324:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14278 00000100:00100000:0.0:1746147138.694331:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967310629888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147138.694384:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147138.694386:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147138.694388:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147138.694389:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147138.694391:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147138.694418:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310629888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (953us total) trans 21474841411 rc 0/0 00000100:00100000:0.0:1746147138.694424:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14278 00000100:00100000:0.0:1746147138.694433:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14279 00000100:00100000:0.0:1746147138.694437:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967310630400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.694486:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310630400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (1001us total) trans 21474841412 rc 0/0 00000100:00100000:0.0:1746147138.694491:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14279 00000100:00100000:0.0:1746147138.694499:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14280 00000100:00100000:0.0:1746147138.694503:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967310630912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147138.694538:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:0.0:1746147138.694540:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:0.0:1746147138.694542:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147138.694544:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147138.694545:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147138.694562:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310630912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (1057us total) trans 17179874151 rc 0/0 00000100:00100000:0.0:1746147138.694567:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14280 00000100:00100000:0.0:1746147138.694576:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14281 00000100:00100000:0.0:1746147138.694580:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967310630016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.694631:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310630016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (1099us total) trans 21474841413 rc 0/0 00000100:00100000:0.0:1746147138.694636:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14281 00000100:00100000:0.0:1746147138.694645:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14282 00000100:00100000:0.0:1746147138.694650:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967310630528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147138.694684:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147138.694687:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.694688:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147136 -> 1746147136 00002000:00010000:0.0:1746147138.694690:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.694692:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147138.694708:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310630528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (1159us total) trans 17179874152 rc 0/0 00000100:00100000:0.0:1746147138.694713:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14282 00000100:00100000:0.0:1746147138.694722:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14283 00000100:00100000:0.0:1746147138.694726:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967310631040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.694774:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310631040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (1208us total) trans 17179874153 rc 0/0 00000100:00100000:0.0:1746147138.694778:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14283 00000100:00100000:0.0:1746147138.694795:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147138.694820:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310630144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.694838:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147138.694875:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db15500/2, rc 0, transno 21474841413 00000100:00100000:0.0:1746147138.694880:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147138.694888:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397800/2, rc 0, transno 17179874152 00000100:00100000:0.0:1746147138.694895:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147138.694902:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396d80/2, rc 0, transno 17179874153 00000100:00100000:0.0:1746147138.694904:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310631040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147138.694911:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db17480/2, rc 0, transno 21474841411 00000100:00100000:0.0:1746147138.694913:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310629888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147138.694918:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db15880/2, rc 0, transno 21474841412 00000100:00100000:0.0:1746147138.694920:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147138.694925:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397100/2, rc 0, transno 17179874151 00000100:00100000:0.0:1746147138.694928:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310630912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.694937:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310629632 00000100:00100000:0.0:1746147138.694940:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310629632 00000100:00100000:0.0:1746147138.694953:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310630144 00000100:00100000:0.0:1746147138.694954:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310630144 00000100:00100000:0.0:1746147138.694962:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14284 00000100:00100000:0.0:1746147138.694966:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310629632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147138.695003:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147138.695006:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147136 -> 1746147136 00002000:00010000:0.0:1746147138.695007:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.695009:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147136 -> 1746147136 00002000:00010000:0.0:1746147138.695023:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147138.695045:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310629632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (250us total) trans 21474841414 rc 0/0 00000100:00100000:0.0:1746147138.695050:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14284 00000100:00100000:0.0:1746147138.695059:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14285 00000100:00100000:0.0:1746147138.695063:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310630144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147138.695125:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147138.695128:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147138.695129:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147138.695131:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147138.695132:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147138.695151:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310630144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (312us total) trans 21474841415 rc 0/0 00000100:00100000:0.0:1746147138.695156:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14285 00000004:00080000:0.0:1746147138.695176:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14000/2, rc 0, transno 21474841414 00000100:00100000:0.0:1746147138.695179:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310629632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147138.695186:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db15f80/2, rc 0, transno 21474841415 00000100:00100000:0.0:1746147138.695188:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310630144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.695233:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310631424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.695252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147138.695270:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310631424 00000100:00100000:0.0:1746147138.695273:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310631424 00000100:00100000:0.0:1746147138.695283:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14286 00000100:00100000:0.0:1746147138.695286:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310631424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.695339:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967310631424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (86us total) trans 17179874154 rc 0/0 00000100:00100000:0.0:1746147138.695344:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14286 00000004:00080000:0.0:1746147138.695361:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576d80/2, rc 0, transno 17179874154 00000100:00100000:0.0:1746147138.695364:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310631424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.695415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.695433:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307856768 00000100:00100000:0.0:1746147138.695435:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307856768 00000100:00100000:0.0:1746147138.695464:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15202 00000100:00100000:0.0:1746147138.695470:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:32152:x1830967307856768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.695482:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.695498:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77675 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.695543:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.695552:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.695567:0:9138:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.695579:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.695588:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.695591:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147138.695593:0:9138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.695599:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ae00, rc 0) 00000100:00100000:0.0:1746147138.695629:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:32152:x1830967307856768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 159us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.695634:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15202 00002000:00010000:2.0:1746147138.696416:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147138.696420:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:2.0:1746147138.696422:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147133 -> 1746147133 00002000:00010000:2.0:1746147138.696424:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:2.0:1746147138.696425:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147138.696459:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3764:x1830967310629376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2575us (3023us total) trans 21474841416 rc 0/0 00000100:00100000:2.0:1746147138.696465:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14277 00000004:00080000:3.0:1746147138.697483:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db17800/2, rc 0, transno 21474841409 00000100:00100000:3.0:1746147138.697489:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310629504:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147138.698232:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.698244:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.698247:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147138.698250:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147138.698257:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.698263:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00000004:00080000:3.0:1746147138.698265:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394e00/2, rc 0, transno 17179874149 00000100:00100000:3.0:1746147138.698269:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310630656:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147138.698278:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395c00/2, rc 0, transno 17179874150 00000100:00100000:3.0:1746147138.698281:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310631168:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147138.698288:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394380/2, rc 0, transno 17179874147 00000100:00100000:3.0:1746147138.698290:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310629760:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147138.698290:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147138.698299:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14a80/2, rc 0, transno 21474841410 00010000:00010000:2.0:1746147138.698301:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.698302:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310630272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147138.698309:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395f80/2, rc 0, transno 17179874148 00000100:00100000:2.0:1746147138.698311:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310631552:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147138.698312:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310631296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147138.698371:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.698382:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307854976:12345-192.168.204.25@tcp:3:cat.0 Request processed in 26886us (28925us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.698390:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3344 00002000:00100000:3.0:1746147138.698398:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f55f80 x1830967307854976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.698406:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55f80 with x1830967307854976 ext(1048576->2097151) 00002000:00010000:3.0:1746147138.698410:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55f80 00000100:00100000:1.0:1746147138.698532:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310630784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5406us (5788us total) trans 17179874155 rc 0/0 00000100:00100000:1.0:1746147138.698542:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14273 00000004:00080000:0.0:1746147138.698883:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14700/2, rc 0, transno 21474841416 00000100:00100000:0.0:1746147138.698887:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310629376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147138.699158:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397b80/2, rc 0, transno 17179874155 00000100:00100000:3.0:1746147138.699162:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310630784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.706274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.706463:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307855616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 34405us (36154us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.706473:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3345 00002000:00100000:1.0:1746147138.706483:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011db15c00 x1830967307855616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.706493:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15c00 with x1830967307855616 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.706498:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15c00 00000100:00100000:0.0:1746147138.706774:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307856896 00000100:00100000:0.0:1746147138.706781:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307856896 00000100:00100000:0.0:1746147138.706813:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15203 00000100:00100000:0.0:1746147138.706819:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32151:x1830967307856896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.706837:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.706855:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7767c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.706905:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.706916:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.706927:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147138.706930:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147138.706932:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147138.706938:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a400, rc 0) 00000100:00100000:0.0:1746147138.706965:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32151:x1830967307856896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 146us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.706970:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15203 00000100:00100000:3.0:1746147138.709287:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310631552:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.709322:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055601 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 30 pid: 16099 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147138.709343:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.709350:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.709379:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff200, rc 0) 00000100:00100000:3.0:1746147138.709415:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32150:x1830967307855488:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 39576us (40007us total) trans 8589935864 rc 0/0 00000100:00100000:3.0:1746147138.709421:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15200 00000100:00100000:2.0:1746147138.711007:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307856128:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 36481us (39636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.711026:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3347 00002000:00100000:2.0:1746147138.711037:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011db16300 x1830967307856128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.711046:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16300 with x1830967307856128 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.711051:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db16300 00000100:00100000:0.0:1746147138.718602:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307855744:12345-192.168.204.25@tcp:3:cat.0 Request processed in 45894us (47397us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147138.718616:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3346 00002000:00100000:0.0:1746147138.718628:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db17b80 x1830967307855744/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.718637:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17b80 with x1830967307855744 ext(1048576->2097151) 00002000:00010000:0.0:1746147138.718643:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17b80 00000100:00100000:2.0:1746147138.720616:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307856256:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 45671us (46240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.720626:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3348 00002000:00100000:2.0:1746147138.720635:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db14e00 x1830967307856256/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.720643:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14e00 with x1830967307856256 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.720648:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14e00 00000100:00100000:0.0:1746147138.726589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.726728:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857024 00000100:00100000:1.0:1746147138.726736:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857024 00010000:00010000:1.0:1746147138.726767:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.726800:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6221 00000100:00100000:1.0:1746147138.726807:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307857024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.726818:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.726823:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.726833:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.726849:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff200/0x3139939425055608 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77667 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.726864:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.726869:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.726876:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.726882:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.726888:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.726904:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.726943:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307857024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.726949:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6221 00010000:00010000:1.0:1746147138.727120:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.727126:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00000040:00080000:1.0:1746147138.727328:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].541, 88 off55664 00000004:00080000:1.0:1746147138.727332:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717242058ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727353:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].484, 88 off50648 00000004:00080000:1.0:1746147138.727355:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717266036ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727365:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].485, 88 off50736 00000004:00080000:1.0:1746147138.727367:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717277809ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727373:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].542, 88 off55752 00000004:00080000:1.0:1746147138.727375:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717285848ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727381:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].543, 88 off55840 00000004:00080000:1.0:1746147138.727384:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717294308ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727389:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].486, 88 off50824 00000004:00080000:1.0:1746147138.727392:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717302318ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727397:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].487, 88 off50912 00000004:00080000:1.0:1746147138.727399:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717310017ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727405:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].488, 88 off51000 00000004:00080000:1.0:1746147138.727407:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717317468ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727413:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].544, 88 off55928 00000004:00080000:1.0:1746147138.727415:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717326002ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727422:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].489, 88 off51088 00000004:00080000:1.0:1746147138.727425:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717335217ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727432:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].545, 88 off56016 00000004:00080000:1.0:1746147138.727435:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717345226ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727443:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].490, 88 off51176 00000004:00080000:1.0:1746147138.727446:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717356459ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147138.727453:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].546, 88 off56104 00000004:00080000:1.0:1746147138.727455:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717365758ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727463:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].547, 88 off56192 00000004:00080000:1.0:1746147138.727466:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717376218ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727473:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].548, 88 off56280 00000004:00080000:1.0:1746147138.727475:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717385986ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727482:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].549, 88 off56368 00000004:00080000:1.0:1746147138.727485:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676717395511ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147138.727492:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].491, 88 off51264 00000004:00080000:1.0:1746147138.727494:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676717404993ns, next at 554081490131ns, rc = 0 00000001:00080000:3.0:1746147138.733478:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935865 is committed 00000004:00080000:3.0:1746147138.733488:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 486 committed 00000004:00080000:3.0:1746147138.733509:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 542 committed 00000004:00080000:3.0:1746147138.733516:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 541 committed 00000004:00080000:3.0:1746147138.733518:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 540 committed 00000004:00080000:3.0:1746147138.733519:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 539 committed 00000004:00080000:3.0:1746147138.733521:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 485 committed 00000004:00080000:3.0:1746147138.733522:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 538 committed 00000004:00080000:3.0:1746147138.733524:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 484 committed 00000004:00080000:3.0:1746147138.733525:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 537 committed 00000004:00080000:3.0:1746147138.733527:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 483 committed 00000004:00080000:3.0:1746147138.733528:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 482 committed 00000004:00080000:3.0:1746147138.733530:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 481 committed 00000004:00080000:3.0:1746147138.733531:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 536 committed 00000004:00080000:3.0:1746147138.733532:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 535 committed 00000004:00080000:3.0:1746147138.733534:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 480 committed 00000004:00080000:3.0:1746147138.733536:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 479 committed 00000004:00080000:3.0:1746147138.733538:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 534 committed 00010000:00010000:3.0:1746147138.733600:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733612:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.733614:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147138.733618:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733626:0:7238:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733633:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733639:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733646:0:7238:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733651:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.733685:0:7238:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.733697:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310631680:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.733793:0:7238:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.733801:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310631808:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.733819:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147138.734055:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.734116:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.734134:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.734147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.734161:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147138.734165:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.734177:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.734187:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147138.734198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147138.734217:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632064 00000100:00100000:1.0:1746147138.734223:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632064 00000100:00100000:1.0:1746147138.734250:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632576 00000100:00100000:1.0:1746147138.734252:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632576 00000100:00100000:1.0:1746147138.734260:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632192 00000100:00100000:1.0:1746147138.734261:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632192 00000100:00100000:1.0:1746147138.734269:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632704 00000100:00100000:1.0:1746147138.734271:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632704 00000100:00100000:1.0:1746147138.734282:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14287 00000100:00100000:1.0:1746147138.734289:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967310632064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147138.734389:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147138.734393:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147138.734395:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:1.0:1746147138.734397:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147133 -> 1746147133 00002000:00010000:1.0:1746147138.734398:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147138.734425:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967310632064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (309us total) trans 21474841417 rc 0/0 00000100:00100000:1.0:1746147138.734431:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14287 00000100:00100000:1.0:1746147138.734446:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14288 00000100:00100000:1.0:1746147138.734450:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967310632576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147138.734491:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147138.734494:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147138.734495:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147138.734496:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147138.734498:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147138.734514:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967310632576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (366us total) trans 21474841418 rc 0/0 00000100:00100000:1.0:1746147138.734518:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14288 00000100:00100000:1.0:1746147138.734527:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14289 00000100:00100000:1.0:1746147138.734530:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967310632192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147138.734566:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147138.734568:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147136 -> 1746147136 00002000:00010000:1.0:1746147138.734569:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147137 -> 1746147137 00002000:00010000:1.0:1746147138.734571:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147136 -> 1746147136 00002000:00010000:1.0:1746147138.734573:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147138.734634:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14290 00000100:00100000:2.0:1746147138.734641:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967310632704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.734712:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3766:x1830967310632704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (512us total) trans 21474841420 rc 0/0 00000100:00100000:2.0:1746147138.734717:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14290 00000100:00100000:2.0:1746147138.734765:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310632320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.734783:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.734794:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310632832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.734809:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.734820:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147138.734824:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310631936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.734837:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.734846:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310632448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.734860:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147138.734876:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632320 00000100:00100000:2.0:1746147138.734878:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632320 00000100:00100000:2.0:1746147138.734891:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632832 00000100:00100000:2.0:1746147138.734893:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632832 00000100:00100000:2.0:1746147138.734900:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310631936 00000100:00100000:2.0:1746147138.734902:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310631936 00000100:00100000:2.0:1746147138.734909:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632448 00000100:00100000:2.0:1746147138.734910:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632448 00000100:00100000:2.0:1746147138.734920:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14291 00000100:00100000:2.0:1746147138.734924:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967310632320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147138.734967:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147138.734969:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.734970:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147138.734972:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.734973:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147138.734994:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967310632320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (210us total) trans 21474841421 rc 0/0 00000100:00100000:2.0:1746147138.734999:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14291 00000100:00100000:2.0:1746147138.735024:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14292 00000100:00100000:2.0:1746147138.735029:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967310632832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.735082:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967310632832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (271us total) trans 21474841422 rc 0/0 00000100:00100000:2.0:1746147138.735087:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14292 00000100:00100000:2.0:1746147138.735114:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14293 00000100:00100000:2.0:1746147138.735118:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967310631936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147138.735154:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147138.735157:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:2.0:1746147138.735159:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147133 -> 1746147133 00002000:00010000:2.0:1746147138.735161:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:2.0:1746147138.735163:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147138.735180:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967310631936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (342us total) trans 21474841423 rc 0/0 00000100:00100000:2.0:1746147138.735184:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14293 00000100:00100000:2.0:1746147138.735193:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14294 00000100:00100000:2.0:1746147138.735196:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967310632448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147138.735242:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967310632448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (381us total) trans 21474841424 rc 0/0 00000100:00100000:2.0:1746147138.735247:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14294 00000004:00080000:2.0:1746147138.735283:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394a80/2, rc 0, transno 21474841423 00000100:00100000:2.0:1746147138.735288:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310631936:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147138.735294:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f56300/2, rc 0, transno 21474841424 00000100:00100000:2.0:1746147138.735297:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310632448:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147138.735303:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f55180/2, rc 0, transno 21474841421 00000100:00100000:2.0:1746147138.735305:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310632320:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147138.735311:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6a00/2, rc 0, transno 21474841422 00000100:00100000:2.0:1746147138.735313:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310632832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.736600:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.736634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147138.736651:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.736662:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147138.736683:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db16d80/2, rc 0, transno 21474841420 00000100:00100000:0.0:1746147138.736686:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147138.736695:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396a00/2, rc 0, transno 21474841417 00000100:00100000:0.0:1746147138.736697:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147138.736703:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f57100/2, rc 0, transno 21474841418 00000100:00100000:0.0:1746147138.736705:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147138.736712:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147138.736715:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.736727:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147138.736735:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.736746:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147138.736763:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633088 00000100:00100000:0.0:1746147138.736766:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633088 00000100:00100000:0.0:1746147138.736787:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633600 00000100:00100000:0.0:1746147138.736788:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633600 00000100:00100000:0.0:1746147138.736796:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633216 00000100:00100000:0.0:1746147138.736797:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633216 00000100:00100000:0.0:1746147138.736805:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633728 00000100:00100000:0.0:1746147138.736807:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633728 00000100:00100000:0.0:1746147138.736817:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14295 00000100:00100000:0.0:1746147138.736821:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3766:x1830967310633088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147138.736911:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147138.736914:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.736916:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147136 -> 1746147136 00002000:00010000:0.0:1746147138.736918:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.736919:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147138.736943:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310633088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (308us total) trans 17179874156 rc 0/0 00000100:00100000:0.0:1746147138.736948:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14295 00000100:00100000:0.0:1746147138.736957:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14296 00000100:00100000:0.0:1746147138.736961:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3766:x1830967310633600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.737021:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310633600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (348us total) trans 17179874157 rc 0/0 00000100:00100000:0.0:1746147138.737025:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14296 00000100:00100000:0.0:1746147138.737035:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14297 00000100:00100000:0.0:1746147138.737039:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3766:x1830967310633216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147138.737072:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147138.737075:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.737076:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.737078:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147138.737080:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147138.737112:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310633216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (384us total) trans 17179874158 rc 0/0 00000100:00100000:0.0:1746147138.737116:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14297 00000100:00100000:0.0:1746147138.737125:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14298 00000100:00100000:0.0:1746147138.737128:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3766:x1830967310633728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147138.737163:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147138.737165:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147138.737167:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147138.737169:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000100:00100000:1.0:1746147138.737214:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967310632192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2681us (3034us total) trans 21474841419 rc 0/0 00000100:00100000:1.0:1746147138.737219:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14289 00000100:00100000:3.0:1746147138.737420:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310632960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.737442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147138.737455:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.737466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147138.737477:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147138.737480:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.737491:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147138.737498:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.737508:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147138.737521:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310632960 00000100:00100000:3.0:1746147138.737523:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310632960 00000100:00100000:3.0:1746147138.737536:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633472 00000100:00100000:3.0:1746147138.737537:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633472 00000100:00100000:3.0:1746147138.737547:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633344 00000100:00100000:3.0:1746147138.737549:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633344 00000100:00100000:3.0:1746147138.737554:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633856 00000100:00100000:3.0:1746147138.737555:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633856 00000100:00100000:3.0:1746147138.737562:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14299 00000100:00100000:3.0:1746147138.737566:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310632960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147138.737610:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147138.737612:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:3.0:1746147138.737614:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147134 -> 1746147134 00002000:00010000:3.0:1746147138.737616:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:3.0:1746147138.737624:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:3.0:1746147138.737644:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310632960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (202us total) trans 17179874160 rc 0/0 00000100:00100000:3.0:1746147138.737650:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14299 00000100:00100000:3.0:1746147138.737659:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14300 00000100:00100000:3.0:1746147138.737663:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310633472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147138.737695:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:3.0:1746147138.737697:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:3.0:1746147138.737699:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147138.737701:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746147138.737702:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:3.0:1746147138.737716:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310633472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (250us total) trans 17179874161 rc 0/0 00000100:00100000:3.0:1746147138.737720:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14300 00000100:00100000:3.0:1746147138.737727:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14301 00000100:00100000:3.0:1746147138.737730:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310633344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.737777:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310633344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (285us total) trans 17179874162 rc 0/0 00000100:00100000:2.0:1746147138.737777:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14302 00000100:00100000:3.0:1746147138.737782:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14301 00000100:00100000:2.0:1746147138.737786:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310633856:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147138.737803:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575180/2, rc 0, transno 17179874162 00000100:00100000:3.0:1746147138.737810:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633344:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147138.737816:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575880/2, rc 0, transno 17179874160 00000100:00100000:3.0:1746147138.737819:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310632960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147138.737823:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577100/2, rc 0, transno 17179874161 00000100:00100000:3.0:1746147138.737826:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633472:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147138.737834:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:2.0:1746147138.737837:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.737838:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147138.737840:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147138.737842:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:2.0:1746147138.737870:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310633856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (360us total) trans 17179874163 rc 0/0 00000100:00100000:2.0:1746147138.737876:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14302 00002000:00010000:0.0:1746147138.738232:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147138.738256:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3766:x1830967310633728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1126us (1507us total) trans 17179874159 rc 0/0 00000100:00100000:0.0:1746147138.738261:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14298 00000004:00080000:0.0:1746147138.738290:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5574700/2, rc 0, transno 17179874158 00000100:00100000:0.0:1746147138.738293:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147138.738300:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094526a00/2, rc 0, transno 17179874159 00000100:00100000:0.0:1746147138.738303:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147138.738308:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576a00/2, rc 0, transno 17179874156 00000100:00100000:0.0:1746147138.738311:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147138.738316:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575500/2, rc 0, transno 17179874157 00000100:00100000:0.0:1746147138.738318:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310633600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147138.738326:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099157100/2, rc 0, transno 21474841419 00000100:00100000:0.0:1746147138.738329:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310632192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147138.738486:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.738507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147138.738524:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524000/2, rc 0, transno 17179874163 00000100:00100000:3.0:1746147138.738527:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147138.738653:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.738669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.738741:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857152 00000100:00100000:2.0:1746147138.738745:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857152 00000100:00100000:2.0:1746147138.738770:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5418 00000100:00100000:2.0:1746147138.738775:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32151:x1830967307857152:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:3.0:1746147138.738796:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310631680:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.738805:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310631808:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.738831:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x313993942505560f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 11 pid: 7238 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746147138.738848:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32151:x1830967307857152:12345-192.168.204.25@tcp:49:cat.0 Request processed in 72us (196us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147138.738850:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.738853:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5418 00010000:00010000:3.0:1746147138.738867:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715e00, rc 0) 00000100:00100000:3.0:1746147138.738888:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32148:x1830967307856512:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 63497us (63746us total) trans 8589935865 rc 0/0 00000100:00100000:3.0:1746147138.738894:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15201 00000100:00100000:2.0:1746147138.738903:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857280 00000100:00100000:2.0:1746147138.738906:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857280 00000100:00100000:2.0:1746147138.738921:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15204 00000100:00100000:2.0:1746147138.738926:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32150:x1830967307857280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147138.738934:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.738944:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x313993942505562b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77683 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.738974:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x313993942505562b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77683 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.738985:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x313993942505562b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77683 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.738994:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.738997:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147138.739000:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79bc00, rc 0) 00000100:00100000:2.0:1746147138.739028:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32150:x1830967307857280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 100us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.739033:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15204 00000100:00100000:0.0:1746147138.739270:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310633984 00000100:00100000:0.0:1746147138.739274:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310633984 00000100:00100000:0.0:1746147138.739305:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14303 00000100:00100000:0.0:1746147138.739310:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310633984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147138.740063:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310633984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 750us (1553us total) trans 17179874164 rc 0/0 00000100:00100000:0.0:1746147138.740071:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14303 00000004:00080000:2.0:1746147138.740157:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8700/2, rc 0, transno 17179874164 00000100:00100000:2.0:1746147138.740161:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310633984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147138.740261:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.740536:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857408 00000100:00100000:2.0:1746147138.740540:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857408 00000100:00100000:2.0:1746147138.740575:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5419 00000100:00100000:2.0:1746147138.740581:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:32152:x1830967307857408:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:2.0:1746147138.740981:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:32152:x1830967307857408:12345-192.168.204.25@tcp:49:cat.0 Request processed in 399us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.740987:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5419 00000100:00100000:0.0:1746147138.742435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.742962:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857664 00000100:00100000:2.0:1746147138.742968:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857664 00000100:00100000:2.0:1746147138.742996:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5420 00000100:00100000:2.0:1746147138.743002:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32150:x1830967307857664:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:2.0:1746147138.743112:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32150:x1830967307857664:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 109us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.743120:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5420 00000100:00100000:0.0:1746147138.744456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.744490:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.744543:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857792 00000100:00100000:2.0:1746147138.744547:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857792 00000100:00100000:2.0:1746147138.744570:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5421 00000100:00100000:2.0:1746147138.744576:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32148:x1830967307857792:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:2.0:1746147138.744646:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32148:x1830967307857792:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.744651:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5421 00000100:00100000:3.0:1746147138.744917:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857536 00000100:00100000:3.0:1746147138.744921:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857536 00000100:00100000:1.0:1746147138.745299:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 796 00000100:00100000:1.0:1746147138.745305:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307857536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.745314:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.745333:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x313993942505562b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77683 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.745351:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.745354:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.745371:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307857536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.745376:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 796 00000100:00100000:0.0:1746147138.750641:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.750734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.750829:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307857920 00000100:00100000:2.0:1746147138.750837:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307857920 00000100:00100000:2.0:1746147138.750877:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307858048 00000100:00100000:2.0:1746147138.750880:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307858048 00000100:00100000:2.0:1746147138.750906:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14304 00000100:00100000:2.0:1746147138.750913:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32150:x1830967307857920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147138.750928:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.750947:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7768a expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.750955:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14305 00000100:00100000:1.0:1746147138.750964:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:32148:x1830967307858048:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147138.750971:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.750972:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.750979:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.750980:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77691 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.750986:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.751389:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.751392:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.751396:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2752512->2879487] (req 2752512->2879487) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.751406:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.751409:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.751413:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3084288->3145727] (req 3084288->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.751424:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3084288->3145727] (req 3084288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.751433:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa800, rc 0) 00000100:00100000:1.0:1746147138.751488:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:32148:x1830967307858048:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 525us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.751494:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14305 00010000:00010000:2.0:1746147138.751508:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.751558:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 29 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.751572:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310634112:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.751945:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.751955:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 8 pid: 17600 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.751963:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310634240:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.751992:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.752000:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 11 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.752023:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310634368:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.752040:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.754926:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.755136:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310634240:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.755144:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310634368:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147138.755564:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307858176 00000100:00100000:3.0:1746147138.755570:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307858176 00010000:00010000:3.0:1746147138.755595:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 9 pid: 17600 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.755623:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.755663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.755664:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307858304 00000100:00100000:1.0:1746147138.755668:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307858304 00000100:00100000:0.0:1746147138.755676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147138.755683:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 12 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.755690:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307858688 00000100:00100000:0.0:1746147138.755693:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307858688 00000100:00100000:2.0:1746147138.755703:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310634112:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147138.755706:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6222 00010000:00010000:0.0:1746147138.755707:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746147138.755712:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307858304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.755722:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147138.755724:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6223 00010000:00010000:2.0:1746147138.755726:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [2752512->2879487] (req 2752512->2879487) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.755729:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307858688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.755735:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147138.755737:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348000, rc 0) 00010000:00010000:1.0:1746147138.755740:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 12 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.755744:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746147138.755748:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 12 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.755763:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.755778:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32150:x1830967307857920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4867us (5145us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147138.755780:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x31399394250555bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77628 expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.755784:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14304 00010000:00010000:0.0:1746147138.755798:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147138.755805:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307858560 00000100:00100000:2.0:1746147138.755808:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307858560 00000100:00100000:0.0:1746147138.755815:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307858688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.755820:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6223 00002000:00100000:2.0:1746147138.755827:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a897f480 x1830967307858560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.755835:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f480 with x1830967307858560 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.755839:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897f480 00000100:00100000:0.0:1746147138.755847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.755935:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307858944 00000100:00100000:2.0:1746147138.755938:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307858944 00000100:00100000:2.0:1746147138.755951:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3349 00000100:00100000:2.0:1746147138.755956:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307858560:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:1.0:1746147138.756021:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x31399394250554f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775e2 expref: 12 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746147138.756132:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.756185:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.756196:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307859200 00000100:00100000:0.0:1746147138.756199:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307859200 00002000:00100000:0.0:1746147138.756413:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a897dc00 x1830967307859200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.756421:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897dc00 with x1830967307859200 ext(1048576->2097151) 00002000:00010000:0.0:1746147138.756424:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897dc00 00000100:00100000:0.0:1746147138.756439:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3350 00000100:00100000:0.0:1746147138.756445:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307859200:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147138.756514:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307858304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 800us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.756520:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6222 00000100:00100000:3.0:1746147138.756761:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6224 00000100:00100000:3.0:1746147138.756767:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307858176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.756774:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.756781:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 9 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.756790:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 9 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.756802:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff400/0x31399394250555de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7764b expref: 9 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.756814:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.756816:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.756822:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.756828:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.756834:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.756835:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.756838:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 8 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.756853:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 8 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.757546:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 8 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.757563:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310634496:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.757614:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.757621:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310634624:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.757639:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.757660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:3.0:1746147138.757677:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a897e300 x1830967307858944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.757684:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897e300 with x1830967307858944 ext(1048576->2097151) 00002000:00010000:3.0:1746147138.757688:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897e300 00000100:00100000:0.0:1746147138.757690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.758126:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307859584 00000100:00100000:3.0:1746147138.758131:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307859712 00000100:00100000:1.0:1746147138.758131:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307859584 00000100:00100000:3.0:1746147138.758135:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307859712 00002000:00100000:1.0:1746147138.758147:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a897e680 x1830967307859584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.758150:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a897d180 x1830967307859712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.758154:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897e680 with x1830967307859584 ext(1048576->2097151) 00002000:00100000:3.0:1746147138.758157:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d180 with x1830967307859712 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.758158:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897e680 00002000:00010000:3.0:1746147138.758160:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897d180 00000100:00100000:1.0:1746147138.758187:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3351 00000100:00100000:1.0:1746147138.758192:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307858944:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147138.758530:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3352 00000100:00100000:3.0:1746147138.758536:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307859584:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147138.758897:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.758913:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307859968 00000100:00100000:0.0:1746147138.758916:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307859968 00002000:00100000:0.0:1746147138.758933:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a897d500 x1830967307859968/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.758941:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d500 with x1830967307859968 ext(1048576->2097151) 00002000:00010000:0.0:1746147138.758944:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897d500 00000100:00100000:0.0:1746147138.758956:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3353 00000100:00100000:0.0:1746147138.758963:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307859712:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147138.758991:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3354 00000100:00100000:0.0:1746147138.758996:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307859968:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147138.766875:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.766932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.766998:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307860352 00000100:00100000:2.0:1746147138.767005:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307860352 00002000:00100000:2.0:1746147138.767046:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2875392->2879487) req@ffff8800a897c700 x1830967307860352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.767055:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c700 with x1830967307860352 ext(2875392->2879487) 00002000:00010000:2.0:1746147138.767060:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897c700 00000100:00100000:2.0:1746147138.767073:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307860480 00000100:00100000:2.0:1746147138.767076:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307860480 00002000:00100000:2.0:1746147138.767085:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3084288->3088383) req@ffff8800a897ea00 x1830967307860480/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.767109:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ea00 with x1830967307860480 ext(3084288->3088383) 00002000:00010000:2.0:1746147138.767112:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897ea00 00000100:00100000:2.0:1746147138.767129:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3355 00000100:00100000:2.0:1746147138.767136:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307860352:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147138.767241:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307860352:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 105us (371us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147138.767247:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3355 00002000:00100000:2.0:1746147138.767252:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2875392->2879487) req@ffff8800a897c700 x1830967307860352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/4536 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.767257:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c700 with x1830967307860352 ext(2875392->2879487) 00002000:00010000:2.0:1746147138.767259:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897c700 00000100:00100000:2.0:1746147138.767272:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3356 00000100:00100000:2.0:1746147138.767276:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307860480:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147138.767315:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307860480:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 38us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147138.767319:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3356 00002000:00100000:2.0:1746147138.767323:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3084288->3088383) req@ffff8800a897ea00 x1830967307860480/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/4536 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.767329:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ea00 with x1830967307860480 ext(3084288->3088383) 00002000:00010000:2.0:1746147138.767332:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897ea00 00000100:00100000:1.0:1746147138.767469:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307859200:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11023us (11283us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.767475:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3350 00002000:00100000:1.0:1746147138.767480:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a897dc00 x1830967307859200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.767487:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897dc00 with x1830967307859200 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.767490:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897dc00 00000100:00100000:3.0:1746147138.767551:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310634496:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147138.767576:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310634624:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147138.767592:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147138.767608:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307858176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10842us (12691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.767615:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6224 00000100:00100000:3.0:1746147138.771966:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307858560:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15999us (16292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.771979:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3349 00002000:00100000:3.0:1746147138.771991:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a897f480 x1830967307858560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.772000:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f480 with x1830967307858560 ext(1048576->2097151) 00002000:00010000:3.0:1746147138.772005:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897f480 00000100:00100000:2.0:1746147138.778401:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307859584:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 19857us (20733us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.778413:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3352 00002000:00100000:2.0:1746147138.778422:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a897e680 x1830967307859584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.778431:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897e680 with x1830967307859584 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.778436:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897e680 00000100:00100000:2.0:1746147138.783180:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307859968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 24175us (24275us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.783190:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3354 00002000:00100000:2.0:1746147138.783200:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a897d500 x1830967307859968/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.783209:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d500 with x1830967307859968 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.783214:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897d500 00000100:00100000:2.0:1746147138.789717:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307859712:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 30744us (32016us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.789729:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3353 00002000:00100000:2.0:1746147138.789741:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a897d180 x1830967307859712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.789749:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d180 with x1830967307859712 ext(1048576->2097151) 00002000:00010000:2.0:1746147138.789754:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897d180 00000100:00100000:1.0:1746147138.793320:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307858944:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 35119us (37463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.793330:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3351 00002000:00100000:1.0:1746147138.793339:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a897e300 x1830967307858944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.793348:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897e300 with x1830967307858944 ext(1048576->2097151) 00002000:00010000:1.0:1746147138.793353:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897e300 00000100:00100000:0.0:1746147138.794291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.798398:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307860608 00000100:00100000:2.0:1746147138.798408:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307860608 00000100:00100000:2.0:1746147138.798470:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14306 00000100:00100000:2.0:1746147138.798476:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+18:32148:x1830967307860608:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147138.798491:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.798507:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77698 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.798530:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.798536:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.798542:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 34 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.798547:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.798549:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.798551:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.798576:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 34 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.798585:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 34 pid: 10340 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.798594:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310634752:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.798690:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.798697:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.798704:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310634880:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.798723:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.798735:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 12 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.798748:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310635008:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.798761:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.799251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.799636:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307860736 00000100:00100000:1.0:1746147138.799641:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307860736 00000100:00100000:1.0:1746147138.800594:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14307 00000100:00100000:1.0:1746147138.800601:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307860736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147138.800613:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147138.800626:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425055647 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7769f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147138.800659:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310635136:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147138.801267:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.803347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.803475:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310634752:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.803484:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310634880:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.803491:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310635008:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.803518:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.803532:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348400, rc 0) 00002000:00010000:1.0:1746147138.803557:0:17600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147136 -> 1746147138 00002000:00010000:1.0:1746147138.803560:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147137 -> 1746147138 00002000:00010000:1.0:1746147138.803562:0:17600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147136 -> 1746147138 00000100:00100000:2.0:1746147138.803572:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+19:32148:x1830967307860608:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5095us (9284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.803575:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310635136:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147138.803579:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14306 00010000:00010000:1.0:1746147138.803594:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425055647 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7769f expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.803602:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425055647 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7769f expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.803613:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa000, rc 0) 00000100:00100000:1.0:1746147138.803629:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307860736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3029us (4380us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147138.803633:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14307 00000100:00100000:3.0:1746147138.803841:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307860864 00000100:00100000:3.0:1746147138.803847:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307860864 00010000:00010000:3.0:1746147138.803872:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 35 pid: 10340 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746147138.803891:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6225 00000100:00100000:3.0:1746147138.803897:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307860864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.803908:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.803918:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 35 pid: 10340 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.803928:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 35 pid: 10340 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.803942:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099149a00/0x31399394250555ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77621 expref: 35 pid: 10340 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.803955:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.803984:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307860864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.803990:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6225 00000100:00100000:0.0:1746147138.807317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.807455:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307861248 00000100:00100000:0.0:1746147138.807458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.807462:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307861248 00002000:00100000:1.0:1746147138.807500:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097095180 x1830967307861248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.807509:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095180 with x1830967307861248 ext(2097152->3145727) 00010000:00010000:1.0:1746147138.807517:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746147138.807526:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00002000:00010000:1.0:1746147138.807533:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097095180 00000100:00100000:0.0:1746147138.807890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.807915:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307861376 00000100:00100000:0.0:1746147138.807917:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307861376 00000100:00100000:2.0:1746147138.807961:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307860992 00000100:00100000:2.0:1746147138.807964:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307860992 00010000:00010000:2.0:1746147138.807976:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 13 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.808004:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14308 00000100:00100000:0.0:1746147138.808022:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32151:x1830967307861376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147138.808033:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.808046:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776a6 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.808063:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.808065:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.808070:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.808080:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.808112:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42c00, rc 0) 00000100:00100000:0.0:1746147138.808149:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32151:x1830967307861376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 138us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.808154:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14308 00000100:00100000:1.0:1746147138.808160:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1063 00000100:00100000:1.0:1746147138.808167:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967307861248:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147138.808345:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6226 00000100:00100000:2.0:1746147138.808351:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307860992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147138.808358:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147138.808369:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 13 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.808382:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 13 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.808395:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250554db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775db expref: 13 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.808408:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147138.808424:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307860992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.808429:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6226 00000100:00100000:0.0:1746147138.815331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.815853:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.816043:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307861632 00000100:00100000:3.0:1746147138.816051:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307861632 00002000:00100000:3.0:1746147138.816108:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097095880 x1830967307861632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.816118:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095880 with x1830967307861632 ext(2097152->3145727) 00002000:00010000:3.0:1746147138.816124:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097095880 00000100:00100000:3.0:1746147138.816139:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307861888 00000100:00100000:3.0:1746147138.816141:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307861888 00002000:00100000:3.0:1746147138.816154:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3084287) req@ffff880097094e00 x1830967307861888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 504/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.816160:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094e00 with x1830967307861888 ext(2097152->3084287) 00002000:00010000:3.0:1746147138.816163:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097094e00 00000100:00100000:3.0:1746147138.816174:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3357 00000100:00100000:3.0:1746147138.816180:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307861632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147138.816620:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3358 00000100:00100000:0.0:1746147138.816628:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307861888:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147138.816951:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967307861248:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8783us (9640us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.816958:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1063 00002000:00100000:1.0:1746147138.816963:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097095180 x1830967307861248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.816971:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095180 with x1830967307861248 ext(2097152->3145727) 00010000:00010000:1.0:1746147138.816977:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746147138.816990:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00002000:00010000:1.0:1746147138.816996:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097095180 00000100:00100000:3.0:1746147138.826778:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307861632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10589us (11445us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.826790:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3357 00002000:00100000:3.0:1746147138.826800:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097095880 x1830967307861632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.826813:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095880 with x1830967307861632 ext(2097152->3145727) 00002000:00010000:3.0:1746147138.826818:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097095880 00000100:00100000:2.0:1746147138.827617:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307861888:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10988us (11761us total) trans 0 rc 860160/860160 00000100:00100000:2.0:1746147138.827624:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3358 00002000:00100000:2.0:1746147138.827629:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3084287) req@ffff880097094e00 x1830967307861888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 504/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.827636:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094e00 with x1830967307861888 ext(2097152->3084287) 00002000:00010000:2.0:1746147138.827640:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097094e00 00000100:00100000:0.0:1746147138.831258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.831312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.831389:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862144 00000100:00100000:3.0:1746147138.831397:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862144 00010000:00010000:3.0:1746147138.831425:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746147138.831448:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6227 00000100:00100000:3.0:1746147138.831455:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967307862144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.831465:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.831479:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.831494:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.831512:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x31399394250555d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77644 expref: 19 pid: 9586 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.831613:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862016 00000100:00100000:2.0:1746147138.831617:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862016 00000100:00100000:2.0:1746147138.831985:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14309 00000100:00100000:2.0:1746147138.831991:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+8:32152:x1830967307862016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147138.832006:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.832029:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776ad expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.832051:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.832057:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.832063:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147138.832064:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147138.832067:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 5/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.832115:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.832124:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.832134:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310635264:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.832244:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.832246:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.832251:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 18 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.832258:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 18 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.832277:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 18 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.832285:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310635392:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147138.832900:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.832908:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 27 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.832916:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310635520:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.832938:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.832975:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.833335:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.833421:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862272 00000100:00100000:2.0:1746147138.833426:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862272 00000100:00100000:2.0:1746147138.833455:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14310 00000100:00100000:2.0:1746147138.833461:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32151:x1830967307862272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147138.833469:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.833478:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776b4 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.833490:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147138.833493:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.833501:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.833507:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099055a00, rc 0) 00000100:00100000:2.0:1746147138.833793:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32151:x1830967307862272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 331us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.833799:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14310 00000100:00100000:3.0:1746147138.834556:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310635392:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.834569:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.834592:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307862144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3138us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.834600:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6227 00000100:00100000:2.0:1746147138.834689:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310635264:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.834697:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310635520:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.834712:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.834723:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04800, rc 0) 00000100:00100000:2.0:1746147138.834740:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+9:32152:x1830967307862016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2749us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.834746:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14309 00000100:00100000:0.0:1746147138.836758:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.836792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.836850:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862528 00000100:00100000:3.0:1746147138.836856:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862528 00002000:00100000:3.0:1746147138.836891:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3084288->3145727) req@ffff880097094000 x1830967307862528/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147138.836927:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862400 00000100:00100000:2.0:1746147138.836930:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862400 00002000:00100000:2.0:1746147138.836945:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2752512->2879487) req@ffff880097096a00 x1830967307862400/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.836952:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096a00 with x1830967307862400 ext(2752512->2879487) 00010000:00010000:2.0:1746147138.836958:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 29 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.836968:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 29 pid: 12201 timeout: 776 lvb_type: 0 00002000:00100000:3.0:1746147138.836983:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094000 with x1830967307862528 ext(3084288->3145727) 00010000:00010000:3.0:1746147138.836988:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.836994:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 9 pid: 17600 timeout: 776 lvb_type: 0 00002000:00010000:3.0:1746147138.836999:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097094000 00000100:00100000:3.0:1746147138.837022:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1064 00000100:00100000:3.0:1746147138.837028:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307862528:12345-192.168.204.25@tcp:4:cat.0 00002000:00010000:2.0:1746147138.837401:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097096a00 00000100:00100000:2.0:1746147138.837415:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1065 00000100:00100000:2.0:1746147138.837420:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307862400:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147138.838139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.838226:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862784 00000100:00100000:2.0:1746147138.838230:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862784 00002000:00100000:2.0:1746147138.838250:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3461120->3465215) req@ffff880097094a80 x1830967307862784/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.838257:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094a80 with x1830967307862784 ext(3461120->3465215) 00002000:00010000:2.0:1746147138.838261:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094a80 00000100:00100000:2.0:1746147138.838273:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3359 00000100:00100000:2.0:1746147138.838279:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307862784:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147138.838369:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307862784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 89us (230us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147138.838374:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3359 00002000:00100000:2.0:1746147138.838380:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3461120->3465215) req@ffff880097094a80 x1830967307862784/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/4536 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.838386:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094a80 with x1830967307862784 ext(3461120->3465215) 00002000:00010000:2.0:1746147138.838389:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094a80 00000100:00100000:3.0:1746147138.839654:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307862528:12345-192.168.204.25@tcp:4:cat.0 Request processed in 2622us (2897us total) trans 21474841425 rc 0/0 00000100:00100000:3.0:1746147138.839661:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1064 00002000:00100000:3.0:1746147138.839667:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3084288->3145727) req@ffff880097094000 x1830967307862528/t21474841425(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/448 e 0 to 0 dl 1746147149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.839675:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094000 with x1830967307862528 ext(3084288->3145727) 00010000:00010000:3.0:1746147138.839682:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 11 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.839698:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 11 pid: 17600 timeout: 776 lvb_type: 0 00002000:00010000:3.0:1746147138.839704:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097094000 00000100:00100000:2.0:1746147138.840610:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307862400:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3187us (3814us total) trans 21474841426 rc 0/0 00000100:00100000:2.0:1746147138.840618:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1065 00002000:00100000:2.0:1746147138.840624:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2752512->2879487) req@ffff880097096a00 x1830967307862400/t21474841426(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/448 e 0 to 0 dl 1746147149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.840630:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096a00 with x1830967307862400 ext(2752512->2879487) 00010000:00010000:2.0:1746147138.840636:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 31 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.840644:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 31 pid: 12201 timeout: 776 lvb_type: 0 00002000:00010000:2.0:1746147138.840650:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097096a00 00000100:00100000:0.0:1746147138.843247:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.843289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.843447:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307863040 00000100:00100000:1.0:1746147138.843447:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307862912 00000100:00100000:3.0:1746147138.843454:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307863040 00000100:00100000:1.0:1746147138.843454:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307862912 00010000:00010000:1.0:1746147138.843490:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 31 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.843524:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6228 00000100:00100000:1.0:1746147138.843531:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307862912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.843539:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 11 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.843542:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147138.843555:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6229 00010000:00010000:1.0:1746147138.843559:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 31 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.843560:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307863040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.843565:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.843568:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 31 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.843635:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 11 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.843646:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425055632 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3084287] (req 2752512->2879487) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7768a expref: 31 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.843647:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 11 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.843656:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055639 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3084288->18446744073709551615] (req 3084288->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77691 expref: 11 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.843679:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.843681:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.843793:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.843805:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.843812:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.843813:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.843816:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 30 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.843822:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 30 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.843828:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147138.843848:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 30 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.843858:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310635648:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147138.843866:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307862912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 336us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.843871:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6228 00010000:00010000:3.0:1746147138.843914:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.843922:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310635776:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.843937:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.849725:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310635648:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.849739:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310635776:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.849762:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.849786:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.849810:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307863040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6249us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.849822:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6229 00000100:00100000:2.0:1746147138.850695:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307863296 00000100:00100000:2.0:1746147138.850702:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307863296 00002000:00100000:2.0:1746147138.850736:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880097096d80 x1830967307863296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.850744:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096d80 with x1830967307863296 ext(2097152->3145727) 00002000:00010000:2.0:1746147138.850749:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097096d80 00000100:00100000:2.0:1746147138.850786:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3360 00000100:00100000:2.0:1746147138.850793:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307863296:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147138.859185:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307863296:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8383us (9391us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.859197:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3360 00002000:00100000:2.0:1746147138.859206:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880097096d80 x1830967307863296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.859214:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096d80 with x1830967307863296 ext(2097152->3145727) 00002000:00010000:2.0:1746147138.859219:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097096d80 00000100:00100000:1.0:1746147138.859452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.859522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.859677:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307863680 00000100:00100000:2.0:1746147138.859684:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307863680 00002000:00100000:2.0:1746147138.859712:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3465216->4194303) req@ffff8800984d4e00 x1830967307863680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.859719:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4e00 with x1830967307863680 ext(3465216->4194303) 00002000:00010000:2.0:1746147138.859723:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d4e00 00000100:00100000:2.0:1746147138.859732:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307863808 00000100:00100000:2.0:1746147138.859734:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307863808 00002000:00100000:2.0:1746147138.859744:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800984d5f80 x1830967307863808/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.859750:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5f80 with x1830967307863808 ext(2097152->4194303) 00002000:00010000:2.0:1746147138.859753:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5f80 00000100:00100000:2.0:1746147138.859762:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3361 00000100:00100000:2.0:1746147138.859767:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307863680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147138.860257:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3362 00000100:00100000:1.0:1746147138.860265:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307863808:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147138.865524:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307863680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5746us (6063us total) trans 0 rc 729088/729088 00000100:00100000:2.0:1746147138.865535:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3361 00002000:00100000:2.0:1746147138.865545:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3465216->4194303) req@ffff8800984d4e00 x1830967307863680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 729088/729088 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.865554:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4e00 with x1830967307863680 ext(3465216->4194303) 00002000:00010000:2.0:1746147138.865560:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d4e00 00000100:00100000:0.0:1746147138.875288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.875495:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307863936 00000100:00100000:2.0:1746147138.875504:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307863936 00000100:00100000:2.0:1746147138.875544:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14311 00000100:00100000:2.0:1746147138.875552:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32151:x1830967307863936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147138.875568:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.875587:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776bb expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.875612:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.875620:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147138.875622:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147138.875625:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.875649:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.875664:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 17 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.875675:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310635904:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.875766:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147138.877254:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307863808:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16985us (17726us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147138.877263:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3362 00002000:00100000:1.0:1746147138.877273:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800984d5f80 x1830967307863808/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.877282:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5f80 with x1830967307863808 ext(2097152->4194303) 00002000:00010000:1.0:1746147138.877286:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5f80 00000100:00100000:0.0:1746147138.882360:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.882509:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310635904:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.882537:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.882553:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04a00, rc 0) 00000100:00100000:2.0:1746147138.882596:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32151:x1830967307863936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7045us (7317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.882604:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14311 00000100:00100000:1.0:1746147138.882794:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307864064 00000100:00100000:1.0:1746147138.882800:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307864064 00002000:00100000:1.0:1746147138.882838:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3465215) req@ffff880091c3dc00 x1830967307864064/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.882846:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3dc00 with x1830967307864064 ext(3145728->3465215) 00010000:00010000:1.0:1746147138.882853:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 18 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.882870:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 18 pid: 12201 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746147138.882876:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c3dc00 00000100:00100000:1.0:1746147138.882895:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1066 00000100:00100000:1.0:1746147138.882902:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967307864064:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147138.883324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.883486:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307864192 00000100:00100000:2.0:1746147138.883489:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307864192 00000100:00100000:2.0:1746147138.883506:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14312 00000100:00100000:2.0:1746147138.883511:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+20:32152:x1830967307864192:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147138.883519:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.883531:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776c2 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.883546:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147138.883550:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.883562:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.883568:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:2.0:1746147138.884159:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:32152:x1830967307864192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 645us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.884164:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14312 00000100:00100000:0.0:1746147138.889861:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310636032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147138.889909:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147138.889953:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310636032 00000100:00100000:3.0:1746147138.889960:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310636032 00000100:00100000:3.0:1746147138.890000:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00080000:2.0:1746147138.890018:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147138.890020:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310636032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1746147138.890040:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1217360960 pending 1085440 free 3909718016 avail 3678195712 00000100:00100000:3.0:1746147138.890073:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310636032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.890079:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1746147138.890113:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310636032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746147138.890184:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307864064:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7279us (7828us total) trans 17179874165 rc 0/0 00000100:00100000:1.0:1746147138.890192:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1066 00002000:00100000:1.0:1746147138.890200:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3465215) req@ffff880091c3dc00 x1830967307864064/t17179874165(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/448 e 0 to 0 dl 1746147149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.890209:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3dc00 with x1830967307864064 ext(3145728->3465215) 00010000:00010000:1.0:1746147138.890217:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 21 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.890231:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 21 pid: 12201 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746147138.890237:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c3dc00 00000100:00100000:0.0:1746147138.894027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.895950:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307864320 00000100:00100000:3.0:1746147138.895962:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307864320 00010000:00010000:3.0:1746147138.896001:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 21 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.896051:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6230 00000100:00100000:3.0:1746147138.896059:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307864320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.896073:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147138.896115:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147137 -> 1746147138 00002000:00010000:3.0:1746147138.896118:0:7227:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147137 -> 1746147138 00010000:00010000:3.0:1746147138.896124:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 21 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.896138:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 21 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.896159:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136348400/0x3139939425055640 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77698 expref: 21 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.896182:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.896184:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.896190:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.896197:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.896205:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.896206:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.896209:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.896216:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.896243:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.896255:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310636160:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.896347:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.896355:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310636288:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.896382:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.899401:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310636160:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147138.899413:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310636288:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147138.899430:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.899478:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307864320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3419us (5471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.899487:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6230 00000100:00100000:0.0:1746147138.901723:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.901795:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307864704 00000100:00100000:1.0:1746147138.901803:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307864704 00002000:00100000:1.0:1746147138.901838:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880091c3d880 x1830967307864704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.901848:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3d880 with x1830967307864704 ext(3145728->4194303) 00002000:00010000:1.0:1746147138.901853:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3d880 00000100:00100000:1.0:1746147138.901891:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3363 00000100:00100000:1.0:1746147138.901898:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307864704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147138.903390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.903432:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.903637:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307864832 00000100:00100000:3.0:1746147138.903642:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307864832 00002000:00100000:3.0:1746147138.903666:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880091c3fb80 x1830967307864832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.903672:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3fb80 with x1830967307864832 ext(3145728->4194303) 00002000:00010000:3.0:1746147138.903675:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3fb80 00000100:00100000:3.0:1746147138.903686:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307865088 00000100:00100000:3.0:1746147138.903688:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307865088 00002000:00100000:3.0:1746147138.903698:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880091c3c000 x1830967307865088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.903704:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c000 with x1830967307865088 ext(3145728->4194303) 00002000:00010000:3.0:1746147138.903706:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c000 00000100:00100000:3.0:1746147138.903716:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3364 00000100:00100000:3.0:1746147138.903722:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307864832:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147138.903731:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3365 00000100:00100000:0.0:1746147138.903739:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307865088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147138.909978:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307864704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8073us (8255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147138.909989:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3363 00002000:00100000:1.0:1746147138.909999:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880091c3d880 x1830967307864704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147138.910019:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3d880 with x1830967307864704 ext(3145728->4194303) 00002000:00010000:1.0:1746147138.910025:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3d880 00000100:00100000:3.0:1746147138.916497:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307864832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12765us (13103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147138.916508:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3364 00002000:00100000:3.0:1746147138.916519:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880091c3fb80 x1830967307864832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.916533:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3fb80 with x1830967307864832 ext(3145728->4194303) 00002000:00010000:3.0:1746147138.916538:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3fb80 00000100:00100000:2.0:1746147138.918158:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307865088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14415us (14720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147138.918166:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3365 00002000:00100000:2.0:1746147138.918173:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880091c3c000 x1830967307865088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.918181:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c000 with x1830967307865088 ext(3145728->4194303) 00002000:00010000:2.0:1746147138.918185:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c000 00000100:00100000:0.0:1746147138.928692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.928927:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.929034:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307865472 00000100:00100000:2.0:1746147138.929041:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307865216 00000100:00100000:3.0:1746147138.929047:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307865472 00000100:00100000:2.0:1746147138.929050:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307865216 00000100:00100000:2.0:1746147138.929134:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15205 00002000:00100000:3.0:1746147138.929136:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3c380 x1830967307865472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147138.929143:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:32156:x1830967307865216:12345-192.168.204.25@tcp:101:mirror_io.0 00002000:00100000:3.0:1746147138.929146:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c380 with x1830967307865472 ext(4194304->4919295) 00002000:00010000:3.0:1746147138.929151:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c380 00010000:00010000:2.0:1746147138.929165:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147138.929176:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3366 00000100:00100000:3.0:1746147138.929184:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307865472:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:2.0:1746147138.929186:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x3139939425055671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776c9 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.929246:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929261:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929272:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929283:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929288:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929292:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929543:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929555:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.929563:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.929570:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.929606:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.929620:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 27 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.929638:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310636416:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.931136:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.931150:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 9 pid: 7238 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.931164:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310636544:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.931205:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.934147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.934186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.934216:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307865984 00000100:00100000:0.0:1746147138.934223:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307865984 00002000:00100000:0.0:1746147138.934257:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3c700 x1830967307865984/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/0 e 0 to 0 dl 1746147149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147138.934267:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c700 with x1830967307865984 ext(4194304->4919295) 00002000:00010000:0.0:1746147138.934272:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c700 00000100:00100000:0.0:1746147138.934289:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3367 00000100:00100000:0.0:1746147138.934296:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307865984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147138.934679:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307865728 00000100:00100000:1.0:1746147138.934688:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307865728 00000100:00100000:1.0:1746147138.934753:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5422 00000100:00100000:1.0:1746147138.934762:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:30748:x1830967307865728:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147138.934998:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310636416:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.935021:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310636544:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.935040:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147138.935747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.936054:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307866240 00000100:00100000:3.0:1746147138.936060:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307866240 00000100:00100000:3.0:1746147138.936114:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5423 00000100:00100000:3.0:1746147138.936121:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:30601:x1830967307866240:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147138.936279:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:30601:x1830967307866240:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 157us (532us total) trans 8589935867 rc 0/0 00000100:00100000:3.0:1746147138.936286:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5423 00000100:00100000:1.0:1746147138.937300:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:30748:x1830967307865728:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 2532us (3155us total) trans 8589935866 rc 0/0 00000100:00100000:1.0:1746147138.937311:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5422 00000100:00100000:3.0:1746147138.937830:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307865472:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8645us (8901us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147138.937839:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3366 00002000:00100000:3.0:1746147138.937848:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3c380 x1830967307865472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147138.937857:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c380 with x1830967307865472 ext(4194304->4919295) 00002000:00010000:3.0:1746147138.937864:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c380 00000100:00100000:0.0:1746147138.938289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.939470:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307866368 00000100:00100000:3.0:1746147138.939483:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307866368 00010000:00010000:3.0:1746147138.939520:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 11 pid: 7238 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.939566:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6231 00000100:00100000:3.0:1746147138.939574:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307866368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.939590:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.939595:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 11 pid: 7238 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.939605:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 11 pid: 7238 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.939628:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x3139939425055583 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775f7 expref: 11 pid: 7238 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.939643:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.939648:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.939655:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.939660:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.939664:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.939706:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307866368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 133us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.939712:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6231 00000100:00100000:0.0:1746147138.940176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.940218:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307866496 00000100:00100000:1.0:1746147138.940223:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307866496 00010000:00010000:1.0:1746147138.940242:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.940259:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6232 00000100:00100000:1.0:1746147138.940264:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307866496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.940272:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.940277:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.940286:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.940298:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425055591 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77652 expref: 29 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.940308:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.940311:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147138.940317:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147138.940324:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147138.940343:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.940364:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307866496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.940370:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6232 00000100:00100000:2.0:1746147138.940520:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307865984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6222us (6332us total) trans 0 rc 724992/724992 00010000:00010000:3.0:1746147138.940532:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:2.0:1746147138.940534:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3367 00010000:00010000:3.0:1746147138.940540:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00002000:00100000:2.0:1746147138.940545:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3c700 x1830967307865984/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:514/0 lens 488/440 e 0 to 0 dl 1746147149 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147138.940554:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c700 with x1830967307865984 ext(4194304->4919295) 00002000:00010000:2.0:1746147138.940560:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3c700 00000004:00200000:3.0:1746147138.940595:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147138.940605:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147138.940626:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940635:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940645:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940652:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940658:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940664:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147138.940668:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940675:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940684:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147138.940686:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147138.940931:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940938:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425055678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940950:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940955:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940959:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940963:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147138.940966:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940971:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940978:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553900) 00010000:00010000:3.0:1746147138.940980:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147138.940983:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.940988:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505567f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.941039:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x3139939425055671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.941051:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.941058:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.941060:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147138.941062:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6a00, rc 0) 00000100:00100000:3.0:1746147138.941385:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32156:x1830967307865216:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 12242us (12704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.941392:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15205 00000100:00100000:0.0:1746147138.943939:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.944017:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307866752 00000100:00100000:1.0:1746147138.944027:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307866752 00000100:00100000:1.0:1746147138.944103:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5424 00000100:00100000:1.0:1746147138.944114:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32151:x1830967307866752:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147138.944315:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32151:x1830967307866752:12345-192.168.204.25@tcp:35:cat.0 Request processed in 202us (384us total) trans 8589935868 rc 0/0 00000100:00100000:1.0:1746147138.944322:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5424 00000100:00100000:0.0:1746147138.948185:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.948240:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.948323:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307866880 00000100:00100000:1.0:1746147138.948332:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307866880 00000100:00100000:1.0:1746147138.948379:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307867008 00000100:00100000:1.0:1746147138.948382:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307867008 00000100:00100000:0.0:1746147138.948399:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14313 00000100:00100000:0.0:1746147138.948414:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307866880:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147138.948435:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147138.948456:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776d0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.948481:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.948483:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.948492:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.948509:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147138.948521:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14314 00010000:00010000:0.0:1746147138.948521:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932e3800, rc 0) 00000100:00100000:1.0:1746147138.948528:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307867008:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147138.948537:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147138.948548:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776d7 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.948561:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147138.948562:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307866880:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 155us (389us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147138.948563:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.948569:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147138.948569:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14313 00010000:00010000:1.0:1746147138.948579:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.948586:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b800, rc 0) 00000100:00100000:1.0:1746147138.948604:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307867008:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 77us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.948609:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14314 00000100:00100000:2.0:1746147138.953597:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.953690:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307867264 00000100:00100000:1.0:1746147138.953699:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307867264 00000100:00100000:1.0:1746147138.953759:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5425 00000100:00100000:1.0:1746147138.953767:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:32152:x1830967307867264:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147138.953991:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32152:x1830967307867264:12345-192.168.204.25@tcp:35:cat.0 Request processed in 224us (405us total) trans 8589935869 rc 0/0 00000100:00100000:1.0:1746147138.954001:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5425 00000100:00100000:0.0:1746147138.955184:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.955359:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307867520 00000100:00100000:3.0:1746147138.955365:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307867520 00000100:00100000:3.0:1746147138.955406:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15206 00000100:00100000:3.0:1746147138.955412:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32156:x1830967307867520:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147138.955424:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147138.955442:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371de00/0x313993942505569b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776de expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.955529:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.955543:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.955551:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.955579:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.955591:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 8 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.955607:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310636672:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147138.956258:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.961467:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310636672:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.961494:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147138.963063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.963132:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307867648 00000100:00100000:3.0:1746147138.963139:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307867648 00010000:00010000:3.0:1746147138.963265:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 9 pid: 16099 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.963292:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6233 00000100:00100000:3.0:1746147138.963300:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307867648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.963315:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.963321:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 9 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.963331:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 9 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.963349:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425055686 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c9 expref: 9 pid: 16099 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.963365:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147138.963369:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.963381:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.963387:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147138.963413:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.963448:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307867648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 149us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.963455:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6233 00010000:00010000:2.0:1746147138.963676:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.963692:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147138.963715:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147138.963867:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371de00/0x313993942505569b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776de expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.963892:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776de expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.963900:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.963902:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147138.963905:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d800, rc 0) 00000100:00100000:2.0:1746147138.963983:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32156:x1830967307867520:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 8570us (8801us total) trans 8589935870 rc 0/0 00000100:00100000:2.0:1746147138.964419:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15206 00000100:00100000:0.0:1746147138.967381:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.967459:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307867904 00000100:00100000:2.0:1746147138.967468:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307867904 00000100:00100000:2.0:1746147138.967509:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15207 00000100:00100000:2.0:1746147138.967516:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32156:x1830967307867904:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147138.967539:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.967542:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147138.967566:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x31399394250556a2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776de expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.967582:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.967586:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147138.967597:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250556b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776e5 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.967689:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.967700:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147138.967707:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147138.967716:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147138.967801:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250556b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.967811:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.967818:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.967820:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147138.967822:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00000100:00100000:2.0:1746147138.967881:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32156:x1830967307867904:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 364us (509us total) trans 8589935871 rc 0/0 00000100:00100000:2.0:1746147138.967887:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15207 00000100:00100000:3.0:1746147138.970621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.970704:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868032 00000100:00100000:2.0:1746147138.970715:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868032 00000100:00100000:2.0:1746147138.970765:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15208 00000100:00100000:2.0:1746147138.970775:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32156:x1830967307868032:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147138.970799:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147138.970822:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x31399394250556c5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776ec expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.970882:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x31399394250556c5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ec expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.970896:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x31399394250556c5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ec expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.970913:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.970916:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147138.970919:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d800, rc 0) 00000100:00100000:2.0:1746147138.970982:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32156:x1830967307868032:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 208us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.970988:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15208 00000100:00100000:0.0:1746147138.973814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.973854:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.973882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.973906:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868160 00000100:00100000:1.0:1746147138.973908:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868416 00000100:00100000:3.0:1746147138.973909:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868288 00000100:00100000:1.0:1746147138.973914:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868416 00000100:00100000:0.0:1746147138.973914:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868160 00000100:00100000:3.0:1746147138.973921:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868288 00000100:00100000:1.0:1746147138.973970:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14315 00000100:00100000:1.0:1746147138.973978:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307868416:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147138.974032:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.974050:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.974057:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.974065:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.974071:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.974073:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.974076:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.974124:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.974137:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 29 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746147138.974153:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310636800:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147138.974231:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.974240:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746147138.974247:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310636928:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147138.974270:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147138.974277:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 13 pid: 1853 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746147138.974285:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310637056:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147138.974299:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a4000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.974415:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14316 00000100:00100000:0.0:1746147138.974422:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307868160:12345-192.168.204.25@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147138.974443:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14317 00000100:00100000:3.0:1746147138.974451:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967307868288:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147138.974487:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.974501:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 13 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.974509:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.974515:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.974520:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147138.974520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147138.974523:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.974525:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.974538:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868544 00000100:00100000:2.0:1746147138.974541:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868544 00010000:00010000:3.0:1746147138.974553:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.974562:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.974567:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14318 00000100:00100000:3.0:1746147138.974573:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310637184:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.974573:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307868544:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147138.974591:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.974603:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.974611:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.974624:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.974629:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.974631:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.974633:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.974633:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.974641:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 9 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746147138.974649:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310637312:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.974650:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.974658:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 35 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.974668:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310637440:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.974674:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 13 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.974682:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 13 pid: 1398 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746147138.974690:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310637568:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.974702:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147138.974709:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147138.974710:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 19 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.974717:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310637696:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.974741:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147138.974753:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 14 pid: 1853 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.974761:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310637824:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.974773:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00010000:00010000:0.0:1746147138.974940:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.974952:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.974959:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.974966:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.974971:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.974973:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.974975:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.974991:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.974999:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 35 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.975019:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310637952:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.975050:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.975057:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.975070:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310638080:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.975110:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.975118:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.975126:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310638208:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.975149:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147138.975284:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.975419:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868672 00000100:00100000:0.0:1746147138.975423:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868672 00000100:00100000:3.0:1746147138.975445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.975858:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868800 00000100:00100000:0.0:1746147138.975861:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868800 00000100:00100000:0.0:1746147138.975883:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14319 00000100:00100000:0.0:1746147138.975892:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967307868672:12345-192.168.204.25@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147138.975905:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14320 00000100:00100000:3.0:1746147138.975914:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307868800:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147138.975915:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.975930:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.975935:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.975938:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.975945:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.975946:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.975953:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147138.975956:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.975959:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.975963:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.975963:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147138.975964:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.975964:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147138.975966:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.975966:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.975982:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 29 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.975983:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.975988:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 29 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.975991:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 19 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.975994:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310638336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.975999:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310638464:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.976038:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147138.976043:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 14 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.976043:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147138.976048:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310638592:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.976051:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.976059:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310638720:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147138.976064:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.976069:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 9 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.976073:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310638848:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147138.976083:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147138.976086:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.976117:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 35 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746147138.976125:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310638976:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.977276:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.977286:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746147138.977295:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310639104:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.977355:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147138.983927:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310636800:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147138.983941:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310636928:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147138.983949:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310637056:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147138.983979:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.984790:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310637184:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147138.984802:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310637312:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.985193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.985211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.985226:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.985247:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869440 00000100:00100000:0.0:1746147138.985254:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869440 00010000:00010000:0.0:1746147138.985288:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 15 pid: 1398 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.985312:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869312 00000100:00100000:0.0:1746147138.985314:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869312 00010000:00010000:0.0:1746147138.985324:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.985336:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869568 00000100:00100000:0.0:1746147138.985338:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869568 00010000:00010000:0.0:1746147138.985346:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 10 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.985361:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6234 00000100:00100000:0.0:1746147138.985368:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307869440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.985388:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.985409:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 15 pid: 1398 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985420:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 15 pid: 1398 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985449:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.985488:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307869440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.985494:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6234 00000100:00100000:0.0:1746147138.985535:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6235 00000100:00100000:0.0:1746147138.985540:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307869312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.985546:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.985555:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985564:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985575:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x3139939425055598 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7760c expref: 30 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985592:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.985604:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307869312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 64us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.985610:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6235 00000100:00100000:0.0:1746147138.985618:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6236 00000100:00100000:0.0:1746147138.985622:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307869568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.985628:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.985635:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 10 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985642:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 10 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985653:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x31399394250555c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7762f expref: 10 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985661:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.985674:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307869568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.985679:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6236 00000100:00100000:0.0:1746147138.985709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.985723:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307868928 00000100:00100000:0.0:1746147138.985726:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307868928 00010000:00010000:0.0:1746147138.985735:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 15 pid: 1853 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.985755:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6237 00000100:00100000:0.0:1746147138.985760:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967307868928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.985766:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.985772:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 15 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985779:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 15 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985790:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f200/0x31399394250554d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775cd expref: 15 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985798:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.985813:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967307868928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.985818:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6237 00000100:00100000:0.0:1746147138.985868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.985880:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869184 00000100:00100000:0.0:1746147138.985883:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869184 00010000:00010000:0.0:1746147138.985895:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 16 pid: 1853 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.985910:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6238 00000100:00100000:0.0:1746147138.985914:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307869184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.985924:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.985937:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 16 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985945:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 16 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.985958:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.985972:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967307869184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.985977:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6238 00000100:00100000:0.0:1746147138.986021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.986032:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869824 00000100:00100000:0.0:1746147138.986035:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869824 00010000:00010000:0.0:1746147138.986044:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.986056:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6239 00000100:00100000:0.0:1746147138.986061:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307869824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.986067:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.986073:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986081:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986117:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x313993942505559f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77605 expref: 29 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986126:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.986128:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.986133:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986140:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986158:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.986172:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307869824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 111us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.986177:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6239 00000100:00100000:0.0:1746147138.986209:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.986220:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869056 00000100:00100000:0.0:1746147138.986222:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869056 00010000:00010000:0.0:1746147138.986231:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.986244:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6240 00000100:00100000:0.0:1746147138.986248:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307869056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.986254:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.986260:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986267:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986282:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250555c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77636 expref: 9 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986290:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.986292:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.986294:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986300:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986314:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.986328:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307869056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.986334:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6240 00000100:00100000:0.0:1746147138.986368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.986378:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869696 00000100:00100000:0.0:1746147138.986381:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869696 00010000:00010000:0.0:1746147138.986391:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 36 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.986403:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6241 00000100:00100000:0.0:1746147138.986407:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307869696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.986413:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.986420:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 36 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986432:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 36 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.986443:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.986457:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307869696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.986462:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6241 00000100:00100000:0.0:1746147138.986529:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310637952:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986567:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310638080:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986599:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310638208:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.986618:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.986720:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310638336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986750:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310638464:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986774:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310638592:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986795:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310639104:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986818:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310638720:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.986842:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310638848:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.986861:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.986914:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310638976:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147138.986929:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986959:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986966:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986982:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986989:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.986996:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.987003:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822ba00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147138.987024:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.987039:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.987053:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.987059:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x31399394250556cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987083:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x31399394250554e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775c6 expref: 13 pid: 1398 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746147138.987117:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310637568:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147138.987123:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307868416:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 13146us (13240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.987132:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14315 00010000:00010000:3.0:1746147138.987140:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987151:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987156:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987168:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987174:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987179:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987184:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009371de00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147138.987186:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987191:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987199:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.987205:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x31399394250556d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147138.987249:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307868288:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 12798us (13393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.987255:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14317 00010000:00010000:2.0:1746147138.987257:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x31399394250555a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77613 expref: 35 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.987270:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310637440:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.987278:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310637696:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.987285:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x31399394250554e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775d4 expref: 15 pid: 1853 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.987292:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310637824:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.987311:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.988963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.988990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.988997:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870464 00000100:00100000:2.0:1746147138.989001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.989002:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870464 00000100:00100000:0.0:1746147138.989025:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870720 00000100:00100000:0.0:1746147138.989027:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870720 00000100:00100000:2.0:1746147138.989030:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147138.989050:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.989052:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.989064:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870976 00000100:00100000:2.0:1746147138.989065:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870592 00000100:00100000:0.0:1746147138.989066:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870976 00000100:00100000:2.0:1746147138.989069:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870592 00000100:00100000:3.0:1746147138.989073:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307869952 00010000:00010000:0.0:1746147138.989073:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 8 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746147138.989077:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307869952 00000100:00100000:0.0:1746147138.989081:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6242 00010000:00010000:2.0:1746147138.989086:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746147138.989086:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307870720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.989105:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 20 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989107:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147138.989117:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6243 00010000:00010000:0.0:1746147138.989120:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746147138.989121:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6244 00000100:00100000:2.0:1746147138.989123:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307870976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147138.989127:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307870592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.989131:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989132:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.989133:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147138.989143:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 8 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.989145:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932e3800/0x313993942505568d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d0 expref: 15 pid: 9584 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.989150:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.989156:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147138.989158:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.989159:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 8 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.989170:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42c00/0x313993942505564e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776a6 expref: 35 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.989173:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425055655 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ad expref: 8 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746147138.989178:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.989180:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307870720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (191us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147138.989182:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.989185:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6242 00000100:00100000:3.0:1746147138.989194:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307870592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.989194:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6245 00000100:00100000:0.0:1746147138.989198:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307869952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147138.989199:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6244 00000100:00100000:2.0:1746147138.989199:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307870976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147138.989202:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147138.989205:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6243 00010000:00010000:0.0:1746147138.989207:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 20 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989213:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 20 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989219:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714e00/0x31399394250555d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7763d expref: 20 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989226:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.989227:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147138.989230:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147138.989230:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989237:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.989242:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870080 00000100:00100000:2.0:1746147138.989245:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870080 00010000:00010000:0.0:1746147138.989251:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.989255:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147138.989255:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 34 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.989260:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307869952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.989263:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6245 00000100:00100000:2.0:1746147138.989264:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870336 00000100:00100000:3.0:1746147138.989266:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6246 00000100:00100000:2.0:1746147138.989266:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870336 00000100:00100000:3.0:1746147138.989271:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307870080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147138.989274:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989276:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 11 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.989277:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.989284:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 34 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746147138.989285:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6247 00000100:00100000:2.0:1746147138.989290:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307870464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147138.989292:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 34 pid: 12225 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746147138.989293:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6248 00000100:00100000:0.0:1746147138.989295:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307870336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147138.989296:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147138.989299:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.989302:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256f600/0x3139939425055575 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775fe expref: 34 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989302:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 11 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989304:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989309:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989310:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 11 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746147138.989313:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147138.989316:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250554cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e775bf expref: 14 pid: 1398 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989321:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822b800/0x3139939425055694 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776d7 expref: 11 pid: 17600 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746147138.989322:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147138.989324:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307870080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.989329:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6246 00010000:00010000:2.0:1746147138.989329:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.989337:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307870336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.989344:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307870464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.989344:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6248 00000100:00100000:2.0:1746147138.989350:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6247 00000100:00100000:3.0:1746147138.989356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147138.989397:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.989513:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870208 00000100:00100000:0.0:1746147138.989517:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870208 00000100:00100000:3.0:1746147138.989522:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307870848 00000100:00100000:3.0:1746147138.989525:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307870848 00010000:00010000:0.0:1746147138.989530:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989534:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.989536:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 28 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746147138.989543:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.989548:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6249 00000100:00100000:3.0:1746147138.989551:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6250 00000100:00100000:0.0:1746147138.989553:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967307870208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147138.989555:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307870848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147138.989559:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147138.989560:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147138.989560:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.989567:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 28 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.989567:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989572:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.989575:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 28 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.989575:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989578:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.989584:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38c200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147138.989585:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505565c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776b4 expref: 28 pid: 17600 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746147138.989585:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256fe00/0x31399394250555b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7761a expref: 19 pid: 12225 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746147138.989587:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989593:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147138.989594:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989594:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.989595:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147138.989596:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147138.989597:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.989599:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989602:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147138.989605:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.989605:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.989611:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x31399394250556da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989615:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147138.989624:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.989632:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307870208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147138.989638:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307870848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.989638:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6249 00000100:00100000:3.0:1746147138.989643:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6250 00000100:00100000:2.0:1746147138.989652:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307868544:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 15078us (15131us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147138.989654:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.989659:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14318 00010000:00010000:0.0:1746147138.989660:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989671:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989677:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989683:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989688:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932e3600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147138.989689:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989691:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.989697:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989697:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989706:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.989715:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932e3600/0x31399394250556e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.989750:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307868160:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 15328us (15948us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.989755:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14316 00010000:00010000:2.0:1746147138.990028:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.990035:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.990041:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.990046:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009371d800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147138.990049:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.990055:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.990063:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.990394:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x31399394250556ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147138.990437:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307868800:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 14523us (14990us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147138.990443:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14320 00000100:00100000:0.0:1746147138.990870:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147138.990896:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.990951:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307871232 00000100:00100000:2.0:1746147138.990956:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307871232 00010000:00010000:2.0:1746147138.990974:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 18 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.991101:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307871104 00000100:00100000:2.0:1746147138.991104:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307871104 00010000:00010000:2.0:1746147138.991115:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 33 pid: 12201 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.991179:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6251 00000100:00100000:1.0:1746147138.991186:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967307871232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.991196:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.991206:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 18 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.991215:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 18 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.991228:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505566a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776c2 expref: 18 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.991242:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.991260:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307871232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.991265:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6251 00000100:00100000:1.0:1746147138.991276:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6252 00000100:00100000:1.0:1746147138.991280:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307871104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.991285:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.991290:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 33 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.991297:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 33 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.991319:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425055663 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776bb expref: 33 pid: 12201 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.991326:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.991327:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147138.991331:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.991338:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147138.991354:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.991365:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307871104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.991369:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6252 00010000:00010000:0.0:1746147138.991410:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991417:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991428:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991434:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991440:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991445:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147138.991447:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991458:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991466:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147138.991471:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x31399394250556e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147138.991500:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307868672:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 15612us (16218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147138.991507:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14319 00000100:00100000:0.0:1746147138.993070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.993365:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307871488 00000100:00100000:2.0:1746147138.993372:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307871488 00000100:00100000:2.0:1746147138.994049:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15209 00000100:00100000:2.0:1746147138.994059:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32156:x1830967307871488:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147138.994139:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147138.994166:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x31399394250556c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776ec expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994184:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147138.994188:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147138.994215:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147138.994229:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994236:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994243:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994250:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147138.994280:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994292:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 28 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.994306:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310639232:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.994407:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994415:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 10 pid: 9138 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.994423:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310639360:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.994446:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147138.994452:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746147138.994459:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310639488:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.994474:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147138.997281:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147138.997319:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310639232:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.997331:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310639360:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147138.997338:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310639488:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147138.997371:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147138.997464:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307871744 00000100:00100000:1.0:1746147138.997471:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307871744 00010000:00010000:1.0:1746147138.997503:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 29 pid: 7237 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.997536:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6253 00000100:00100000:1.0:1746147138.997542:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307871744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.997557:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.997562:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 29 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.997570:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 29 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.997592:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425055624 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7767c expref: 29 pid: 7237 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.997604:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.997608:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.997616:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147138.997629:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.997654:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307871744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.997664:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6253 00000100:00100000:1.0:1746147138.997677:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307871616 00000100:00100000:1.0:1746147138.997679:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307871616 00010000:00010000:1.0:1746147138.997686:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.997696:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6254 00000100:00100000:1.0:1746147138.997699:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307871616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.997704:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.997707:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.997713:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.997722:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942505561d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77675 expref: 11 pid: 9138 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.997732:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.997735:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.997739:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.997749:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307871616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.997754:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6254 00000100:00100000:0.0:1746147138.997955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147138.997993:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307871872 00000100:00100000:1.0:1746147138.997997:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307871872 00010000:00010000:1.0:1746147138.998016:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746147138.998040:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6255 00000100:00100000:1.0:1746147138.998045:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307871872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147138.998051:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147138.998055:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.998063:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.998073:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425055616 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7766e expref: 10 pid: 7238 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746147138.998083:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147138.998085:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.998119:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.998125:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147138.998191:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147138.998212:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307871872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147138.998222:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6255 00010000:00010000:2.0:1746147138.998285:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147138.998290:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000040:00080000:2.0:1746147138.998541:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].550, 88 off56456 00000004:00080000:2.0:1746147138.998546:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988455938ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998688:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].492, 88 off51352 00000004:00080000:2.0:1746147138.998692:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988602498ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998713:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].493, 88 off51440 00000004:00080000:2.0:1746147138.998715:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988625599ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998722:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].551, 88 off56544 00000004:00080000:2.0:1746147138.998724:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988634998ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998731:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].552, 88 off56632 00000004:00080000:2.0:1746147138.998733:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988643253ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998738:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].494, 88 off51528 00000004:00080000:2.0:1746147138.998741:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988651179ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998746:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].495, 88 off51616 00000004:00080000:2.0:1746147138.998749:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988659768ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998755:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].496, 88 off51704 00000004:00080000:2.0:1746147138.998757:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988667432ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998762:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].553, 88 off56720 00000004:00080000:2.0:1746147138.998765:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988675821ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998771:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].497, 88 off51792 00000004:00080000:2.0:1746147138.998773:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988683928ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998779:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].554, 88 off56808 00000004:00080000:2.0:1746147138.998781:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988691618ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998786:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].498, 88 off51880 00000004:00080000:2.0:1746147138.998788:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988698846ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147138.998794:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].555, 88 off56896 00000004:00080000:2.0:1746147138.998796:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988706188ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998801:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].556, 88 off56984 00000004:00080000:2.0:1746147138.998803:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988713959ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998809:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].557, 88 off57072 00000004:00080000:2.0:1746147138.998811:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988721281ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998816:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].558, 88 off57160 00000004:00080000:2.0:1746147138.998819:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676988729289ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147138.998824:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].499, 88 off51968 00000004:00080000:2.0:1746147138.998826:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676988736749ns, next at 554081490131ns, rc = 0 00000001:00080000:3.0:1746147139.001525:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935872 is committed 00000004:00080000:3.0:1746147139.001534:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 494 committed 00000004:00080000:3.0:1746147139.001886:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 551 committed 00000004:00080000:3.0:1746147139.001903:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 550 committed 00000004:00080000:3.0:1746147139.001907:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 549 committed 00000004:00080000:3.0:1746147139.001909:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 548 committed 00000004:00080000:3.0:1746147139.001910:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 493 committed 00000004:00080000:3.0:1746147139.001912:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 547 committed 00000004:00080000:3.0:1746147139.001913:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 492 committed 00000004:00080000:3.0:1746147139.001914:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 546 committed 00000004:00080000:3.0:1746147139.001916:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 491 committed 00000004:00080000:3.0:1746147139.001917:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 490 committed 00000004:00080000:3.0:1746147139.001918:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 489 committed 00000004:00080000:3.0:1746147139.001922:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 545 committed 00000004:00080000:3.0:1746147139.001923:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 544 committed 00000004:00080000:3.0:1746147139.001924:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 488 committed 00000004:00080000:3.0:1746147139.001926:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 487 committed 00000004:00080000:3.0:1746147139.001927:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 543 committed 00000001:00080000:3.0:1746147139.001935:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935869 is committed 00000001:00080000:3.0:1746147139.001939:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935868 is committed 00000100:00100000:2.0:1746147139.002122:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310639744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002174:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.002196:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310640256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.002220:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147139.002223:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310639872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002232:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.002239:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310640384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002249:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.002270:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310639744 00000100:00100000:2.0:1746147139.002276:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310639744 00000100:00100000:2.0:1746147139.002306:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640256 00000100:00100000:2.0:1746147139.002308:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640256 00000100:00100000:2.0:1746147139.002315:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310639872 00000100:00100000:2.0:1746147139.002317:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310639872 00000100:00100000:2.0:1746147139.002324:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640384 00000100:00100000:2.0:1746147139.002325:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640384 00000100:00100000:2.0:1746147139.002334:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14321 00000100:00100000:2.0:1746147139.002339:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3764:x1830967310639744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002457:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3764:x1830967310639744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (282us total) trans 17179874166 rc 0/0 00000100:00100000:2.0:1746147139.002463:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14321 00000100:00100000:2.0:1746147139.002474:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14322 00000100:00100000:2.0:1746147139.002478:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3764:x1830967310640256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002529:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3764:x1830967310640256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (321us total) trans 17179874167 rc 0/0 00000100:00100000:2.0:1746147139.002534:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14322 00000100:00100000:2.0:1746147139.002543:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14323 00000100:00100000:2.0:1746147139.002547:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3764:x1830967310639872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.002599:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3764:x1830967310639872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (365us total) trans 17179874168 rc 0/0 00000100:00100000:2.0:1746147139.002604:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14323 00000100:00100000:2.0:1746147139.002612:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14324 00000100:00100000:2.0:1746147139.002616:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3764:x1830967310640384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147139.002654:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147139.002657:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.002660:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147139.002661:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000100:00100000:1.0:1746147139.002661:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310640896:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147139.002663:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147139.002680:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3764:x1830967310640384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (430us total) trans 17179874169 rc 0/0 00000100:00100000:1.0:1746147139.002681:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.002685:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14324 00000100:00100000:2.0:1746147139.002692:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640896 00000100:00100000:1.0:1746147139.002693:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310641408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.002694:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640896 00000100:00100000:1.0:1746147139.002704:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.002709:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310641408 00000100:00100000:2.0:1746147139.002711:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310641408 00000100:00100000:1.0:1746147139.002715:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147139.002718:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14325 00000100:00100000:1.0:1746147139.002719:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310640768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.002721:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3765:x1830967310640896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147139.002731:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147139.002737:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310641280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147139.002748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147139.002760:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640768 00000100:00100000:1.0:1746147139.002763:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640768 00000100:00100000:1.0:1746147139.002774:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310641280 00000100:00100000:1.0:1746147139.002776:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310641280 00000100:00100000:1.0:1746147139.002782:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14326 00000100:00100000:1.0:1746147139.002786:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310641408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.002788:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310640896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (107us total) trans 21474841427 rc 0/0 00000100:00100000:2.0:1746147139.002792:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14325 00000100:00100000:2.0:1746147139.002801:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14327 00000100:00100000:2.0:1746147139.002804:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967310640768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147139.002834:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310641408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (129us total) trans 21474841428 rc 0/0 00000100:00100000:2.0:1746147139.002842:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967310640768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (110us total) trans 21474841429 rc 0/0 00000100:00100000:1.0:1746147139.002842:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14326 00000100:00100000:2.0:1746147139.002846:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14327 00000100:00100000:1.0:1746147139.002851:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14328 00000100:00100000:1.0:1746147139.002855:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967310641280:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746147139.002859:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746147139.002862:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746147139.002882:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf8a80/2, rc 0, transno 17179874168 00002000:00010000:1.0:1746147139.002887:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746147139.002889:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310639872:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147139.002889:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147139.002891:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147139.002892:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147139.002894:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147139.002910:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967310641280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (160us total) trans 21474841430 rc 0/0 00000100:00100000:1.0:1746147139.002914:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14328 00000004:00080000:1.0:1746147139.002934:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4380/2, rc 0, transno 21474841429 00000100:00100000:1.0:1746147139.002937:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310640768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147139.002943:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4000/2, rc 0, transno 21474841430 00000100:00100000:1.0:1746147139.002945:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310641280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147139.002950:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5880/2, rc 0, transno 21474841427 00000100:00100000:1.0:1746147139.002952:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310640896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147139.002957:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6300/2, rc 0, transno 21474841428 00000100:00100000:1.0:1746147139.002959:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310641408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147139.003029:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094572300/2, rc 0, transno 17179874169 00000100:00100000:0.0:1746147139.003030:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003031:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310640384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147139.003037:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfb800/2, rc 0, transno 17179874166 00000100:00100000:2.0:1746147139.003039:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310639744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147139.003044:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf8700/2, rc 0, transno 17179874167 00000100:00100000:2.0:1746147139.003047:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310640256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.003051:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.003071:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640000 00000100:00100000:2.0:1746147139.003073:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640000 00000100:00100000:0.0:1746147139.003077:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003086:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14329 00000100:00100000:0.0:1746147139.003106:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.003109:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3766:x1830967310640000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.003117:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.003132:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.003138:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.003154:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.003159:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3766:x1830967310640000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (107us total) trans 17179874170 rc 0/0 00000100:00100000:2.0:1746147139.003163:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14329 00000004:00080000:0.0:1746147139.003169:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf9180/2, rc 0, transno 17179874170 00000100:00100000:2.0:1746147139.003171:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640512 00000100:00100000:0.0:1746147139.003172:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003173:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640512 00000100:00100000:0.0:1746147139.003176:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:2.0:1746147139.003180:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310641024 00000100:00100000:0.0:1746147139.003180:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310639616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003181:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310641024 00000100:00100000:2.0:1746147139.003187:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310641536 00000100:00100000:2.0:1746147139.003188:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310641536 00000100:00100000:0.0:1746147139.003193:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.003194:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14330 00000100:00100000:2.0:1746147139.003197:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3766:x1830967310640512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.003199:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.003211:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.003217:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.003230:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147139.003231:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:2.0:1746147139.003233:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.003235:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147139.003236:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641152:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147139.003237:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.003239:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147139.003248:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.003252:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3766:x1830967310640512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (145us total) trans 17179874171 rc 0/0 00000100:00100000:0.0:1746147139.003253:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003257:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14330 00000100:00100000:2.0:1746147139.003263:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310639616 00000100:00100000:0.0:1746147139.003264:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.003266:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310639616 00000100:00100000:2.0:1746147139.003272:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640128 00000100:00100000:2.0:1746147139.003274:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640128 00000004:00080000:0.0:1746147139.003274:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094572d80/2, rc 0, transno 17179874171 00000100:00100000:0.0:1746147139.003277:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003279:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310640640 00000100:00100000:2.0:1746147139.003280:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310640640 00000100:00100000:2.0:1746147139.003285:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310641152 00000100:00100000:2.0:1746147139.003287:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310641152 00000100:00100000:0.0:1746147139.003291:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310641664 00000100:00100000:2.0:1746147139.003293:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14331 00000100:00100000:0.0:1746147139.003294:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310641664 00000100:00100000:2.0:1746147139.003297:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3766:x1830967310641024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.003304:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14332 00000100:00100000:0.0:1746147139.003308:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3766:x1830967310641536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147139.003333:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147139.003335:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.003337:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147139.003338:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.003340:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147139.003356:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3766:x1830967310641536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (200us total) trans 21474841432 rc 0/0 00000100:00100000:0.0:1746147139.003361:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14332 00000100:00100000:0.0:1746147139.003371:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14333 00000100:00100000:0.0:1746147139.003376:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967310639616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147139.003388:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14334 00000100:00100000:1.0:1746147139.003393:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967310640128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147139.003427:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:1.0:1746147139.003429:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:1.0:1746147139.003431:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147139.003433:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147139.003434:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:3.0:1746147139.003467:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14335 00000100:00100000:3.0:1746147139.003476:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967310640640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.003684:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3766:x1830967310641024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 386us (551us total) trans 21474841431 rc 0/0 00000100:00100000:2.0:1746147139.003689:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14331 00000100:00100000:2.0:1746147139.003777:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14336 00000100:00100000:2.0:1746147139.003781:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967310641152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.003823:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3766:x1830967310641152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (574us total) trans 21474841434 rc 0/0 00000100:00100000:2.0:1746147139.003827:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14336 00000100:00100000:2.0:1746147139.003834:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14337 00000100:00100000:2.0:1746147139.003837:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967310641664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.003872:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967310641664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (607us total) trans 17179874174 rc 0/0 00000100:00100000:2.0:1746147139.003876:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14337 00000004:00010000:2.0:1746147139.003909:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098c71c00 reply state ffff88009506d000 transno 8589935872 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.003923:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.003930:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147139.003932:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147139.003935:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746147139.003985:0:7238:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147139.003993:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32156:x1830967307871488:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 9936us (10930us total) trans 8589935872 rc 0/0 00000100:00100000:2.0:1746147139.003998:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15209 00010000:00010000:2.0:1746147139.004028:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.004034:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.004040:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.004044:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147139.004048:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.004054:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147139.004061:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147139.004063:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147139.004064:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967310639616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 687us (869us total) trans 17179874172 rc 0/0 00010000:00010000:2.0:1746147139.004066:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147139.004069:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14333 00010000:00010000:2.0:1746147139.004073:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250556f6 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000004:00080000:0.0:1746147139.004115:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf9f80/2, rc 0, transno 17179874172 00000100:00100000:0.0:1746147139.004118:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310639616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147139.004169:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf9500/2, rc 0, transno 17179874173 00000100:00100000:1.0:1746147139.004170:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967310640128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 776us (957us total) trans 17179874173 rc 0/0 00000100:00100000:0.0:1746147139.004172:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147139.004175:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14334 00000100:00100000:3.0:1746147139.004374:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967310640640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 898us (1141us total) trans 21474841433 rc 0/0 00000100:00100000:3.0:1746147139.004379:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14335 00000004:00080000:0.0:1746147139.004421:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5c00/2, rc 0, transno 21474841433 00000100:00100000:0.0:1746147139.004424:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310640640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147139.004429:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5180/2, rc 0, transno 21474841434 00000100:00100000:0.0:1746147139.004431:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147139.004436:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094571f80/2, rc 0, transno 17179874174 00000100:00100000:0.0:1746147139.004438:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147139.004443:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6d80/2, rc 0, transno 21474841431 00000100:00100000:0.0:1746147139.004445:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147139.004449:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e321c00/2, rc 0, transno 21474841432 00000100:00100000:0.0:1746147139.004451:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310641536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.007463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.007534:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872000 00000100:00100000:2.0:1746147139.007542:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872000 00000100:00100000:2.0:1746147139.007583:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15210 00000100:00100000:2.0:1746147139.007589:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32156:x1830967307872000:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147139.007606:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.007621:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776f3 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.007666:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.007676:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.007688:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147139.007690:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147139.007692:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099055a00, rc 0) 00000100:00100000:2.0:1746147139.007734:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32156:x1830967307872000:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 145us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.007739:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15210 00000100:00100000:0.0:1746147139.011331:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.011400:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872128 00000100:00100000:3.0:1746147139.011408:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872128 00000100:00100000:3.0:1746147139.011461:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15211 00000100:00100000:3.0:1746147139.011468:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32156:x1830967307872128:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147139.011484:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.011500:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x3139939425055704 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e776fa expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.011573:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.011584:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.011596:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.011617:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147139.011620:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147139.011639:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.011659:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x3139939425055704 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.011687:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.011694:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.011696:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147139.011699:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fdc00, rc 0) 00000100:00100000:3.0:1746147139.011749:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32156:x1830967307872128:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 281us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.011755:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15211 00000100:00100000:0.0:1746147139.015484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.015507:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.016351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.017325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.017666:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872256 00000100:00100000:3.0:1746147139.017674:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872256 00000100:00100000:3.0:1746147139.017705:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872384 00000100:00100000:3.0:1746147139.017707:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872384 00000100:00100000:3.0:1746147139.017723:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872512 00000100:00100000:3.0:1746147139.017724:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872512 00000100:00100000:3.0:1746147139.017735:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14338 00000100:00100000:3.0:1746147139.017740:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307872256:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147139.017741:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14339 00000100:00100000:1.0:1746147139.017748:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307872384:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147139.017753:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.017756:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.017768:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77701 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.017768:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77708 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147139.017784:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814173f, atime: 0x6814173e, ctime: 0x6814173f, blocks: 0x7c8 00002000:00010000:1.0:1746147139.017784:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6814173f, atime: 0x6814173d, ctime: 0x6814173f, blocks: 0x808 00010000:00010000:3.0:1746147139.017798:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.017798:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.017799:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.017800:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.017806:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.017806:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.017818:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.017818:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.017826:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fca00, rc 0) 00010000:00010000:1.0:1746147139.017826:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:1.0:1746147139.017866:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307872384:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 119us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.017871:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14339 00000100:00100000:1.0:1746147139.017885:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14340 00000100:00100000:1.0:1746147139.017890:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307872512:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147139.017896:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.017904:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7770f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147139.017912:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814173c, atime: 0x6814173c, ctime: 0x6814173d, blocks: 0x808 00010000:00010000:1.0:1746147139.017951:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.017953:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.017957:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.017969:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.017975:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822ba00, rc 0) 00000100:00100000:3.0:1746147139.019077:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307872256:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 1332us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.019084:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14338 00000100:00100000:1.0:1746147139.019108:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307872512:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 1216us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.019114:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14340 00000100:00100000:2.0:1746147139.019730:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872640 00000100:00100000:0.0:1746147139.019731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.019735:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872640 00000100:00100000:2.0:1746147139.019760:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872768 00000100:00100000:2.0:1746147139.019762:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872768 00000100:00100000:0.0:1746147139.019770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.019772:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14341 00000100:00100000:2.0:1746147139.019778:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307872640:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147139.019787:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147139.019787:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307872896 00000100:00100000:0.0:1746147139.019789:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307872896 00010000:00010000:2.0:1746147139.019800:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77716 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147139.019803:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14342 00000100:00100000:0.0:1746147139.019807:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307872768:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147139.019813:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.019819:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7771d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147139.019823:0:17600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141741, atime: 0x68141740, ctime: 0x68141741, blocks: 0x800 00002000:00010000:0.0:1746147139.019827:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141742, atime: 0x68141741, ctime: 0x68141742, blocks: 0x1590 00010000:00010000:2.0:1746147139.019834:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.019834:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.019835:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.019835:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.019840:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.019843:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.019850:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.019851:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.019857:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49400, rc 0) 00010000:00010000:0.0:1746147139.019857:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9800, rc 0) 00000100:00100000:2.0:1746147139.019882:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967307872640:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 104us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.019882:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307872768:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 73us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.019887:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14342 00000100:00100000:2.0:1746147139.019889:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14341 00000100:00100000:0.0:1746147139.019897:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14343 00000100:00100000:0.0:1746147139.019901:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307872896:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147139.019906:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.019914:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77724 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147139.019928:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141742, atime: 0x68141742, ctime: 0x68141742, blocks: 0x1008 00010000:00010000:0.0:1746147139.019937:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.019938:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.019942:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.020052:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.020058:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9c00, rc 0) 00000100:00100000:0.0:1746147139.020075:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307872896:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 174us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.020080:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14343 00000100:00100000:0.0:1746147139.020613:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.020725:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307873152 00000100:00100000:3.0:1746147139.020729:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307873152 00000100:00100000:3.0:1746147139.020764:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15212 00000100:00100000:3.0:1746147139.020769:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32161:x1830967307873152:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.020783:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.020804:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505573c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7772b expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.020856:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020866:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020877:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020885:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020890:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020894:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020966:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.020974:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.020980:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.021000:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.021021:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 8 pid: 16099 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.021031:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310641792:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.021107:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.022336:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310641792:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.022351:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147139.022537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.023382:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307873280 00000100:00100000:1.0:1746147139.023388:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307873280 00010000:00010000:1.0:1746147139.023416:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 9 pid: 16099 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746147139.023496:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6256 00000100:00100000:1.0:1746147139.023503:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307873280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.023515:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.023520:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 9 pid: 16099 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.023534:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 9 pid: 16099 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.023550:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250556b7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776e5 expref: 9 pid: 16099 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.023575:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.023579:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.023585:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.023591:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.023965:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.024063:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307873280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 559us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.024069:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6256 00010000:00010000:3.0:1746147139.024514:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024521:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.024533:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147139.024617:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024627:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024632:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024637:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.024640:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024645:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024653:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.024656:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147139.024658:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024662:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055751 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024687:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024696:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024700:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024704:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fd200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.024706:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.024710:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025256:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147139.025258:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.025260:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025265:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd200/0x3139939425055743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025273:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025276:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025280:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025283:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.025285:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025292:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025297:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dd400) 00010000:00010000:3.0:1746147139.025299:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.025301:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025305:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x313993942505574a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.025344:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505573c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7772b expref: 28 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.025355:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505573c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7772b expref: 28 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.025362:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fcc00, rc 0) 00000100:00100000:3.0:1746147139.025655:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32161:x1830967307873152:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4885us (5041us total) trans 8589935873 rc 301/301 00000100:00100000:3.0:1746147139.025661:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15212 00000100:00100000:0.0:1746147139.072987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.074031:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307873536 00000100:00100000:3.0:1746147139.074039:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307873536 00000100:00100000:3.0:1746147139.074116:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15213 00000100:00100000:3.0:1746147139.074123:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:32163:x1830967307873536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.074142:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.074156:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x313993942505575f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77732 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.074220:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074231:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074240:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074251:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074255:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074260:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074336:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074343:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074349:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.074356:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147139.074408:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074413:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074421:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074426:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.074429:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074434:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074443:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.074445:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147139.074448:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074452:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x3139939425055774 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074468:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074472:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074477:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074481:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fd800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.074482:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074486:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074495:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147139.074497:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.074499:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074502:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074508:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074512:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074515:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074518:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fcc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.074520:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074524:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074529:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dd800) 00010000:00010000:3.0:1746147139.074531:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.074532:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074536:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505576d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.074563:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x313993942505575f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77732 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.074569:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x313993942505575f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77732 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.074576:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fc800, rc 0) 00000100:00100000:3.0:1746147139.074635:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:32163:x1830967307873536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 512us (1655us total) trans 8589935874 rc 301/301 00000100:00100000:3.0:1746147139.074641:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15213 00000100:00100000:0.0:1746147139.180371:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.180800:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307873664 00000100:00100000:2.0:1746147139.180809:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307873664 00000100:00100000:2.0:1746147139.180861:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15214 00000100:00100000:2.0:1746147139.180868:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32161:x1830967307873664:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147139.180888:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.180907:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055782 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77739 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.180954:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055782 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77739 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.180967:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055782 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77739 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.180982:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147139.180984:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147139.180987:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1fa00, rc 0) 00000100:00100000:2.0:1746147139.181045:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32161:x1830967307873664:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 177us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.181050:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15214 00000100:00100000:0.0:1746147139.184626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.184968:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307873920 00000100:00100000:3.0:1746147139.184976:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307873920 00000100:00100000:3.0:1746147139.185162:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15215 00000100:00100000:3.0:1746147139.185170:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ccf8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32167:x1830967307873920:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.185187:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.185202:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77740 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.185263:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185273:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185282:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185293:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185298:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185307:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185380:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185387:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185393:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.185400:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147139.185454:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185460:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185465:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185470:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fcc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.185473:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185479:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185488:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.185490:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147139.185493:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185501:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x313993942505579e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185523:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185527:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185531:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185535:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fd600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.185537:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185540:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185546:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147139.185547:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.185549:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185553:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425055790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185559:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.185563:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.189578:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.189587:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.189591:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.189599:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.189613:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dde00) 00010000:00010000:3.0:1746147139.189616:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.189618:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.189623:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425055797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.189683:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055789 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77740 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.189690:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x3139939425055789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77740 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.189697:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fc000, rc 0) 00000100:00100000:3.0:1746147139.189754:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ccf8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32167:x1830967307873920:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4584us (5134us total) trans 8589935875 rc 301/301 00000100:00100000:3.0:1746147139.189762:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15215 00000100:00100000:1.0:1746147139.190197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.190725:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307874176 00000100:00100000:3.0:1746147139.190732:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307874176 00000100:00100000:3.0:1746147139.190770:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15216 00000100:00100000:3.0:1746147139.190777:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32161:x1830967307874176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.190791:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.190793:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147139.190806:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055782 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77739 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.190815:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.190818:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147139.190826:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250557ac lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77747 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.190860:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.190870:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.190876:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.190881:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.190903:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.190914:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 7 pid: 7238 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.190924:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310641920:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147139.194929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.194983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.195022:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307874304 00000100:00100000:2.0:1746147139.195030:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307874304 00000100:00100000:2.0:1746147139.195065:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307874432 00000100:00100000:2.0:1746147139.195067:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307874432 00000100:00100000:1.0:1746147139.195074:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15217 00000100:00100000:1.0:1746147139.195083:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32167:x1830967307874304:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147139.195109:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15218 00000100:00100000:2.0:1746147139.195115:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:32163:x1830967307874432:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147139.195119:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.195126:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.195134:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77755 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.195134:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x31399394250557ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7774e expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.195135:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.195147:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 7 pid: 16099 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.195158:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310642048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.195172:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.195179:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.195191:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.195204:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.195214:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147139.195217:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147139.195219:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.195224:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e600, rc 0) 00000100:00100000:2.0:1746147139.195244:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32163:x1830967307874432:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 130us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.195250:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15218 00000100:00100000:3.0:1746147139.195282:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147139.195602:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.195612:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.195618:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147139.197532:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.197568:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.197619:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310641920:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.197627:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310642048:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.197646:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00000100:00100000:2.0:1746147139.197707:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307874560 00000100:00100000:2.0:1746147139.197712:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307874560 00010000:00010000:2.0:1746147139.197737:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 8 pid: 7238 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.197768:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307874688 00000100:00100000:2.0:1746147139.197771:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307874688 00010000:00010000:2.0:1746147139.197779:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 9 pid: 16099 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.197794:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6257 00000100:00100000:3.0:1746147139.197801:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307874560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.197811:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.197816:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 9 pid: 7238 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.197826:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 9 pid: 7238 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.197842:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099055a00/0x31399394250556fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776f3 expref: 9 pid: 7238 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.197853:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.197857:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.197863:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.197868:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.197872:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.197877:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.197904:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307874560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.198168:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6258 00000100:00100000:2.0:1746147139.198174:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307874688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147139.198182:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147139.198186:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 8 pid: 16099 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.198198:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 8 pid: 16099 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.198207:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x313993942505570b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e776fa expref: 8 pid: 16099 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.198224:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147139.198228:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147139.198233:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.198239:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.198448:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.198455:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147139.198461:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.198466:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147139.198478:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147139.198495:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2003:x1830967307874688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 322us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.198504:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6258 00010000:00010000:2.0:1746147139.198545:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147139.198550:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16099 initiator: MDT0 00000040:00080000:2.0:1746147139.198733:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].559, 88 off57248 00000004:00080000:2.0:1746147139.198738:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677188648452ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.198787:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].500, 88 off52056 00000004:00080000:2.0:1746147139.198792:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677188702102ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147139.198816:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].501, 88 off52144 00000004:00080000:2.0:1746147139.198819:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677188729142ns, next at 554081490131ns, rc = 0 00000100:00100000:3.0:1746147139.199531:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6257 00000040:00080000:2.0:1746147139.200216:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].561, 88 off57432 00000004:00080000:2.0:1746147139.200224:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190133886ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200251:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].562, 88 off57520 00000004:00080000:2.0:1746147139.200253:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190163996ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200264:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].502, 88 off52232 00000004:00080000:2.0:1746147139.200267:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677190177259ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147139.200285:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].503, 88 off52320 00000004:00080000:2.0:1746147139.200289:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677190198781ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147139.200296:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].504, 88 off52408 00000004:00080000:2.0:1746147139.200299:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677190209521ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147139.200316:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].563, 88 off57608 00000004:00080000:2.0:1746147139.200319:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190229142ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200327:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].505, 88 off52496 00000004:00080000:2.0:1746147139.200329:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677190239453ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147139.200349:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].564, 88 off57696 00000004:00080000:2.0:1746147139.200351:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190261987ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200359:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].506, 88 off52584 00000004:00080000:2.0:1746147139.200362:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677190272287ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147139.200368:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].565, 88 off57784 00000004:00080000:2.0:1746147139.200371:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190281443ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200378:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].566, 88 off57872 00000004:00080000:2.0:1746147139.200380:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190290439ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200387:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].567, 88 off57960 00000004:00080000:2.0:1746147139.200389:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190299541ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200395:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].568, 88 off58048 00000004:00080000:2.0:1746147139.200398:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677190308249ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147139.200404:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].507, 88 off52672 00000004:00080000:2.0:1746147139.200406:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 677190316819ns, next at 554081490131ns, rc = 0 00000100:00100000:0.0:1746147139.204274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.204323:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307874944 00000100:00100000:1.0:1746147139.204332:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307874944 00000100:00100000:1.0:1746147139.205051:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15219 00000100:00100000:1.0:1746147139.205060:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:32169:x1830967307874944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147139.205077:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.205115:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x31399394250557cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7775c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.205347:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.205359:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.205486:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.205498:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.205503:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.205507:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000001:00080000:3.0:1746147139.205508:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935876 is committed 00000004:00080000:3.0:1746147139.205514:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 502 committed 00000004:00080000:3.0:1746147139.205521:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 560 committed 00000004:00080000:3.0:1746147139.205526:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 559 committed 00000004:00080000:3.0:1746147139.205527:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 558 committed 00000004:00080000:3.0:1746147139.205528:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 557 committed 00000004:00080000:3.0:1746147139.205530:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 501 committed 00000004:00080000:3.0:1746147139.205531:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 556 committed 00000004:00080000:3.0:1746147139.205533:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 500 committed 00000004:00080000:3.0:1746147139.205534:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 555 committed 00000004:00080000:3.0:1746147139.205535:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 499 committed 00000004:00080000:3.0:1746147139.205537:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 498 committed 00000004:00080000:3.0:1746147139.205538:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 497 committed 00000004:00080000:3.0:1746147139.205539:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 554 committed 00000004:00080000:3.0:1746147139.205541:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 553 committed 00000004:00080000:3.0:1746147139.205542:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 496 committed 00000004:00080000:3.0:1746147139.205543:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 495 committed 00000004:00080000:3.0:1746147139.205545:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 552 committed 00000001:00080000:3.0:1746147139.205550:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935874 is committed 00010000:00010000:3.0:1746147139.205693:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.205701:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.205703:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147139.205705:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.205712:0:16099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.205716:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.205722:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.205728:0:16099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.205733:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.205754:0:16099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.205764:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310642304:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.205843:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.205920:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.205950:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.205952:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310642560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.205970:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.205970:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.205983:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.205983:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310643072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.205993:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147139.205994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.205997:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.206017:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147139.206021:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310642688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.206023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.206033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.206034:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.206043:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310643200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.206045:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.206054:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.206063:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310642176 00000100:00100000:2.0:1746147139.206066:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310642176 00000100:00100000:0.0:1746147139.206067:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310642560 00000100:00100000:0.0:1746147139.206069:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310642560 00000100:00100000:2.0:1746147139.206105:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310642816 00000100:00100000:2.0:1746147139.206108:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310642816 00010000:00010000:1.0:1746147139.206142:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147139.206149:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643072 00010000:00010000:1.0:1746147139.206149:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147139.206152:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643072 00010000:00010000:1.0:1746147139.206155:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147139.206163:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:0.0:1746147139.206200:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310642432 00000100:00100000:0.0:1746147139.206203:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310642432 00000100:00100000:0.0:1746147139.206214:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310642688 00000100:00100000:0.0:1746147139.206216:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310642688 00000100:00100000:0.0:1746147139.206222:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310642944 00000100:00100000:0.0:1746147139.206223:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310642944 00000100:00100000:0.0:1746147139.206228:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643200 00000100:00100000:0.0:1746147139.206230:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643200 00000100:00100000:0.0:1746147139.206238:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14344 00000100:00100000:0.0:1746147139.206243:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967310642176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147139.206340:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147139.206343:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:0.0:1746147139.206345:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147134 -> 1746147134 00002000:00010000:0.0:1746147139.206346:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00000100:00100000:2.0:1746147139.206348:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14345 00002000:00010000:0.0:1746147139.206348:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:2.0:1746147139.206353:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310642560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.206376:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310642176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (424us total) trans 17179874175 rc 0/0 00000100:00100000:0.0:1746147139.206382:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14344 00000100:00100000:0.0:1746147139.206394:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14346 00002000:00010000:2.0:1746147139.206395:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:2.0:1746147139.206397:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147138 -> 1746147138 00000100:00100000:0.0:1746147139.206398:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310642432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147139.206399:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147137 -> 1746147137 00002000:00010000:2.0:1746147139.206401:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147138 -> 1746147138 00002000:00010000:2.0:1746147139.206403:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:2.0:1746147139.206428:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3766:x1830967310642560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (457us total) trans 17179874176 rc 0/0 00000100:00100000:2.0:1746147139.206433:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14345 00002000:00010000:0.0:1746147139.206433:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147139.206435:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147139.206436:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147136 -> 1746147136 00002000:00010000:0.0:1746147139.206438:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147137 -> 1746147137 00002000:00010000:0.0:1746147139.206440:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147139.206443:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14347 00000100:00100000:2.0:1746147139.206446:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310642688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.206455:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310642432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (432us total) trans 17179874177 rc 0/0 00000100:00100000:0.0:1746147139.206460:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14346 00000100:00100000:0.0:1746147139.206468:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14348 00000100:00100000:0.0:1746147139.206472:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310642944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.206490:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310642688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (456us total) trans 17179874178 rc 0/0 00000100:00100000:2.0:1746147139.206495:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14347 00000100:00100000:2.0:1746147139.206504:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14349 00000100:00100000:2.0:1746147139.206507:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310643200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.206513:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310642944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (467us total) trans 17179874179 rc 0/0 00000100:00100000:0.0:1746147139.206517:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14348 00000100:00100000:0.0:1746147139.206524:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14350 00000100:00100000:0.0:1746147139.206528:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967310642816:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147139.206591:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206598:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206603:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206608:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.206611:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206616:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206624:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.206626:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.206629:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206633:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc600/0x31399394250557e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206654:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206659:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206663:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206667:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206670:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822be00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.206672:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206676:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206682:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.206684:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.206686:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206690:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x31399394250557d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206696:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206701:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206705:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206709:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822b800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.206711:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206715:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206721:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b447b00) 00010000:00010000:1.0:1746147139.206723:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.206725:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206729:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x31399394250557dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147139.206761:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x31399394250557cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7775c expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.206767:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x31399394250557cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7775c expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.206773:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b400, rc 0) 00000100:00100000:1.0:1746147139.206795:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:32169:x1830967307874944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1737us (2529us total) trans 8589935877 rc 301/301 00000100:00100000:1.0:1746147139.206800:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15219 00010000:00010000:1.0:1746147139.206825:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.206830:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147139.206852:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147139.206855:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147139.206862:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.206877:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x31399394250557ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.206885:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.206890:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.206892:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746147139.206893:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b000, rc 0) 00000100:00100000:1.0:1746147139.206907:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32167:x1830967307874304:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11826us (11986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.206911:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15217 00000100:00100000:3.0:1746147139.207037:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14351 00000100:00100000:3.0:1746147139.207042:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310643072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147139.207614:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:2.0:1746147139.207617:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.207619:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147139.207620:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.207622:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000004:00080000:0.0:1746147139.207625:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097094700/2, rc 0, transno 17179874178 00000100:00100000:0.0:1746147139.207632:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310642688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147139.207640:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3ca80/2, rc 0, transno 17179874180 00000100:00100000:2.0:1746147139.207642:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310643200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1134us (1587us total) trans 17179874180 rc 0/0 00000100:00100000:0.0:1746147139.207643:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310643200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.207647:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14349 00000004:00080000:0.0:1746147139.207648:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097095c00/2, rc 0, transno 17179874176 00000100:00100000:0.0:1746147139.207650:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310642560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147139.207672:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097097100/2, rc 0, transno 17179874177 00000100:00100000:2.0:1746147139.207675:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147139.207681:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3d180/2, rc 0, transno 17179874179 00000100:00100000:2.0:1746147139.207683:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147139.207689:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097094380/2, rc 0, transno 17179874175 00000100:00100000:2.0:1746147139.207692:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642176:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147139.207704:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:0.0:1746147139.207706:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:0.0:1746147139.207708:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147139.207710:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147139.207711:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147139.207732:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310642816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1203us (1747us total) trans 17179874181 rc 0/0 00000100:00100000:0.0:1746147139.207737:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14350 00000100:00100000:2.0:1746147139.207752:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.207771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147139.207878:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147139.207880:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147139.207882:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147139.207883:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147139.207885:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:3.0:1746147139.207907:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3766:x1830967310643072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 865us (1912us total) trans 17179874182 rc 0/0 00000100:00100000:3.0:1746147139.207912:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14351 00000100:00100000:0.0:1746147139.208132:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310643584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147139.208530:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643328 00000004:00080000:2.0:1746147139.208531:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3ce00/2, rc 0, transno 17179874181 00000100:00100000:3.0:1746147139.208534:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643328 00000100:00100000:2.0:1746147139.208534:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310642816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147139.208542:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.208558:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.208568:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310644352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.208581:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.208590:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147139.208593:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.208605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.208613:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.208624:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.208630:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643840 00000100:00100000:0.0:1746147139.208633:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643840 00000100:00100000:2.0:1746147139.208639:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310644352 00000100:00100000:2.0:1746147139.208641:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310644352 00000100:00100000:3.0:1746147139.208655:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14352 00000100:00100000:3.0:1746147139.208662:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967310643328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147139.208752:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643456 00000100:00100000:1.0:1746147139.208755:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643456 00000100:00100000:2.0:1746147139.209068:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643968 00000100:00100000:0.0:1746147139.209071:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14353 00000100:00100000:2.0:1746147139.209072:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643968 00000100:00100000:0.0:1746147139.209077:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3764:x1830967310643840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.209082:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14354 00000100:00100000:2.0:1746147139.209086:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3764:x1830967310644352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209138:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14355 00000100:00100000:0.0:1746147139.209143:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967310643968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.209163:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967310644352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (581us total) trans 21474841435 rc 0/0 00000100:00100000:2.0:1746147139.209168:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14354 00000004:00080000:2.0:1746147139.209193:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f087100/2, rc 0, transno 21474841435 00000100:00100000:0.0:1746147139.209194:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967310643968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (568us total) trans 21474841437 rc 0/0 00000100:00100000:2.0:1746147139.209197:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310644352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209199:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14355 00000004:00080000:2.0:1746147139.209203:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f087b80/2, rc 0, transno 21474841437 00000100:00100000:2.0:1746147139.209206:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209213:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.209225:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310643712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147139.209268:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967310643328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 606us (1496us total) trans 17179874183 rc 0/0 00000100:00100000:3.0:1746147139.209272:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14352 00000100:00100000:0.0:1746147139.209314:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310644096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147139.209340:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643584 00000100:00100000:3.0:1746147139.209343:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643584 00000100:00100000:0.0:1746147139.209415:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147139.209665:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310644096 00000100:00100000:2.0:1746147139.209668:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310644096 00000100:00100000:2.0:1746147139.209682:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14356 00000004:00080000:0.0:1746147139.209682:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3f480/2, rc 0, transno 17179874182 00000100:00100000:2.0:1746147139.209686:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3764:x1830967310643456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209686:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310643072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.209700:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14357 00000100:00100000:0.0:1746147139.209705:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967310643584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147139.209729:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147139.209731:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147135 -> 1746147135 00002000:00010000:2.0:1746147139.209733:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147133 -> 1746147133 00002000:00010000:2.0:1746147139.209735:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147135 -> 1746147135 00002000:00010000:2.0:1746147139.209736:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746147139.209736:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147139.209738:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147139.209740:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147132 -> 1746147132 00002000:00010000:0.0:1746147139.209741:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147133 -> 1746147133 00002000:00010000:0.0:1746147139.209743:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147139.209756:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3764:x1830967310643456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1149us total) trans 21474841438 rc 0/0 00000100:00100000:0.0:1746147139.209760:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967310643584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (546us total) trans 21474841439 rc 0/0 00000100:00100000:2.0:1746147139.209761:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14356 00000100:00100000:0.0:1746147139.209764:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14357 00000100:00100000:2.0:1746147139.209770:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14358 00000100:00100000:2.0:1746147139.209774:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967310644096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209779:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147139.209790:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310644224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147139.209809:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147139.209811:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.209813:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147139.209815:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.209816:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147139.209821:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310643712 00000100:00100000:0.0:1746147139.209824:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310643712 00000100:00100000:2.0:1746147139.209831:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967310644096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (416us total) trans 21474841440 rc 0/0 00000100:00100000:0.0:1746147139.209835:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310644224 00000100:00100000:2.0:1746147139.209836:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14358 00000100:00100000:0.0:1746147139.209837:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310644224 00000100:00100000:2.0:1746147139.209843:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14359 00000100:00100000:0.0:1746147139.209846:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14360 00000100:00100000:2.0:1746147139.209847:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967310643712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209850:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967310644224:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147139.209886:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3df80/2, rc 0, transno 21474841438 00000100:00100000:2.0:1746147139.209890:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147139.209895:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3767:x1830967310644224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (89us total) trans 21474841442 rc 0/0 00000004:00080000:2.0:1746147139.209898:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094571880/2, rc 0, transno 17179874183 00000100:00100000:2.0:1746147139.209900:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147139.209900:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14360 00000004:00080000:0.0:1746147139.209917:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084000/2, rc 0, transno 21474841442 00000100:00100000:0.0:1746147139.209920:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310644224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147139.209931:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f087480/2, rc 0, transno 21474841439 00002000:00010000:2.0:1746147139.209934:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746147139.209934:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310643584:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147139.209936:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147139.209937:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147139.209939:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000004:00080000:0.0:1746147139.209939:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084a80/2, rc 0, transno 21474841440 00002000:00010000:2.0:1746147139.209941:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147139.209941:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310644096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147139.209958:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3764:x1830967310643840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 882us (1399us total) trans 21474841436 rc 0/0 00000100:00100000:2.0:1746147139.209963:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14353 00000004:00080000:2.0:1746147139.209978:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085c00/2, rc 0, transno 21474841436 00000100:00100000:2.0:1746147139.209981:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310643840:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147139.209997:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147139.209999:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147138 -> 1746147138 00002000:00010000:2.0:1746147139.210257:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147138 -> 1746147138 00002000:00010000:2.0:1746147139.210259:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147138 -> 1746147138 00002000:00010000:2.0:1746147139.210260:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147139.210283:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967310643712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 435us (503us total) trans 21474841441 rc 0/0 00000100:00100000:2.0:1746147139.210288:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14359 00000004:00080000:0.0:1746147139.210497:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f086680/2, rc 0, transno 21474841441 00000100:00100000:0.0:1746147139.210500:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310643712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147139.211739:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310642304:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147139.211770:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250557ac lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 29 pid: 16099 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147139.211800:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 28 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.211826:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1200, rc 0) 00000100:00100000:3.0:1746147139.211870:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32161:x1830967307874176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 21093us (21674us total) trans 8589935876 rc 0/0 00000100:00100000:3.0:1746147139.211876:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15216 00000100:00100000:0.0:1746147139.213045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.213133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.213197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.213247:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875456 00000100:00100000:3.0:1746147139.213253:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875456 00000100:00100000:3.0:1746147139.213286:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14361 00000100:00100000:3.0:1746147139.213292:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32161:x1830967307875456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.213304:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.213317:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77771 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.213340:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.213346:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.213348:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.213351:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.213754:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.213960:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 11 pid: 12225 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.213977:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310644480:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.214040:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.214054:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875328 00000100:00100000:3.0:1746147139.214057:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875328 00000100:00100000:2.0:1746147139.214063:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875072 00000100:00100000:2.0:1746147139.214066:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875072 00000100:00100000:3.0:1746147139.214079:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15220 00000100:00100000:2.0:1746147139.214107:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5426 00000100:00100000:2.0:1746147139.214112:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:32163:x1830967307875072:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:3.0:1746147139.214117:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:32169:x1830967307875328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.214126:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.214135:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371ca00/0x31399394250557f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7776a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.214182:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00000100:00100000:2.0:1746147139.214184:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32163:x1830967307875072:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 71us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.214190:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5426 00010000:00010000:3.0:1746147139.214192:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.214200:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.214219:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147139.214223:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147139.214233:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.214249:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371ca00/0x31399394250557f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.214260:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.214271:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.214274:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147139.214276:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38e000, rc 0) 00000100:00100000:3.0:1746147139.214295:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:32169:x1830967307875328:12345-192.168.204.25@tcp:101:cat.0 Request processed in 210us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.214300:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15220 00000100:00100000:0.0:1746147139.214709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.215983:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875200 00000100:00100000:1.0:1746147139.215991:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875200 00000100:00100000:1.0:1746147139.216041:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15221 00000100:00100000:1.0:1746147139.216047:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32167:x1830967307875200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147139.216060:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.216073:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055807 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77763 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.216124:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055807 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77763 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.216136:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055807 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77763 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.216149:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.216151:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147139.216154:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd800, rc 0) 00000100:00100000:1.0:1746147139.216197:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32167:x1830967307875200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 149us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.216201:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15221 00000100:00100000:2.0:1746147139.220693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.220740:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.220815:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.220941:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310644480:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.220967:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.220983:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c400, rc 0) 00000100:00100000:3.0:1746147139.221034:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32161:x1830967307875456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7742us (7836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.221042:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14361 00000100:00100000:3.0:1746147139.221065:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875584 00000100:00100000:3.0:1746147139.221069:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875584 00000100:00100000:1.0:1746147139.221076:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875712 00000100:00100000:1.0:1746147139.221081:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875712 00000100:00100000:3.0:1746147139.221108:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875840 00000100:00100000:3.0:1746147139.221110:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875840 00000100:00100000:3.0:1746147139.221125:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14362 00010000:00010000:1.0:1746147139.221126:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 12 pid: 12225 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.221131:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:32163:x1830967307875584:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.221142:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147139.221146:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6259 00000100:00100000:1.0:1746147139.221151:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307875712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.221154:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77778 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.221161:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.221170:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.221175:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 12 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.221178:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.221180:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.221183:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2400256->3145727] (req 2400256->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.221184:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 12 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.221197:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9c00/0x3139939425055735 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77724 expref: 12 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.221202:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.221210:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.221211:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 12 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.221211:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.221216:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.221222:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310644608:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147139.221222:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.221237:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.221244:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310644736:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.221260:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.221264:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.221274:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14363 00000100:00100000:3.0:1746147139.221279:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967307875840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.221285:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.221292:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7777f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.221302:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.221303:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.221308:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.221317:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.221327:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034a00, rc 0) 00000100:00100000:3.0:1746147139.221342:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307875840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 64us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.221347:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14363 00000100:00100000:0.0:1746147139.222119:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.222139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.222152:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.222174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.222183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.222193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.222204:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307875968 00000100:00100000:0.0:1746147139.222207:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307875968 00000100:00100000:0.0:1746147139.222223:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876096 00000100:00100000:0.0:1746147139.222224:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876096 00000100:00100000:0.0:1746147139.222231:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876224 00000100:00100000:0.0:1746147139.222233:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876224 00000100:00100000:0.0:1746147139.222240:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876352 00000100:00100000:0.0:1746147139.222241:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876352 00000100:00100000:0.0:1746147139.222248:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876480 00000100:00100000:0.0:1746147139.222249:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876480 00000100:00100000:0.0:1746147139.222254:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876608 00000100:00100000:0.0:1746147139.222255:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876608 00000100:00100000:0.0:1746147139.222263:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14364 00000100:00100000:0.0:1746147139.222267:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307875968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147139.222274:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.222282:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77786 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.222292:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.222294:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.222298:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.222307:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.222314:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099055a00, rc 0) 00000100:00100000:0.0:1746147139.222334:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307875968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.222338:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14364 00000100:00100000:0.0:1746147139.222348:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14365 00000100:00100000:0.0:1746147139.222353:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307876096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147139.222358:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.222364:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7778d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.222373:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.222374:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.222377:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.222385:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.222391:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00000100:00100000:0.0:1746147139.222406:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307876096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.222413:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14365 00000100:00100000:0.0:1746147139.222421:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14366 00000100:00100000:2.0:1746147139.222464:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14367 00000100:00100000:2.0:1746147139.222470:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307876352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.222480:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.222486:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942505582a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7779b expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.222499:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.222508:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942505582a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7779b expref: 22 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222515:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942505582a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7779b expref: 22 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222526:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8c00, rc 0) 00000100:00100000:2.0:1746147139.222543:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307876352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 74us (369us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147139.222548:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14367 00000100:00100000:2.0:1746147139.222558:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14368 00000100:00100000:2.0:1746147139.222562:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307876480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.222567:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.222572:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425055831 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777a2 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147139.222594:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310644864:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.222636:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.222657:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14369 00000100:00100000:2.0:1746147139.222662:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307876608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.222672:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.222682:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777a9 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.222691:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.222692:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.222696:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222708:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222718:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48c00, rc 0) 00000100:00100000:2.0:1746147139.222732:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307876608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 70us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.222737:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14369 00000100:00100000:2.0:1746147139.222771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.222801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.222810:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876864 00000100:00100000:2.0:1746147139.222813:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876864 00000100:00100000:2.0:1746147139.222826:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307877120 00000100:00100000:2.0:1746147139.222827:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307877120 00000100:00100000:2.0:1746147139.222835:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14370 00000100:00100000:2.0:1746147139.222839:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307876864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.222845:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.222851:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777b7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.222860:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.222861:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.222865:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222873:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222879:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227600, rc 0) 00000100:00100000:2.0:1746147139.222892:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307876864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.222898:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14370 00000100:00100000:2.0:1746147139.222921:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14371 00000100:00100000:2.0:1746147139.222925:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307877120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.222929:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.222933:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098226c00/0x3139939425055846 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777c5 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.222942:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.222946:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098226c00/0x3139939425055846 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777c5 expref: 34 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222953:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098226c00/0x3139939425055846 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777c5 expref: 34 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.222960:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226c00, rc 0) 00000100:00100000:2.0:1746147139.222973:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307877120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 47us (171us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147139.222977:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14371 00000100:00100000:2.0:1746147139.223021:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.223039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.223046:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876736 00000100:00100000:2.0:1746147139.223048:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876736 00000100:00100000:2.0:1746147139.223057:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307876992 00000100:00100000:2.0:1746147139.223058:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307876992 00000100:00100000:2.0:1746147139.223064:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14372 00000100:00100000:2.0:1746147139.223067:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307876736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.223074:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.223079:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777b0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.223086:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.223103:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.223107:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.223114:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.223120:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226400, rc 0) 00000100:00100000:2.0:1746147139.223131:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307876736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.223135:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14372 00000100:00100000:2.0:1746147139.223142:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14373 00000100:00100000:2.0:1746147139.223146:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307876992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.223150:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.223154:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777be expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.223161:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.223162:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.223165:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 34 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.223172:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 34 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.223178:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227e00, rc 0) 00000100:00100000:2.0:1746147139.223186:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307876992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 40us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.223189:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14373 00000100:00100000:2.0:1746147139.223215:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.223255:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.223309:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307877248 00000100:00100000:2.0:1746147139.223312:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307877248 00000100:00100000:2.0:1746147139.223325:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14374 00000100:00100000:2.0:1746147139.223328:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307877248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.223333:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.223338:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x313993942505585b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777cc expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147139.223355:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310644992:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.223373:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.223418:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307876224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147139.223424:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.223429:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77794 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.223437:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.223438:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.223441:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 21 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.223448:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 21 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147139.223453:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c200, rc 0) 00000100:00100000:0.0:1746147139.223467:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307876224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1041us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.223472:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14366 00000100:00100000:3.0:1746147139.223762:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307877376 00000100:00100000:3.0:1746147139.223766:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307877376 00000100:00100000:3.0:1746147139.223787:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 797 00000100:00100000:3.0:1746147139.223791:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307877376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.223799:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.223810:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425055807 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77763 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.223820:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.223823:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.223837:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307877376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 46us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.223841:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 797 00000100:00100000:0.0:1746147139.224071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.224129:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310644608:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147139.224143:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2400256->3145727] (req 2400256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.224151:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d200, rc 0) 00000100:00100000:0.0:1746147139.224168:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32163:x1830967307875584:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3038us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.224173:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14362 00000100:00100000:3.0:1746147139.224305:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307877504 00000100:00100000:3.0:1746147139.224308:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307877504 00010000:00010000:3.0:1746147139.224319:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 13 pid: 12225 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.224335:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6260 00000100:00100000:3.0:1746147139.224339:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307877504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.224345:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.224358:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 13 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.224366:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 13 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.224376:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x313993942505572e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7771d expref: 13 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.224388:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.224390:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.224393:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.224400:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.224415:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.224424:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310645120:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.224448:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.224757:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310644736:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.224768:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.224787:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307875712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3637us (4046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.224793:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6259 00000100:00100000:0.0:1746147139.225875:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:3.0:1746147139.225991:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147138 -> 1746147139 00002000:00010000:3.0:1746147139.225994:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147138 -> 1746147139 00000100:00100000:3.0:1746147139.226014:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310644864:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147139.226033:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425055831 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a2 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.226047:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x3139939425055831 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a2 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.226056:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8800, rc 0) 00000100:00100000:3.0:1746147139.226080:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307876480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3516us (3894us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147139.226085:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14368 00000100:00100000:2.0:1746147139.226122:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307877760 00000100:00100000:2.0:1746147139.226164:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307877760 00002000:00100000:2.0:1746147139.226192:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2867200->2871295) req@ffff88011da9fb80 x1830967307877760/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.226200:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9fb80 with x1830967307877760 ext(2867200->2871295) 00002000:00010000:2.0:1746147139.226204:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9fb80 00000100:00100000:3.0:1746147139.226208:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310644992:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.226219:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3368 00010000:00010000:3.0:1746147139.226222:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x313993942505585b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777cc expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147139.226224:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307877760:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:3.0:1746147139.226229:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x313993942505585b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777cc expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.226236:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227800, rc 0) 00000100:00100000:3.0:1746147139.226250:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307877248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2921us (3035us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147139.226255:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14374 00000100:00100000:2.0:1746147139.226298:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307877760:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 74us (426us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147139.226302:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3368 00002000:00100000:2.0:1746147139.226305:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2867200->2871295) req@ffff88011da9fb80 x1830967307877760/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.226310:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9fb80 with x1830967307877760 ext(2867200->2871295) 00002000:00010000:2.0:1746147139.226312:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9fb80 00000100:00100000:3.0:1746147139.228769:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310645120:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147139.228784:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.228815:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307877504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4474us (4743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.228824:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6260 00000100:00100000:2.0:1746147139.229781:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.230171:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307878016 00000100:00100000:0.0:1746147139.230177:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307878016 00002000:00100000:0.0:1746147139.230210:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2400256->2404351) req@ffff88012e323480 x1830967307878016/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.230218:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e323480 with x1830967307878016 ext(2400256->2404351) 00002000:00010000:0.0:1746147139.230223:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e323480 00000100:00100000:0.0:1746147139.230586:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3369 00000100:00100000:0.0:1746147139.230594:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307878016:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147139.231019:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307878016:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 424us (1238us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147139.231025:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3369 00002000:00100000:0.0:1746147139.231031:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2400256->2404351) req@ffff88012e323480 x1830967307878016/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.231038:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e323480 with x1830967307878016 ext(2400256->2404351) 00002000:00010000:0.0:1746147139.231041:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e323480 00000100:00100000:0.0:1746147139.236680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.236953:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307878144 00000100:00100000:3.0:1746147139.236962:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307878144 00000100:00100000:3.0:1746147139.237021:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14375 00000100:00100000:3.0:1746147139.237028:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32161:x1830967307878144:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.237045:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.237063:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777d3 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.237105:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.237114:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.237115:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.237119:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.237146:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.237156:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 19 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.237166:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310645248:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.237252:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.239238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.239266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.239286:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.239303:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307878400 00000100:00100000:0.0:1746147139.239307:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307878400 00002000:00100000:0.0:1746147139.239337:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011da9ed80 x1830967307878400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.239345:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9ed80 with x1830967307878400 ext(0->1048575) 00002000:00010000:0.0:1746147139.239349:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9ed80 00000100:00100000:0.0:1746147139.239366:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307878656 00000100:00100000:0.0:1746147139.239368:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307878656 00000100:00100000:2.0:1746147139.239369:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307878912 00000100:00100000:2.0:1746147139.239374:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307878912 00002000:00100000:0.0:1746147139.239377:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011da9d880 x1830967307878656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.239383:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d880 with x1830967307878656 ext(1048576->2097151) 00002000:00010000:0.0:1746147139.239385:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9d880 00002000:00100000:2.0:1746147139.239391:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011da9f800 x1830967307878912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147139.239394:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3370 00002000:00100000:2.0:1746147139.239399:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9f800 with x1830967307878912 ext(1048576->2097151) 00000100:00100000:0.0:1746147139.239400:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307878400:12345-192.168.204.25@tcp:3:cat.0 00002000:00010000:2.0:1746147139.239403:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9f800 00000100:00100000:2.0:1746147139.239417:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3371 00000100:00100000:2.0:1746147139.239423:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307878656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.239782:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3372 00000100:00100000:1.0:1746147139.239789:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307878912:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.240255:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.240271:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307879168 00000100:00100000:2.0:1746147139.240274:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307879168 00002000:00100000:2.0:1746147139.240289:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88012e323800 x1830967307879168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.240297:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e323800 with x1830967307879168 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.240300:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e323800 00000100:00100000:2.0:1746147139.240311:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3373 00000100:00100000:2.0:1746147139.240317:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307879168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147139.240476:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310645248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.240496:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 39 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.240514:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034600, rc 0) 00000100:00100000:3.0:1746147139.240541:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32161:x1830967307878144:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3514us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.240547:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14375 00000100:00100000:0.0:1746147139.248665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.248847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.248905:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307879552 00000100:00100000:2.0:1746147139.248914:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307879552 00000100:00100000:3.0:1746147139.248920:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307879680 00000100:00100000:0.0:1746147139.248923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.248925:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307879680 00002000:00100000:2.0:1746147139.248950:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011da9d180 x1830967307879552/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.248959:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d180 with x1830967307879552 ext(0->1048575) 00002000:00010000:2.0:1746147139.248965:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9d180 00000100:00100000:3.0:1746147139.248966:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14376 00000100:00100000:3.0:1746147139.248973:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+9:32163:x1830967307879680:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:0.0:1746147139.248983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.248984:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307879936 00010000:00010000:3.0:1746147139.248985:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147139.248987:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307879936 00000100:00100000:0.0:1746147139.248998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147139.248999:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011da9e680 x1830967307879936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147139.249012:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777da expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147139.249018:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9e680 with x1830967307879936 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.249022:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9e680 00000100:00100000:0.0:1746147139.249029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.249031:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307879808 00000100:00100000:2.0:1746147139.249033:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307879808 00010000:00010000:3.0:1746147139.249036:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.249043:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00100000:2.0:1746147139.249044:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2400256->3145727) req@ffff88011da9ea00 x1830967307879808/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147139.249045:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.249048:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147139.249050:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307880192 00002000:00100000:2.0:1746147139.249051:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9ea00 with x1830967307879808 ext(2400256->3145727) 00000100:00100000:0.0:1746147139.249053:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307880192 00010000:00010000:2.0:1746147139.249057:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 22 pid: 9586 timeout: 777 lvb_type: 0 00002000:00100000:0.0:1746147139.249068:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011da9e300 x1830967307880192/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147139.249069:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 22 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.249072:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147139.249075:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011da9ea00 00002000:00100000:0.0:1746147139.249076:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9e300 with x1830967307880192 ext(1048576->2097151) 00002000:00010000:0.0:1746147139.249079:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9e300 00010000:00010000:3.0:1746147139.249081:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 33 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.249082:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307880320 00000100:00100000:2.0:1746147139.249084:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307880320 00000100:00100000:0.0:1746147139.249108:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1067 00000100:00100000:0.0:1746147139.249113:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967307879808:12345-192.168.204.25@tcp:4:cat.0 00002000:00100000:2.0:1746147139.249115:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011da9c700 x1830967307880320/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147139.249116:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310645376:192.168.204.25@tcp:104: 00002000:00100000:2.0:1746147139.249121:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c700 with x1830967307880320 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.249124:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9c700 00000100:00100000:2.0:1746147139.249132:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3374 00000100:00100000:2.0:1746147139.249137:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967307879552:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147139.249182:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.249264:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3375 00000100:00100000:0.0:1746147139.249269:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967307879936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147139.249287:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3376 00000100:00100000:3.0:1746147139.249293:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307880192:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.249770:0:29478:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:2.0:1746147139.249776:0:29478:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_010' 00000100:00100000:1.0:1746147139.250028:0:29477:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:1.0:1746147139.250037:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3377 00000100:00100000:1.0:1746147139.250043:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307880320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.251520:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307878656:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12092us (12248us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.251529:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3371 00002000:00100000:2.0:1746147139.251537:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011da9d880 x1830967307878656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.251545:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d880 with x1830967307878656 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.251550:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9d880 00000100:00100000:3.0:1746147139.256821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.256890:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307880576 00000100:00100000:3.0:1746147139.256897:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307880576 00002000:00100000:3.0:1746147139.256931:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2867200->3145727) req@ffff880094525f80 x1830967307880576/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.256940:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525f80 with x1830967307880576 ext(2867200->3145727) 00010000:00010000:3.0:1746147139.256947:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 31 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.256957:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 31 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.256963:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094525f80 00000100:00100000:1.0:1746147139.256975:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307878912:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17185us (17685us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.256978:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1068 00000100:00100000:3.0:1746147139.256983:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307880576:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147139.256983:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3372 00002000:00100000:1.0:1746147139.256988:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011da9f800 x1830967307878912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.256995:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9f800 with x1830967307878912 ext(1048576->2097151) 00002000:00010000:1.0:1746147139.256998:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9f800 00000100:00100000:3.0:1746147139.257181:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307878400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17781us (17947us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.257187:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3370 00002000:00100000:3.0:1746147139.257191:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011da9ed80 x1830967307878400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.257199:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9ed80 with x1830967307878400 ext(0->1048575) 00002000:00010000:3.0:1746147139.257203:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9ed80 00000100:00100000:2.0:1746147139.257512:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310645376:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.257533:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 14 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.257545:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034e00, rc 0) 00000100:00100000:2.0:1746147139.257568:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+14:32163:x1830967307879680:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8595us (8911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.257575:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14376 00000100:00100000:2.0:1746147139.266496:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967307879808:12345-192.168.204.25@tcp:4:cat.0 Request processed in 17369us (17500us total) trans 17179874184 rc 0/0 00000100:00100000:2.0:1746147139.266510:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1067 00002000:00100000:2.0:1746147139.266520:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (2400256->3145727) req@ffff88011da9ea00 x1830967307879808/t17179874184(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.266529:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9ea00 with x1830967307879808 ext(2400256->3145727) 00010000:00010000:2.0:1746147139.266540:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 26 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.266552:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 26 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746147139.266558:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011da9ea00 00000100:00100000:3.0:1746147139.271507:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307879168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 31177us (31241us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.271519:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3373 00002000:00100000:3.0:1746147139.271530:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88012e323800 x1830967307879168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.271539:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e323800 with x1830967307879168 ext(1048576->2097151) 00002000:00010000:3.0:1746147139.271545:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e323800 00000100:00100000:0.0:1746147139.272458:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.272485:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307880704 00000100:00100000:0.0:1746147139.272491:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307880704 00010000:00010000:0.0:1746147139.272517:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 26 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746147139.272555:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6261 00000100:00100000:0.0:1746147139.272562:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967307880704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147139.272573:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147139.272585:0:7225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147138 -> 1746147139 00002000:00010000:0.0:1746147139.272588:0:7225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147138 -> 1746147139 00010000:00010000:0.0:1746147139.272592:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 26 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746147139.272601:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 26 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746147139.272620:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x313993942505580e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77778 expref: 26 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746147139.272637:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.272638:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.272645:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.272657:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.272686:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147139.272697:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310645504:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147139.272757:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.272929:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967307879552:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23789us (24080us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.272936:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3374 00002000:00100000:2.0:1746147139.272943:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011da9d180 x1830967307879552/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.272950:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d180 with x1830967307879552 ext(0->1048575) 00002000:00010000:2.0:1746147139.272954:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9d180 00000100:00100000:0.0:1746147139.273876:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307880576:12345-192.168.204.25@tcp:4:cat.0 Request processed in 16890us (17058us total) trans 21474841443 rc 0/0 00000100:00100000:0.0:1746147139.273883:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1068 00002000:00100000:0.0:1746147139.273889:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2867200->3145727) req@ffff880094525f80 x1830967307880576/t21474841443(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.273896:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525f80 with x1830967307880576 ext(2867200->3145727) 00010000:00010000:0.0:1746147139.273903:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 32 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746147139.273913:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 32 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746147139.273918:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094525f80 00000100:00100000:2.0:1746147139.276401:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967307879936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27123us (27469us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.276412:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3375 00002000:00100000:2.0:1746147139.276420:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011da9e680 x1830967307879936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.276427:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9e680 with x1830967307879936 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.276433:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9e680 00000100:00100000:2.0:1746147139.281028:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310645504:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147139.281052:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147139.281128:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307880704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8564us (8670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.281139:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6261 00000100:00100000:0.0:1746147139.282055:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.282216:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307880832 00000100:00100000:2.0:1746147139.282222:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307880832 00010000:00010000:2.0:1746147139.282253:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 32 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.282276:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6262 00000100:00100000:2.0:1746147139.282283:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307880832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147139.282290:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307880192:12345-192.168.204.25@tcp:3:cat.0 Request processed in 32996us (33290us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746147139.282294:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147139.282297:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3376 00002000:00100000:3.0:1746147139.282305:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011da9e300 x1830967307880192/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147139.282308:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 32 pid: 9586 timeout: 777 lvb_type: 0 00002000:00100000:3.0:1746147139.282312:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9e300 with x1830967307880192 ext(1048576->2097151) 00002000:00010000:3.0:1746147139.282316:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9e300 00010000:00010000:2.0:1746147139.282318:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 32 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.282338:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x31399394250557f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77771 expref: 32 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.282364:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.282367:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.282373:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.282385:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.282414:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147139.282425:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310645632:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147139.282476:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.287615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.287650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.287683:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307881088 00000100:00100000:1.0:1746147139.287800:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307880320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 37756us (38769us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147139.287809:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3377 00000100:00100000:2.0:1746147139.287812:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307881344 00000100:00100000:2.0:1746147139.287818:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307881344 00002000:00100000:1.0:1746147139.287820:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011da9c700 x1830967307880320/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.287829:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c700 with x1830967307880320 ext(1048576->2097151) 00002000:00010000:1.0:1746147139.287833:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9c700 00002000:00100000:2.0:1746147139.287847:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3665920->3670015) req@ffff88011da9d500 x1830967307881344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.287855:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d500 with x1830967307881344 ext(3665920->3670015) 00002000:00010000:2.0:1746147139.287858:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9d500 00000100:00100000:2.0:1746147139.287874:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3378 00000100:00100000:2.0:1746147139.287880:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307881344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.287881:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310645632:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.287896:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.287915:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307880832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5632us (5862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.287922:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6262 00000100:00100000:3.0:1746147139.287968:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307881088 00000100:00100000:2.0:1746147139.287973:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307881344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 92us (321us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147139.287979:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3378 00002000:00100000:2.0:1746147139.287983:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3665920->3670015) req@ffff88011da9d500 x1830967307881344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.287987:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88011da9ca80 x1830967307881088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.287991:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d500 with x1830967307881344 ext(3665920->3670015) 00002000:00100000:3.0:1746147139.287993:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9ca80 with x1830967307881088 ext(2097152->3145727) 00002000:00010000:2.0:1746147139.287993:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9d500 00002000:00010000:3.0:1746147139.287996:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9ca80 00000100:00100000:2.0:1746147139.288018:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3379 00000100:00100000:2.0:1746147139.288024:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307881088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.288961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.289034:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307881600 00000100:00100000:1.0:1746147139.289038:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307881600 00002000:00100000:1.0:1746147139.289055:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2138112->2142207) req@ffff88011da9df80 x1830967307881600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.289062:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9df80 with x1830967307881600 ext(2138112->2142207) 00002000:00010000:1.0:1746147139.289065:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9df80 00000100:00100000:1.0:1746147139.289110:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3380 00000100:00100000:1.0:1746147139.289116:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307881600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.289175:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307881600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 60us (809us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147139.289181:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3380 00002000:00100000:1.0:1746147139.289185:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2138112->2142207) req@ffff88011da9df80 x1830967307881600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.289192:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9df80 with x1830967307881600 ext(2138112->2142207) 00002000:00010000:1.0:1746147139.289195:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9df80 00000100:00100000:0.0:1746147139.296266:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.296570:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.296604:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307881856 00000100:00100000:3.0:1746147139.296605:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882112 00000100:00100000:3.0:1746147139.296610:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882112 00000100:00100000:0.0:1746147139.296610:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307881856 00000100:00100000:3.0:1746147139.296648:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5427 00000100:00100000:3.0:1746147139.296654:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:32163:x1830967307882112:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147139.296807:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5428 00000100:00100000:0.0:1746147139.296813:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32161:x1830967307881856:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147139.298171:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32161:x1830967307881856:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1354us (1908us total) trans 8589935879 rc 0/0 00000100:00100000:0.0:1746147139.298179:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5428 00000100:00100000:3.0:1746147139.298230:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32163:x1830967307882112:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1573us (1657us total) trans 8589935878 rc 0/0 00000100:00100000:3.0:1746147139.298237:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5427 00000100:00100000:2.0:1746147139.298397:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307881088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10373us (10790us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.298405:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3379 00002000:00100000:2.0:1746147139.298414:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88011da9ca80 x1830967307881088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.298423:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9ca80 with x1830967307881088 ext(2097152->3145727) 00002000:00010000:2.0:1746147139.298428:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9ca80 00000100:00100000:0.0:1746147139.299320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.299372:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882240 00000100:00100000:2.0:1746147139.299377:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882240 00000100:00100000:2.0:1746147139.299417:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14377 00000100:00100000:2.0:1746147139.299424:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:32169:x1830967307882240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.299435:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.299449:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777e1 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.299469:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.299476:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.299481:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.299484:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.299508:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.299517:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.299524:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310645760:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.299581:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.301693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.301763:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882368 00000100:00100000:3.0:1746147139.301768:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882368 00002000:00100000:3.0:1746147139.301798:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3670015) req@ffff88012f3cdc00 x1830967307882368/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.301807:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967307882368 ext(3145728->3670015) 00010000:00010000:3.0:1746147139.301814:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 35 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.301824:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 35 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.301830:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3cdc00 00000100:00100000:2.0:1746147139.301904:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310645760:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.301921:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.301933:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4000, rc 0) 00000100:00100000:2.0:1746147139.301964:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+22:32169:x1830967307882240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2540us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.301970:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14377 00000100:00100000:1.0:1746147139.302836:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1069 00000100:00100000:1.0:1746147139.302847:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307882368:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147139.304721:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.304793:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882496 00000100:00100000:2.0:1746147139.304800:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882496 00000100:00100000:2.0:1746147139.304832:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14378 00000100:00100000:2.0:1746147139.304838:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32167:x1830967307882496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.304851:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.304867:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777e8 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.304895:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.304905:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.304907:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.304909:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.304931:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.304940:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 9 pid: 12201 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.304949:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310645888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.305018:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.311807:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310645888:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.311876:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.311891:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4200, rc 0) 00000100:00100000:2.0:1746147139.312049:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32167:x1830967307882496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7209us (7331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.312058:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14378 00000100:00100000:2.0:1746147139.313031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.313772:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882624 00000100:00100000:3.0:1746147139.313779:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882624 00002000:00100000:3.0:1746147139.314140:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2142207) req@ffff88012e322d80 x1830967307882624/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.314149:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e322d80 with x1830967307882624 ext(2097152->2142207) 00010000:00010000:3.0:1746147139.314157:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 10 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.314172:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 10 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.314178:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e322d80 00000100:00100000:3.0:1746147139.314208:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1070 00000100:00100000:3.0:1746147139.314214:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307882624:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147139.315570:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307882368:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12720us (13876us total) trans 17179874185 rc 0/0 00000100:00100000:1.0:1746147139.315577:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1069 00002000:00100000:1.0:1746147139.315584:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3670015) req@ffff88012f3cdc00 x1830967307882368/t17179874185(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.316182:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967307882368 ext(3145728->3670015) 00010000:00010000:1.0:1746147139.316192:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 37 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.316204:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 37 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746147139.316215:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3cdc00 00000100:00100000:3.0:1746147139.317360:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307882624:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3142us (4327us total) trans 21474841444 rc 0/0 00000100:00100000:3.0:1746147139.317367:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1070 00002000:00100000:3.0:1746147139.317372:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2142207) req@ffff88012e322d80 x1830967307882624/t21474841444(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.317379:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e322d80 with x1830967307882624 ext(2097152->2142207) 00010000:00010000:3.0:1746147139.317386:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 12 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.317395:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 12 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.317404:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e322d80 00000100:00100000:0.0:1746147139.319181:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.319227:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882752 00000100:00100000:1.0:1746147139.319235:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882752 00010000:00010000:1.0:1746147139.319261:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 37 pid: 12201 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746147139.319302:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6263 00000100:00100000:1.0:1746147139.319308:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307882752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.319319:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.319335:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 37 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.319343:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 37 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.319361:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x3139939425055869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777d3 expref: 37 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.319389:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.319391:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.319397:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.319403:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.319433:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.319443:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310646016:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.319512:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.321677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.321771:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307882880 00000100:00100000:2.0:1746147139.321778:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307882880 00010000:00010000:2.0:1746147139.321806:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 12 pid: 12201 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746147139.321812:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310646016:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.321828:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147139.321842:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6264 00000100:00100000:2.0:1746147139.321848:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307882880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147139.321858:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147139.321859:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307882752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2550us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.321865:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6263 00010000:00010000:2.0:1746147139.321870:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 12 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.321880:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 12 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.321895:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034e00/0x3139939425055870 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777da expref: 12 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.321910:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.321912:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.321918:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.321925:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.321946:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147139.321956:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310646144:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147139.322009:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.324491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.324507:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310646144:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147139.324522:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.324535:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307883136 00000100:00100000:3.0:1746147139.324540:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307883136 00000100:00100000:2.0:1746147139.324562:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307882880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2713us (2891us total) trans 0 rc 0/0 00002000:00100000:3.0:1746147139.324568:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88012f3cd500 x1830967307883136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147139.324570:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6264 00002000:00100000:3.0:1746147139.324575:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cd500 with x1830967307883136 ext(2097152->3145727) 00002000:00010000:3.0:1746147139.324579:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cd500 00000100:00100000:3.0:1746147139.324599:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3381 00000100:00100000:3.0:1746147139.324605:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307883136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.326964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.327804:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307883392 00000100:00100000:1.0:1746147139.327811:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307883392 00002000:00100000:1.0:1746147139.327845:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88012f3cc380 x1830967307883392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.327855:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc380 with x1830967307883392 ext(2097152->3145727) 00002000:00010000:1.0:1746147139.327860:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cc380 00000100:00100000:1.0:1746147139.327951:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3382 00000100:00100000:1.0:1746147139.327959:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307883392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147139.333053:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307883136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8439us (8559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.333065:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3381 00002000:00100000:3.0:1746147139.333075:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88012f3cd500 x1830967307883136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.333084:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cd500 with x1830967307883136 ext(2097152->3145727) 00002000:00010000:3.0:1746147139.333112:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cd500 00000100:00100000:1.0:1746147139.334624:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307883392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6660us (7659us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147139.334632:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3382 00002000:00100000:1.0:1746147139.334639:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88012f3cc380 x1830967307883392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.334652:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc380 with x1830967307883392 ext(2097152->3145727) 00002000:00010000:1.0:1746147139.334656:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cc380 00000100:00100000:0.0:1746147139.337144:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.337373:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307883520 00000100:00100000:2.0:1746147139.337399:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307883520 00000100:00100000:2.0:1746147139.337448:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14379 00000100:00100000:2.0:1746147139.337456:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+11:32169:x1830967307883520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.337470:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.337486:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777ef expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.337506:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.337507:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.337513:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.337524:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.337532:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38cc00, rc 0) 00000100:00100000:2.0:1746147139.337635:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:32169:x1830967307883520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 179us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.337641:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14379 00000100:00100000:1.0:1746147139.341749:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.341784:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307883648 00000100:00100000:2.0:1746147139.341791:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307883648 00000100:00100000:2.0:1746147139.341826:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14380 00000100:00100000:2.0:1746147139.341833:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32167:x1830967307883648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.341851:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.341868:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777f6 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.341889:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.341891:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.341896:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.341909:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.341918:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d200, rc 0) 00000100:00100000:2.0:1746147139.341970:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32167:x1830967307883648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 137us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.341976:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14380 00000100:00100000:0.0:1746147139.344932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.345435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.345518:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307884032 00000100:00100000:1.0:1746147139.345525:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307884032 00002000:00100000:1.0:1746147139.345562:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012f3cc700 x1830967307884032/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.345570:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc700 with x1830967307884032 ext(3145728->4194303) 00002000:00010000:1.0:1746147139.345575:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc700 00000100:00100000:1.0:1746147139.345602:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307884160 00000100:00100000:1.0:1746147139.345605:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307884160 00002000:00100000:1.0:1746147139.345616:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88012f3cce00 x1830967307884160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.345622:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cce00 with x1830967307884160 ext(2097152->4194303) 00002000:00010000:1.0:1746147139.345625:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cce00 00000100:00100000:3.0:1746147139.345631:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3383 00000100:00100000:1.0:1746147139.345635:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3384 00000100:00100000:3.0:1746147139.345639:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307884032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.345639:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307884160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.350527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.350570:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.350653:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307884544 00000100:00100000:2.0:1746147139.350661:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307884544 00002000:00100000:2.0:1746147139.350701:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012f3ced80 x1830967307884544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.350710:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3ced80 with x1830967307884544 ext(3145728->4194303) 00002000:00010000:2.0:1746147139.350715:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3ced80 00000100:00100000:2.0:1746147139.350732:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307884672 00000100:00100000:2.0:1746147139.350735:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307884672 00002000:00100000:2.0:1746147139.350746:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012f3cfb80 x1830967307884672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.350757:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cfb80 with x1830967307884672 ext(3145728->4194303) 00002000:00010000:2.0:1746147139.350761:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cfb80 00000100:00100000:2.0:1746147139.350775:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3385 00000100:00100000:2.0:1746147139.350783:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307884544:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.351466:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3386 00000100:00100000:2.0:1746147139.351473:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307884672:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147139.353577:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307884032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7930us (8642us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.353587:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3383 00002000:00100000:3.0:1746147139.353596:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012f3cc700 x1830967307884032/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.353605:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc700 with x1830967307884032 ext(3145728->4194303) 00002000:00010000:3.0:1746147139.353611:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc700 00000100:00100000:1.0:1746147139.362408:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307884160:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16758us (16964us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147139.362421:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3384 00002000:00100000:1.0:1746147139.362432:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88012f3cce00 x1830967307884160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.362441:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cce00 with x1830967307884160 ext(2097152->4194303) 00002000:00010000:1.0:1746147139.362447:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cce00 00000100:00100000:2.0:1746147139.366612:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307884544:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15824us (16086us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.366620:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3385 00002000:00100000:2.0:1746147139.366629:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012f3ced80 x1830967307884544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.366634:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3ced80 with x1830967307884544 ext(3145728->4194303) 00002000:00010000:2.0:1746147139.366638:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3ced80 00000100:00100000:2.0:1746147139.370470:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307884672:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18991us (19893us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.370478:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3386 00002000:00100000:2.0:1746147139.370486:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012f3cfb80 x1830967307884672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.370493:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cfb80 with x1830967307884672 ext(3145728->4194303) 00002000:00010000:2.0:1746147139.370497:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cfb80 00000100:00100000:0.0:1746147139.383047:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.383364:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307884928 00000100:00100000:2.0:1746147139.383374:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307884928 00002000:00100000:2.0:1746147139.383411:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012f3cc000 x1830967307884928/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.383420:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc000 with x1830967307884928 ext(4194304->4919295) 00002000:00010000:2.0:1746147139.383425:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc000 00000100:00100000:2.0:1746147139.383455:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3387 00000100:00100000:2.0:1746147139.383461:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307884928:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.383655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.383678:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307885184 00000100:00100000:3.0:1746147139.383682:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307885184 00002000:00100000:3.0:1746147139.383700:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012f3cf800 x1830967307885184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.383713:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cf800 with x1830967307885184 ext(4194304->4919295) 00002000:00010000:3.0:1746147139.383717:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cf800 00000100:00100000:3.0:1746147139.383778:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3388 00000100:00100000:3.0:1746147139.383784:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307885184:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.391563:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307884928:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8094us (8517us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147139.391574:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3387 00002000:00100000:2.0:1746147139.391585:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012f3cc000 x1830967307884928/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.391594:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc000 with x1830967307884928 ext(4194304->4919295) 00002000:00010000:2.0:1746147139.391598:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc000 00000100:00100000:3.0:1746147139.394458:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307885184:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10665us (10794us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147139.394468:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3388 00002000:00100000:3.0:1746147139.394476:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012f3cf800 x1830967307885184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.394483:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cf800 with x1830967307885184 ext(4194304->4919295) 00002000:00010000:3.0:1746147139.394489:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cf800 00000100:00100000:0.0:1746147139.398266:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.398423:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307885440 00000100:00100000:3.0:1746147139.398432:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307885440 00000100:00100000:3.0:1746147139.398478:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5429 00000100:00100000:3.0:1746147139.398485:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32169:x1830967307885440:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147139.398675:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:32169:x1830967307885440:12345-192.168.204.25@tcp:35:cat.0 Request processed in 190us (415us total) trans 8589935880 rc 0/0 00000100:00100000:3.0:1746147139.398681:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5429 00000100:00100000:0.0:1746147139.402423:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.402835:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307885696 00000100:00100000:2.0:1746147139.402844:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307885696 00000100:00100000:2.0:1746147139.402898:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5430 00000100:00100000:2.0:1746147139.402906:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32167:x1830967307885696:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147139.403116:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32167:x1830967307885696:12345-192.168.204.25@tcp:35:cat.0 Request processed in 210us (699us total) trans 8589935881 rc 0/0 00000100:00100000:2.0:1746147139.403123:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5430 00000100:00100000:0.0:1746147139.527721:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.527781:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.528657:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307885952 00000100:00100000:3.0:1746147139.528668:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307885952 00000100:00100000:1.0:1746147139.528671:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307886208 00000100:00100000:1.0:1746147139.528676:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307886208 00000100:00100000:3.0:1746147139.528728:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15222 00000100:00100000:3.0:1746147139.528735:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:32176:x1830967307885952:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.528769:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.528787:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eea00/0x3139939425055893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e777fd expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.528858:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.528874:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.528885:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.528897:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.528902:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.528906:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147139.528983:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15223 00000100:00100000:1.0:1746147139.528991:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32177:x1830967307886208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.529034:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.529036:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.529043:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.529045:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250558af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77804 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.529049:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.529058:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147139.529078:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529086:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529111:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529123:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529129:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529135:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.529170:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.529174:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.529178:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.529185:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.529188:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529193:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.529194:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984efe00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.529199:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147139.529199:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147139.529206:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.529219:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.529222:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147139.529227:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.529230:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147139.529232:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558a8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147139.529236:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529240:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529244:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.529247:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529664:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529672:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.529674:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.529677:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529681:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250558cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529709:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529714:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529718:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529726:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529730:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.529732:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529737:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529743:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.529744:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.529747:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529751:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250558bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529758:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529762:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529766:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529770:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.529771:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529776:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529784:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b9e6200) 00010000:00010000:1.0:1746147139.529786:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.529788:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529792:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250558c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.529825:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250558af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77804 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.529833:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250558af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77804 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.529840:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00000100:00100000:1.0:1746147139.529897:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32177:x1830967307886208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 907us (2114us total) trans 8589935883 rc 301/301 00000100:00100000:1.0:1746147139.529904:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15223 00010000:00010000:3.0:1746147139.530371:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530380:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530385:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530390:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984eee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.530393:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530397:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530409:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147139.530411:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.530414:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530419:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x313993942505589a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530428:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530431:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530435:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530438:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ee800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.530439:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530442:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530446:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b9e6200) 00010000:00010000:3.0:1746147139.530447:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.530448:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530451:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee800/0x31399394250558a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.530481:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eea00/0x3139939425055893 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777fd expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.530489:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eea00/0x3139939425055893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777fd expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.530495:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:3.0:1746147139.530521:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:32176:x1830967307885952:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1787us (2811us total) trans 8589935882 rc 301/301 00000100:00100000:3.0:1746147139.530528:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15222 00000100:00100000:0.0:1746147139.577542:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.577681:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307886336 00000100:00100000:2.0:1746147139.577694:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307886336 00000100:00100000:2.0:1746147139.578181:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14381 00000100:00100000:2.0:1746147139.578192:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32177:x1830967307886336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147139.578214:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.578237:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7780b expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.578272:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.578282:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.578290:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.578297:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.578298:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.578302:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1409024->1863679] (req 1409024->1863679) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 33 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.578335:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.578349:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 11 pid: 9584 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.578363:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646272:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.578496:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.578510:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.578518:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646400:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.578547:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.578555:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 10 pid: 12225 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.578562:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646528:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.580425:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.581385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.581445:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646272:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.581453:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646400:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.583864:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307886464 00000100:00100000:3.0:1746147139.583874:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307886464 00010000:00010000:3.0:1746147139.583932:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 12 pid: 9584 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.583983:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6265 00000100:00100000:3.0:1746147139.584004:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307886464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.584018:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.584037:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 12 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.584049:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 12 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.584071:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x313993942505581c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77786 expref: 12 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.584129:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.584184:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307886464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 192us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.584190:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6265 00000100:00100000:0.0:1746147139.585455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.585498:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.585557:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646528:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147139.585589:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1409024->1863679] (req 1409024->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 33 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.585601:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4600, rc 0) 00000100:00100000:0.0:1746147139.585631:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32177:x1830967307886336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7441us (8101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.585638:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14381 00000100:00100000:1.0:1746147139.585684:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307886592 00000100:00100000:1.0:1746147139.585688:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307886592 00000100:00100000:2.0:1746147139.585689:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307886720 00000100:00100000:2.0:1746147139.585692:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307886720 00010000:00010000:2.0:1746147139.585707:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 11 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.585707:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746147139.585728:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6266 00000100:00100000:1.0:1746147139.585733:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967307886592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.585741:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.585754:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.585763:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.585775:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942505584d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b0 expref: 33 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.586234:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.586253:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307886592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 519us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.586258:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6266 00000100:00100000:1.0:1746147139.586268:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6267 00000100:00100000:1.0:1746147139.586273:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307886720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.586278:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.586286:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 11 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.586322:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 11 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.586334:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425055719 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77708 expref: 11 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.586342:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.586343:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.586349:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.586355:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.586376:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.586386:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310646656:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.586422:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.593911:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.593984:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307886976 00000100:00100000:3.0:1746147139.593992:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307886976 00002000:00100000:3.0:1746147139.594052:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1409024->1413119) req@ffff880099156680 x1830967307886976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147139.594056:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310646656:192.168.204.25@tcp:105: 00002000:00100000:3.0:1746147139.594062:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156680 with x1830967307886976 ext(1409024->1413119) 00002000:00010000:3.0:1746147139.594065:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156680 00010000:00010000:2.0:1746147139.594075:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.594104:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3389 00000100:00100000:3.0:1746147139.594110:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307886976:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147139.594129:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307886720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7855us (8630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.594149:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6267 00000100:00100000:3.0:1746147139.594215:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307886976:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 105us (312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147139.594220:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3389 00002000:00100000:3.0:1746147139.594224:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1409024->1413119) req@ffff880099156680 x1830967307886976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.594231:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156680 with x1830967307886976 ext(1409024->1413119) 00002000:00010000:3.0:1746147139.594233:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156680 00000100:00100000:0.0:1746147139.599963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.600043:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307887232 00000100:00100000:2.0:1746147139.600384:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307887232 00002000:00100000:2.0:1746147139.600425:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1859584->1863679) req@ffff880091d97800 x1830967307887232/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.600435:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97800 with x1830967307887232 ext(1859584->1863679) 00002000:00010000:2.0:1746147139.600439:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97800 00000100:00100000:2.0:1746147139.600472:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3390 00000100:00100000:2.0:1746147139.600480:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307887232:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147139.601060:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307887232:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 578us (2974us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147139.601066:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3390 00002000:00100000:2.0:1746147139.601072:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1859584->1863679) req@ffff880091d97800 x1830967307887232/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.601080:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97800 with x1830967307887232 ext(1859584->1863679) 00002000:00010000:2.0:1746147139.601083:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97800 00000100:00100000:0.0:1746147139.604539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.604659:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307887488 00000100:00100000:3.0:1746147139.604671:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307887488 00000100:00100000:3.0:1746147139.605219:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5431 00000100:00100000:3.0:1746147139.605227:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32177:x1830967307887488:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147139.605402:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32177:x1830967307887488:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 176us (874us total) trans 8589935884 rc 0/0 00000100:00100000:3.0:1746147139.605408:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5431 00010000:00010000:0.0:1746147139.621334:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147139.626612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.626674:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307887744 00000100:00100000:3.0:1746147139.626681:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307887744 00000100:00100000:3.0:1746147139.626747:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15224 00000100:00100000:3.0:1746147139.626756:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:32183:x1830967307887744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.626777:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.626792:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x31399394250558e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77812 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.626853:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626864:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626873:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626883:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626888:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626893:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626974:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626981:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.626987:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.627011:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147139.627062:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627067:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627072:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627077:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984efc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.627080:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627085:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627135:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.627138:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147139.627141:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627146:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x31399394250558f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627165:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627170:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627174:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627180:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984efe00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.627181:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627185:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627191:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147139.627193:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.627195:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627199:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efe00/0x31399394250558e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627204:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627208:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627212:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627216:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ef200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.627218:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627222:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627226:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b9e6700) 00010000:00010000:3.0:1746147139.627228:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.627286:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627291:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef200/0x31399394250558ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627321:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x31399394250558e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77812 expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.627332:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eee00/0x31399394250558e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77812 expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.627340:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eee00, rc 0) 00000100:00100000:3.0:1746147139.627465:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:32183:x1830967307887744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 711us (860us total) trans 8589935885 rc 301/301 00000100:00100000:3.0:1746147139.627471:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15224 00000100:00100000:2.0:1746147139.627558:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.627671:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888000 00000100:00100000:3.0:1746147139.627675:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888000 00000100:00100000:3.0:1746147139.627699:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15225 00000100:00100000:3.0:1746147139.627704:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32184:x1830967307888000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.627715:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.627721:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eea00/0x3139939425055903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77819 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.627747:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627753:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627759:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627768:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627772:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627777:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627809:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627815:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627820:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147139.627826:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147139.627851:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627855:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627860:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627864:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.627866:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627870:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627877:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147139.627879:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147139.627881:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627885:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1c00/0x3139939425055918 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627893:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627897:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627900:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627904:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.627906:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627910:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627915:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147139.627917:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.627919:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627922:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942505590a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627928:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627933:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627937:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627940:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147139.627942:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627946:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627951:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b9e6200) 00010000:00010000:3.0:1746147139.627952:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147139.627954:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627958:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425055911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147139.627977:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eea00/0x3139939425055903 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77819 expref: 34 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.627983:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984eea00/0x3139939425055903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77819 expref: 34 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.627989:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:3.0:1746147139.628032:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32184:x1830967307888000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 327us (474us total) trans 8589935886 rc 301/301 00000100:00100000:3.0:1746147139.628037:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15225 00000100:00100000:3.0:1746147139.631734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.631905:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888128 00000100:00100000:0.0:1746147139.631913:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888128 00000100:00100000:0.0:1746147139.631961:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14382 00000100:00100000:0.0:1746147139.631969:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307888128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147139.631985:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.632011:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425055926 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77820 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147139.632060:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646784:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147139.632173:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.634520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.634718:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888256 00000100:00100000:2.0:1746147139.634725:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888256 00000100:00100000:2.0:1746147139.634767:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14383 00000100:00100000:2.0:1746147139.634774:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:32176:x1830967307888256:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147139.634788:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.634802:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77827 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.634830:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.634837:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.634839:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.634842:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.634864:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.634873:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 31 pid: 12201 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.634883:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310646912:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.634951:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00002000:00010000:1.0:1746147139.635041:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746147135 -> 1746147139 00002000:00010000:1.0:1746147139.635046:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147133 -> 1746147139 00002000:00010000:1.0:1746147139.635047:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746147135 -> 1746147139 00000100:00100000:1.0:1746147139.635065:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310646784:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147139.635105:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425055926 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77820 expref: 14 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147139.635110:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147139.635115:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425055926 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77820 expref: 14 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147139.635126:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009a00, rc 0) 00000100:00100000:1.0:1746147139.635153:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307888128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3180us (3421us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147139.635160:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14382 00000100:00100000:2.0:1746147139.635420:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888512 00000100:00100000:2.0:1746147139.635423:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888512 00002000:00100000:2.0:1746147139.635445:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091d95f80 x1830967307888512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 504/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.635453:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95f80 with x1830967307888512 ext(1048576->2097151) 00010000:00010000:2.0:1746147139.635459:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 32 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.635467:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 32 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746147139.635473:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d95f80 00000100:00100000:2.0:1746147139.635483:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1071 00000100:00100000:2.0:1746147139.635488:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307888512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.637897:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310646912:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147139.637926:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 12 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.637941:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81400, rc 0) 00000100:00100000:0.0:1746147139.637987:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+12:32176:x1830967307888256:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3212us (3473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.638003:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14383 00000100:00100000:1.0:1746147139.638011:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.638063:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888640 00000100:00100000:3.0:1746147139.638069:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888640 00002000:00100000:3.0:1746147139.638123:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1409024->1863679) req@ffff880099157480 x1830967307888640/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.638132:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157480 with x1830967307888640 ext(1409024->1863679) 00010000:00010000:3.0:1746147139.638138:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.638149:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.638155:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099157480 00000100:00100000:3.0:1746147139.638174:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1072 00000100:00100000:3.0:1746147139.638181:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307888640:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147139.641369:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307888512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5873us (6251us total) trans 0 rc 593920/593920 00000100:00100000:2.0:1746147139.641379:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1071 00002000:00100000:2.0:1746147139.641387:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091d95f80 x1830967307888512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 504/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.641396:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95f80 with x1830967307888512 ext(1048576->2097151) 00010000:00010000:2.0:1746147139.641405:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.641417:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746147139.641425:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d95f80 00000100:00100000:0.0:1746147139.646037:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.646325:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888768 00000100:00100000:2.0:1746147139.646334:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888768 00000100:00100000:2.0:1746147139.646386:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14384 00000100:00100000:2.0:1746147139.646393:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+12:32183:x1830967307888768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.646406:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.646421:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7782e expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.646447:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.646451:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.646457:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147139.646459:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.646485:0:1136:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.646494:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.646501:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81e00, rc 0) 00000100:00100000:2.0:1746147139.646548:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:32183:x1830967307888768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 155us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.646554:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14384 00000100:00100000:3.0:1746147139.647230:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307888640:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9048us (9218us total) trans 21474841445 rc 0/0 00000100:00100000:3.0:1746147139.647239:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1072 00002000:00100000:3.0:1746147139.647246:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1409024->1863679) req@ffff880099157480 x1830967307888640/t21474841445(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.647254:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157480 with x1830967307888640 ext(1409024->1863679) 00010000:00010000:3.0:1746147139.647259:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.647269:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.647276:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099157480 00000100:00100000:0.0:1746147139.651835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.651968:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307888896 00000100:00100000:2.0:1746147139.651976:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307888896 00010000:00010000:2.0:1746147139.652551:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.652590:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6268 00000100:00100000:2.0:1746147139.652598:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967307888896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147139.652610:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147139.652793:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.652806:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.652824:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x31399394250558d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->1863679) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7780b expref: 34 pid: 12201 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.652852:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.652853:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.652860:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 12 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.652866:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 12 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.653351:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 12 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.653367:0:7225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 12 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.653378:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310647168:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.654130:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.656227:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.656505:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307889152 00000100:00100000:3.0:1746147139.656513:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307889152 00002000:00100000:3.0:1746147139.656553:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880091d94e00 x1830967307889152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.656562:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94e00 with x1830967307889152 ext(2097152->3145727) 00002000:00010000:3.0:1746147139.656567:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94e00 00000100:00100000:3.0:1746147139.656597:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3391 00000100:00100000:3.0:1746147139.656604:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307889152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.657945:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.658018:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310647168:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147139.658035:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147139.658069:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967307888896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5472us (6241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.658078:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6268 00000100:00100000:1.0:1746147139.658185:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307889408 00000100:00100000:1.0:1746147139.658189:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307889408 00002000:00100000:1.0:1746147139.658210:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1728512->1732607) req@ffff880094185180 x1830967307889408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.658219:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185180 with x1830967307889408 ext(1728512->1732607) 00010000:00010000:1.0:1746147139.658226:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 13 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.658243:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 13 pid: 1136 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746147139.658249:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094185180 00000100:00100000:1.0:1746147139.658263:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1073 00000100:00100000:1.0:1746147139.658403:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307889408:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.658549:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307889408:12345-192.168.204.25@tcp:3:cat.0 Request processed in 278us (604us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147139.658555:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1073 00002000:00100000:1.0:1746147139.658560:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1728512->1732607) req@ffff880094185180 x1830967307889408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.658567:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185180 with x1830967307889408 ext(1728512->1732607) 00010000:00010000:1.0:1746147139.658571:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 13 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.658580:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 13 pid: 1136 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746147139.658591:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094185180 00000100:00100000:3.0:1746147139.663755:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307889152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7140us (7522us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.663767:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3391 00002000:00100000:3.0:1746147139.663778:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880091d94e00 x1830967307889152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.663787:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94e00 with x1830967307889152 ext(2097152->3145727) 00002000:00010000:3.0:1746147139.663793:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94e00 00000100:00100000:0.0:1746147139.669366:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.669741:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307889792 00000100:00100000:2.0:1746147139.669749:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307889792 00000100:00100000:0.0:1746147139.669809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.669871:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14385 00000100:00100000:2.0:1746147139.669879:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:32176:x1830967307889792:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147139.669895:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.669909:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77835 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.669935:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.669947:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 32 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.669954:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.669959:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.669961:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.669964:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.669987:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.670008:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 14 pid: 9584 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.670019:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310647296:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.670084:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 32 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.670113:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 32 pid: 1853 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.670120:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310647424:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.670168:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307889664 00000100:00100000:3.0:1746147139.670172:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307889664 00002000:00100000:3.0:1746147139.670195:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1728512->2097151) req@ffff880094187b80 x1830967307889664/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.670202:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187b80 with x1830967307889664 ext(1728512->2097151) 00010000:00010000:3.0:1746147139.670208:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.670216:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.670222:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094187b80 00000100:00100000:3.0:1746147139.670236:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1074 00000100:00100000:3.0:1746147139.670242:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307889664:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:2.0:1746147139.670760:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.670768:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 9 pid: 12225 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.670776:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310647552:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.670794:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.671815:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310647296:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147139.674801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.674826:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.674837:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.674853:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890048 00000100:00100000:0.0:1746147139.674858:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890048 00000100:00100000:2.0:1746147139.674870:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310647424:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147139.674883:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890176 00000100:00100000:0.0:1746147139.674885:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890176 00000100:00100000:2.0:1746147139.674887:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310647552:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147139.674903:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14386 00000100:00100000:0.0:1746147139.674909:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307890048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.674910:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.674921:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80400, rc 0) 00010000:00010000:0.0:1746147139.674921:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147139.674933:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x3139939425055942 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7783c expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147139.674950:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:32176:x1830967307889792:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5073us (5592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.674955:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14385 00000100:00100000:0.0:1746147139.674966:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310647680:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.674967:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14387 00000100:00100000:2.0:1746147139.674971:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307890176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.674976:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.674980:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80e00/0x3139939425055949 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77843 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.674991:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.675010:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80e00/0x3139939425055949 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77843 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147139.675021:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147139.675022:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80e00/0x3139939425055949 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77843 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.675039:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80e00, rc 0) 00000100:00100000:2.0:1746147139.675053:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307890176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (215us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147139.675058:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14387 00000100:00100000:1.0:1746147139.675113:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307889920 00000100:00100000:1.0:1746147139.675117:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307889920 00010000:00010000:1.0:1746147139.675133:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 10 pid: 12225 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746147139.675149:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6269 00000100:00100000:1.0:1746147139.675153:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307889920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.675160:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.675172:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 10 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.675180:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 10 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.675193:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822ba00/0x3139939425055720 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7770f expref: 10 pid: 12225 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.675595:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.675616:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307889920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 462us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.675621:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6269 00000100:00100000:3.0:1746147139.675692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.675710:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890432 00000100:00100000:1.0:1746147139.675713:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890432 00000100:00100000:3.0:1746147139.675724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147139.675724:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 18 pid: 9584 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.675734:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890304 00000100:00100000:3.0:1746147139.675736:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890304 00000100:00100000:1.0:1746147139.675745:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6270 00010000:00010000:3.0:1746147139.675748:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 35 pid: 1853 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746147139.675750:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307890432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.675757:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.675763:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 18 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.675770:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 18 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.675780:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425055823 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7778d expref: 18 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.675787:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.675920:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6271 00000100:00100000:1.0:1746147139.675920:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967307890432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 168us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.675921:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307889664:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5678us (6110us total) trans 21474841446 rc 0/0 00000100:00100000:1.0:1746147139.675925:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6270 00000100:00100000:3.0:1746147139.675926:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307890304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147139.675928:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1074 00010000:00010000:3.0:1746147139.675932:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746147139.675935:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1728512->2097151) req@ffff880094187b80 x1830967307889664/t21474841446(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147139.675939:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 35 pid: 1853 timeout: 777 lvb_type: 1 00002000:00100000:2.0:1746147139.675943:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187b80 with x1830967307889664 ext(1728512->2097151) 00010000:00010000:3.0:1746147139.675948:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 35 pid: 1853 timeout: 777 lvb_type: 1 00010000:00010000:2.0:1746147139.675949:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.675957:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.675959:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098227600/0x313993942505583f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777b7 expref: 35 pid: 1853 timeout: 777 lvb_type: 1 00002000:00010000:2.0:1746147139.675963:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094187b80 00010000:00010000:3.0:1746147139.675969:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.675971:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.675976:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.675982:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.676010:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.676018:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310647808:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.676063:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.677544:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310647680:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147139.677565:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x3139939425055942 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7783c expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147139.677571:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310647808:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147139.677576:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7e600/0x3139939425055942 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7783c expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.677578:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147139.677586:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7e600, rc 0) 00000100:00100000:3.0:1746147139.677686:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307890304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1759us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.677686:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307890048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2776us (2857us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147139.677693:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6271 00000100:00100000:2.0:1746147139.677693:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14386 00000100:00100000:0.0:1746147139.678133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.678190:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890560 00000100:00100000:3.0:1746147139.678195:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890560 00010000:00010000:3.0:1746147139.678210:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.678233:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6272 00000100:00100000:3.0:1746147139.678238:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307890560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.678246:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.678254:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.678262:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.678276:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x313993942505592d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77827 expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.678285:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.678287:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.678291:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.678298:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.678316:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.678325:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310647936:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.678584:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.679593:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.679645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.679702:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890816 00000100:00100000:2.0:1746147139.679707:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890816 00000100:00100000:2.0:1746147139.679728:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307890944 00000100:00100000:2.0:1746147139.679730:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307890944 00000100:00100000:2.0:1746147139.679754:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14388 00000100:00100000:2.0:1746147139.679760:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307890816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.679772:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.679784:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7784a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.679797:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.679799:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.679803:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.679814:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.679827:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:2.0:1746147139.679851:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307890816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.679856:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14388 00000100:00100000:2.0:1746147139.679867:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14389 00000100:00100000:2.0:1746147139.679871:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967307890944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.679877:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.679881:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x3139939425055957 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77851 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.679944:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310647936:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147139.679958:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.679974:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307890560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1736us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.679980:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6272 00000100:00100000:1.0:1746147139.680194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.680233:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310648064:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147139.680253:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307891200 00000100:00100000:3.0:1746147139.680256:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307891200 00002000:00100000:3.0:1746147139.680276:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1449984->1454079) req@ffff880099155880 x1830967307891200/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.680285:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155880 with x1830967307891200 ext(1449984->1454079) 00002000:00010000:3.0:1746147139.680288:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155880 00000100:00100000:3.0:1746147139.680347:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3392 00000100:00100000:3.0:1746147139.680353:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307891200:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.680438:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.680439:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307891200:12345-192.168.204.25@tcp:3:cat.0 Request processed in 86us (244us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147139.680473:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3392 00002000:00100000:3.0:1746147139.680479:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1449984->1454079) req@ffff880099155880 x1830967307891200/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.680486:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155880 with x1830967307891200 ext(1449984->1454079) 00002000:00010000:3.0:1746147139.680488:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155880 00002000:00010000:2.0:1746147139.682043:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147132 -> 1746147139 00002000:00010000:2.0:1746147139.682048:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147132 -> 1746147139 00002000:00010000:2.0:1746147139.682049:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147133 -> 1746147139 00000100:00100000:2.0:1746147139.682060:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310648064:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147139.682082:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x3139939425055957 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77851 expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.682115:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x3139939425055957 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77851 expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.682122:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81a00, rc 0) 00000100:00100000:2.0:1746147139.682150:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967307890944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2278us (2505us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147139.682155:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14389 00000100:00100000:0.0:1746147139.682520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.682582:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307891456 00000100:00100000:2.0:1746147139.682586:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307891456 00000100:00100000:2.0:1746147139.682617:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5432 00000100:00100000:2.0:1746147139.682621:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:32176:x1830967307891456:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147139.682749:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:32176:x1830967307891456:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 127us (231us total) trans 8589935887 rc 0/0 00000100:00100000:2.0:1746147139.682753:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5432 00000100:00100000:0.0:1746147139.683549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.683838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.684039:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307891712 00000100:00100000:3.0:1746147139.684045:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307891712 00002000:00100000:3.0:1746147139.684071:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094185c00 x1830967307891712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.684085:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185c00 with x1830967307891712 ext(1048576->2097151) 00002000:00010000:3.0:1746147139.684114:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094185c00 00000100:00100000:3.0:1746147139.684130:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3393 00000100:00100000:3.0:1746147139.684136:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307891712:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.684199:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307892096 00000100:00100000:1.0:1746147139.684202:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307892096 00002000:00100000:1.0:1746147139.684215:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1454080->2097151) req@ffff880094185f80 x1830967307892096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.684220:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185f80 with x1830967307892096 ext(1454080->2097151) 00002000:00010000:1.0:1746147139.684223:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094185f80 00000100:00100000:1.0:1746147139.684292:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3394 00000100:00100000:1.0:1746147139.684296:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307892096:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147139.684816:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.684982:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307891840 00000100:00100000:2.0:1746147139.684986:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307891840 00000100:00100000:2.0:1746147139.685019:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14390 00000100:00100000:2.0:1746147139.685024:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307891840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.685033:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.685048:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x313993942505595e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77858 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147139.685082:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310648192:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.685291:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.688724:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307892096:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4417us (4877us total) trans 0 rc 643072/643072 00000100:00100000:1.0:1746147139.688736:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3394 00002000:00100000:1.0:1746147139.688747:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1454080->2097151) req@ffff880094185f80 x1830967307892096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.688755:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185f80 with x1830967307892096 ext(1454080->2097151) 00002000:00010000:1.0:1746147139.688760:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094185f80 00000100:00100000:2.0:1746147139.688861:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310648192:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147139.688886:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x313993942505595e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77858 expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.688900:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x313993942505595e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77858 expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.688914:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81c00, rc 0) 00000100:00100000:2.0:1746147139.688935:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307891840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3911us (4119us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147139.688941:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14390 00000100:00100000:3.0:1746147139.690547:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307891712:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6406us (6994us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.690556:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3393 00002000:00100000:3.0:1746147139.690563:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094185c00 x1830967307891712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.690571:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185c00 with x1830967307891712 ext(1048576->2097151) 00002000:00010000:3.0:1746147139.690575:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094185c00 00000100:00100000:0.0:1746147139.693132:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.693262:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307892352 00000100:00100000:3.0:1746147139.693270:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307892352 00000100:00100000:3.0:1746147139.693311:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5433 00000100:00100000:3.0:1746147139.693318:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32184:x1830967307892352:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147139.693479:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32184:x1830967307892352:12345-192.168.204.25@tcp:35:cat.0 Request processed in 160us (390us total) trans 8589935888 rc 0/0 00000100:00100000:3.0:1746147139.693485:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5433 00000100:00100000:0.0:1746147139.706572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.706647:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307892608 00000100:00100000:3.0:1746147139.706655:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307892608 00000100:00100000:3.0:1746147139.706700:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5434 00000100:00100000:3.0:1746147139.706708:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:32183:x1830967307892608:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147139.706895:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:32183:x1830967307892608:12345-192.168.204.25@tcp:35:cat.0 Request processed in 187us (329us total) trans 8589935889 rc 0/0 00000100:00100000:3.0:1746147139.706901:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5434 00000100:00100000:0.0:1746147139.727661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.728187:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307892864 00000100:00100000:1.0:1746147139.728196:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307892864 00000100:00100000:1.0:1746147139.728346:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15226 00000100:00100000:1.0:1746147139.728355:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32189:x1830967307892864:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147139.728373:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.728389:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7785f expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.728450:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728460:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728469:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728480:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728488:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728493:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728572:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728580:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728585:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147139.728593:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147139.728654:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728660:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728664:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728668:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.728671:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728676:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728685:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.728689:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.728692:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728696:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x313993942505597a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728720:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728728:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728732:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728736:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728739:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.728741:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728745:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728752:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.728753:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.728755:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728760:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505596c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728766:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728771:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728775:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728779:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.728780:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728784:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728790:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23a00) 00010000:00010000:1.0:1746147139.728792:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.728794:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728798:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055973 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.728851:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055965 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7785f expref: 36 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.728858:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7785f expref: 36 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.728864:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32800, rc 0) 00000100:00100000:1.0:1746147139.728931:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32189:x1830967307892864:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 576us (1278us total) trans 8589935890 rc 301/301 00000100:00100000:1.0:1746147139.728937:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15226 00000100:00100000:0.0:1746147139.756214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.756338:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307892992 00000100:00100000:2.0:1746147139.756349:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307892992 00000100:00100000:2.0:1746147139.756418:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14391 00000100:00100000:2.0:1746147139.756427:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32189:x1830967307892992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147139.756449:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.756471:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77866 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.756505:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.756513:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.756515:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147139.756519:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.756550:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.756562:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 13 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746147139.756579:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310648320:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.756729:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.759189:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310648320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147139.759205:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147139.759220:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.759237:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80600, rc 0) 00000100:00100000:2.0:1746147139.759285:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32189:x1830967307892992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2859us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.759290:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307893120 00000100:00100000:2.0:1746147139.759293:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14391 00000100:00100000:3.0:1746147139.759301:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307893120 00002000:00100000:3.0:1746147139.759344:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1454079) req@ffff880091d97b80 x1830967307893120/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.759354:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97b80 with x1830967307893120 ext(1048576->1454079) 00010000:00010000:3.0:1746147139.759364:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 14 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.759378:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 14 pid: 1136 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.759385:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d97b80 00000100:00100000:3.0:1746147139.759426:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1075 00000100:00100000:3.0:1746147139.759434:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307893120:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147139.764578:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307893120:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5133us (5362us total) trans 21474841447 rc 0/0 00000100:00100000:3.0:1746147139.764591:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1075 00002000:00100000:3.0:1746147139.764603:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1454079) req@ffff880091d97b80 x1830967307893120/t21474841447(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.764613:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97b80 with x1830967307893120 ext(1048576->1454079) 00010000:00010000:3.0:1746147139.764625:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.764647:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.764654:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d97b80 00000100:00100000:0.0:1746147139.768492:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.768627:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307893248 00000100:00100000:3.0:1746147139.768638:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307893248 00010000:00010000:3.0:1746147139.768678:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.768724:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6273 00000100:00100000:3.0:1746147139.768733:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307893248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.768750:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.768770:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.768784:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.768808:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505593b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77835 expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.768840:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.768842:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.768851:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.768865:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.768902:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.768916:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310648448:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147139.769015:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.770788:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310648448:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147139.770805:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.770844:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307893248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2113us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.770854:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6273 00000100:00100000:0.0:1746147139.771262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.771355:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307893504 00000100:00100000:3.0:1746147139.771361:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307893504 00002000:00100000:3.0:1746147139.771396:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->1724415) req@ffff880099152300 x1830967307893504/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.771406:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152300 with x1830967307893504 ext(1720320->1724415) 00002000:00010000:3.0:1746147139.771411:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152300 00000100:00100000:3.0:1746147139.771972:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3395 00000100:00100000:3.0:1746147139.771982:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307893504:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147139.772218:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307893504:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 237us (956us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147139.772228:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3395 00002000:00100000:3.0:1746147139.772233:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->1724415) req@ffff880099152300 x1830967307893504/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.772241:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152300 with x1830967307893504 ext(1720320->1724415) 00002000:00010000:3.0:1746147139.772244:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152300 00000100:00100000:0.0:1746147139.779261:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.779393:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307893632 00000100:00100000:2.0:1746147139.779404:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307893632 00000100:00100000:2.0:1746147139.779462:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14392 00000100:00100000:2.0:1746147139.779470:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32189:x1830967307893632:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147139.779489:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.779571:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7786d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.779608:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.779618:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 21 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.779631:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.779638:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.779639:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.779642:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.779671:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.779683:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.779696:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310648576:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.779807:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 21 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.779815:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 21 pid: 9584 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.779823:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310648704:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.780015:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.780029:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 11 pid: 17600 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746147139.780038:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310648832:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.780653:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147139.782200:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310648576:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.782214:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310648704:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.782220:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310648832:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147139.782246:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.782262:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81000, rc 0) 00000100:00100000:2.0:1746147139.782299:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32189:x1830967307893632:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2829us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.782307:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14392 00000100:00100000:0.0:1746147139.782621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.782938:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307893760 00000100:00100000:3.0:1746147139.782946:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307893760 00010000:00010000:3.0:1746147139.782972:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 12 pid: 17600 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.783008:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6274 00000100:00100000:3.0:1746147139.783015:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307893760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.783029:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.783048:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 12 pid: 17600 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.783059:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 12 pid: 17600 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.783082:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425055727 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77716 expref: 12 pid: 17600 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.783118:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.783139:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307893760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.783149:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6274 00000100:00100000:0.0:1746147139.783556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.783589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.783594:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307893888 00000100:00100000:1.0:1746147139.783599:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307893888 00010000:00010000:1.0:1746147139.783618:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 22 pid: 9584 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746147139.783640:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307894016 00000100:00100000:1.0:1746147139.783642:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307894016 00000100:00100000:0.0:1746147139.783651:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6275 00010000:00010000:1.0:1746147139.783653:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746147139.783659:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967307893888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147139.783667:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147139.783669:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6276 00000100:00100000:1.0:1746147139.783674:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307894016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147139.783677:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 22 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.783681:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147139.783684:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 22 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746147139.783695:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38c200/0x3139939425055862 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77794 expref: 22 pid: 9584 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746147139.783707:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147139.783726:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967307893888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147139.783731:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6275 00010000:00010000:1.0:1746147139.783812:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.783826:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.783838:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098227e00/0x3139939425055854 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777be expref: 38 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.783849:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.783851:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.783858:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.783865:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.783893:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.783904:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310648960:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.784765:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.785882:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310648960:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.785904:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.785937:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307894016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2261us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.785947:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6276 00000100:00100000:2.0:1746147139.786411:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.786440:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307894272 00000100:00100000:2.0:1746147139.786446:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307894272 00002000:00100000:2.0:1746147139.786483:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1150976->1155071) req@ffff880097095f80 x1830967307894272/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.786493:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095f80 with x1830967307894272 ext(1150976->1155071) 00002000:00010000:2.0:1746147139.786498:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097095f80 00000100:00100000:2.0:1746147139.786513:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3396 00000100:00100000:2.0:1746147139.786522:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307894272:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147139.786874:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307894272:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 352us (463us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147139.786881:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3396 00002000:00100000:2.0:1746147139.786887:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1150976->1155071) req@ffff880097095f80 x1830967307894272/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.786894:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095f80 with x1830967307894272 ext(1150976->1155071) 00002000:00010000:2.0:1746147139.786897:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097095f80 00000100:00100000:0.0:1746147139.789696:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.789873:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307894528 00000100:00100000:3.0:1746147139.789883:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307894528 00000100:00100000:3.0:1746147139.790021:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5435 00000100:00100000:3.0:1746147139.790030:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32189:x1830967307894528:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147139.790401:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32189:x1830967307894528:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 371us (714us total) trans 8589935891 rc 0/0 00000100:00100000:3.0:1746147139.790407:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5435 00000100:00100000:0.0:1746147139.827501:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.827570:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307894784 00000100:00100000:1.0:1746147139.827581:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307894784 00000100:00100000:1.0:1746147139.827648:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15227 00000100:00100000:1.0:1746147139.827657:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:32193:x1830967307894784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147139.827687:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.827712:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77874 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.827793:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827806:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827817:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827832:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827836:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827841:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827933:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827941:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.827945:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147139.827952:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147139.828038:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828044:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828049:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828055:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.828059:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828065:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828075:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.828078:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.828082:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828086:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250559ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828140:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828145:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828149:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828152:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828156:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.828158:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828162:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828168:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.828169:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.828171:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828176:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505599d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828183:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828187:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828191:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828195:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.828197:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828201:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828206:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23400) 00010000:00010000:1.0:1746147139.828208:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.828210:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828215:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.828247:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055996 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77874 expref: 18 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.828254:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77874 expref: 18 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.828262:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00000100:00100000:1.0:1746147139.828322:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:32193:x1830967307894784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 666us (835us total) trans 8589935892 rc 301/301 00000100:00100000:1.0:1746147139.828329:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15227 00000100:00100000:0.0:1746147139.833235:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.833420:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307894912 00000100:00100000:3.0:1746147139.833430:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307894912 00000100:00100000:3.0:1746147139.833490:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14393 00000100:00100000:0.0:1746147139.833497:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.833500:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307894912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.833523:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147139.833541:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895040 00000100:00100000:2.0:1746147139.833545:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895040 00000100:00100000:2.0:1746147139.833569:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14394 00000100:00100000:2.0:1746147139.833574:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307895040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147139.833581:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.833595:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80e00/0x31399394250559c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77882 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.833612:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1e00/0x31399394250559b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7787b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147139.833648:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310649088:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.833648:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310649216:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.833750:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.833905:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00002000:00010000:2.0:1746147139.835545:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147137 -> 1746147139 00002000:00010000:2.0:1746147139.835555:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147136 -> 1746147139 00002000:00010000:2.0:1746147139.835557:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147137 -> 1746147139 00000100:00100000:3.0:1746147139.835565:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310649088:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147139.835570:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310649216:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147139.835596:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1e00/0x31399394250559b9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7787b expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.835596:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80e00/0x31399394250559c0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77882 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.835610:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1e00/0x31399394250559b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7787b expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.835611:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80e00/0x31399394250559c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77882 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.835622:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80e00, rc 0) 00010000:00010000:3.0:1746147139.835635:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1e00, rc 0) 00000100:00100000:2.0:1746147139.835670:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307895040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2095us (2173us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147139.835676:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14394 00000100:00100000:3.0:1746147139.835737:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307894912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2238us (2515us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147139.835743:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14393 00000100:00100000:0.0:1746147139.842263:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.842397:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895168 00000100:00100000:3.0:1746147139.842408:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895168 00000100:00100000:3.0:1746147139.842466:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14395 00000100:00100000:3.0:1746147139.842474:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:32193:x1830967307895168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.842494:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.842512:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77889 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.842543:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.842550:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.842552:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.842555:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.842586:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.842597:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 33 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.842614:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310649344:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.842703:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147139.845226:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310649344:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.845258:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.845278:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eee00, rc 0) 00000100:00100000:3.0:1746147139.845333:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:32193:x1830967307895168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2859us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.845342:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14395 00000100:00100000:0.0:1746147139.845789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.845870:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895296 00000100:00100000:3.0:1746147139.845877:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895296 00002000:00100000:3.0:1746147139.845962:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->2097151) req@ffff880099153100 x1830967307895296/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.845972:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153100 with x1830967307895296 ext(1720320->2097151) 00010000:00010000:3.0:1746147139.845980:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 34 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.846006:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 34 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.846013:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099153100 00000100:00100000:3.0:1746147139.846042:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1076 00000100:00100000:3.0:1746147139.846049:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307895296:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147139.850427:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307895296:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4357us (4620us total) trans 21474841448 rc 0/0 00000100:00100000:3.0:1746147139.850441:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1076 00002000:00100000:3.0:1746147139.850454:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->2097151) req@ffff880099153100 x1830967307895296/t21474841448(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.850464:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153100 with x1830967307895296 ext(1720320->2097151) 00010000:00010000:3.0:1746147139.850476:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746147139.850493:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746147139.850501:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099153100 00000100:00100000:0.0:1746147139.853077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.853213:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895424 00000100:00100000:1.0:1746147139.853223:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895424 00010000:00010000:1.0:1746147139.853259:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746147139.854640:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6277 00000100:00100000:1.0:1746147139.854758:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307895424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.854779:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.854804:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.854819:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.854844:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425055988 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77866 expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.854878:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.854880:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.854888:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.854897:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.854939:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.854952:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310649472:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.855068:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.857882:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310649472:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.857910:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.857950:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307895424:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3299us (4884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.857961:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6277 00000100:00100000:0.0:1746147139.858962:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.859060:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895680 00000100:00100000:3.0:1746147139.859068:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895680 00002000:00100000:3.0:1746147139.859140:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880099151c00 x1830967307895680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.859150:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151c00 with x1830967307895680 ext(1048576->2097151) 00002000:00010000:3.0:1746147139.859155:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151c00 00000100:00100000:3.0:1746147139.859175:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3397 00000100:00100000:3.0:1746147139.859183:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307895680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147139.867317:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307895680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8123us (8349us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147139.867330:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3397 00002000:00100000:3.0:1746147139.867342:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880099151c00 x1830967307895680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147139.867351:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151c00 with x1830967307895680 ext(1048576->2097151) 00002000:00010000:3.0:1746147139.867356:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151c00 00000100:00100000:0.0:1746147139.870565:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.871355:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895808 00000100:00100000:3.0:1746147139.871367:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895808 00000100:00100000:3.0:1746147139.871429:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14396 00000100:00100000:3.0:1746147139.871437:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:32193:x1830967307895808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.871453:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.871471:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77890 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.871496:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.871504:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.871505:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147139.871508:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.871539:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.871550:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 36 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.871560:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310649600:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.871655:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.873837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.874004:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307895936 00000100:00100000:2.0:1746147139.874010:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307895936 00002000:00100000:2.0:1746147139.874048:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1155071) req@ffff880099151f80 x1830967307895936/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.874057:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151f80 with x1830967307895936 ext(1048576->1155071) 00010000:00010000:2.0:1746147139.874064:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 37 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.874075:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 37 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746147139.874082:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099151f80 00000100:00100000:3.0:1746147139.874133:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310649600:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147139.874137:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1077 00000100:00100000:2.0:1746147139.874144:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307895936:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:3.0:1746147139.874152:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.874163:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984efc00, rc 0) 00000100:00100000:3.0:1746147139.874212:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:32193:x1830967307895808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2776us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.874218:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14396 00000100:00100000:2.0:1746147139.877775:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967307895936:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 3622us (3935us total) trans 17179874186 rc 0/0 00000100:00100000:2.0:1746147139.877785:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1077 00002000:00100000:2.0:1746147139.877795:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1155071) req@ffff880099151f80 x1830967307895936/t17179874186(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/448 e 0 to 0 dl 1746147150 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.877804:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151f80 with x1830967307895936 ext(1048576->1155071) 00010000:00010000:2.0:1746147139.877811:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 39 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746147139.877829:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 39 pid: 9586 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746147139.877836:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099151f80 00000100:00100000:0.0:1746147139.880136:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.880199:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307896064 00000100:00100000:1.0:1746147139.880285:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307896064 00010000:00010000:1.0:1746147139.880316:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 39 pid: 9586 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746147139.880350:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6278 00000100:00100000:1.0:1746147139.880356:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307896064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.880368:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.880384:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 39 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.880396:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 39 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.880420:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505598f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7786d expref: 39 pid: 9586 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.880449:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.880451:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.880457:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.880465:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.880492:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.880502:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310649728:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.880574:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.883450:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310649728:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.883477:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.883522:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307896064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3164us (3390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.883533:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6278 00000100:00100000:0.0:1746147139.885816:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.885917:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307896320 00000100:00100000:2.0:1746147139.885925:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307896320 00002000:00100000:2.0:1746147139.885972:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880099152680 x1830967307896320/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.885981:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967307896320 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.885987:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152680 00000100:00100000:2.0:1746147139.886026:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3398 00000100:00100000:2.0:1746147139.886034:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307896320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.895554:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307896320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9513us (9738us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.895575:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3398 00002000:00100000:2.0:1746147139.895583:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880099152680 x1830967307896320/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.895589:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967307896320 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.895597:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152680 00000100:00100000:0.0:1746147139.911354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.911462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.911571:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307896576 00000100:00100000:3.0:1746147139.911580:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307896576 00000100:00100000:3.0:1746147139.912039:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5436 00000100:00100000:1.0:1746147139.912189:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307896832 00000100:00100000:3.0:1746147139.912207:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:32193:x1830967307896576:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147139.912207:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307896832 00000100:00100000:1.0:1746147139.912640:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15228 00000100:00100000:1.0:1746147139.912649:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:32195:x1830967307896832:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147139.912663:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.912682:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250559d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77897 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.912761:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.912772:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.912782:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.912793:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.912798:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.912803:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913289:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913310:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913318:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147139.913329:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147139.913527:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913537:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147139.913540:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:32193:x1830967307896576:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1336us (2197us total) trans 8589935893 rc 0/0 00010000:00010000:1.0:1746147139.913543:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913547:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:3.0:1746147139.913548:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5436 00010000:00010000:1.0:1746147139.913550:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913555:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913564:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.913567:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.913570:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913574:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x31399394250559ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913588:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913592:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913596:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913601:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913604:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.913606:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913610:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913615:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.913617:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.913619:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913622:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250559dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913628:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913632:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913636:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913638:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.913639:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913643:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913647:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23100) 00010000:00010000:1.0:1746147139.913648:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.913650:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913657:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x31399394250559e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.913681:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250559d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77897 expref: 20 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.913688:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250559d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77897 expref: 20 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.913695:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:1.0:1746147139.913714:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:32195:x1830967307896832:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1067us (2259us total) trans 8589935894 rc 301/301 00000100:00100000:1.0:1746147139.913720:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15228 00000100:00100000:0.0:1746147139.915043:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.915362:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307897088 00000100:00100000:1.0:1746147139.915369:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307897088 00000100:00100000:1.0:1746147139.915418:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15229 00000100:00100000:1.0:1746147139.915424:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32198:x1830967307897088:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147139.915442:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.915453:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33a00/0x31399394250559f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7789e expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.915504:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915513:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915521:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915533:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915537:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915541:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915604:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915613:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915618:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147139.915625:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147139.915666:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915672:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915677:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915680:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.915683:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915688:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915696:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.915698:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.915701:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915704:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425055a0d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915718:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915722:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915725:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915729:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915733:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.915735:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915739:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915744:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.915746:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.915748:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915752:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x31399394250559ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915758:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915762:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915766:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915769:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.915771:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915775:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915780:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23400) 00010000:00010000:1.0:1746147139.915781:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.915784:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915788:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425055a06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.915812:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33a00/0x31399394250559f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7789e expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.915818:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33a00/0x31399394250559f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7789e expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.915825:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33a00, rc 0) 00000100:00100000:1.0:1746147139.915864:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32198:x1830967307897088:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 439us (825us total) trans 8589935895 rc 301/301 00000100:00100000:1.0:1746147139.915870:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15229 00000100:00100000:0.0:1746147139.920246:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.920305:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307897344 00000100:00100000:1.0:1746147139.920313:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307897344 00000100:00100000:1.0:1746147139.920363:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15230 00000100:00100000:1.0:1746147139.920370:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32200:x1830967307897344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147139.920387:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147139.920402:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425055a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778a5 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.920500:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920512:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920520:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920531:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920536:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920541:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920621:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920629:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920635:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147139.920642:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147139.920696:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920701:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920706:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920710:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.920714:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920719:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920727:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147139.920730:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147139.920733:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920738:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425055a30 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920751:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920760:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920767:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920771:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920774:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.920775:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920780:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920785:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147139.920786:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.920788:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920792:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x3139939425055a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920798:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920802:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920806:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920809:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147139.920811:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920817:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920822:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23200) 00010000:00010000:1.0:1746147139.920823:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147139.920825:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920829:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425055a29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147139.920858:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425055a1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778a5 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.920865:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425055a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778a5 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.920871:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:1.0:1746147139.920944:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32200:x1830967307897344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 572us (705us total) trans 8589935896 rc 301/301 00000100:00100000:1.0:1746147139.920950:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15230 00000100:00100000:0.0:1746147139.925948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.926002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.926033:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307897472 00000100:00100000:3.0:1746147139.926040:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307897472 00000100:00100000:2.0:1746147139.926048:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307897600 00000100:00100000:2.0:1746147139.926051:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307897600 00000100:00100000:3.0:1746147139.926144:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14397 00000100:00100000:3.0:1746147139.926152:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307897472:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147139.926157:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14398 00000100:00100000:2.0:1746147139.926162:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307897600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147139.926167:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147139.926167:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.926180:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778ac expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147139.926180:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778b3 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.926198:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.926198:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.926199:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147139.926200:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.926206:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.926206:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 39 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.926218:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147139.926218:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 39 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.926227:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0200, rc 0) 00010000:00010000:2.0:1746147139.926227:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80400, rc 0) 00000100:00100000:2.0:1746147139.926261:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967307897600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147139.926266:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14398 00000100:00100000:3.0:1746147139.926417:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307897472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 265us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.926422:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14397 00000100:00100000:0.0:1746147139.935549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.935667:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307897856 00000100:00100000:2.0:1746147139.935678:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307897856 00002000:00100000:2.0:1746147139.935725:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091d95500 x1830967307897856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.935736:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95500 with x1830967307897856 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.935741:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d95500 00000100:00100000:2.0:1746147139.935765:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3399 00000100:00100000:2.0:1746147139.935772:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307897856:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.939353:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.939400:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.939479:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307898112 00000100:00100000:2.0:1746147139.939488:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307898112 00002000:00100000:2.0:1746147139.939525:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880091d97480 x1830967307898112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.939534:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97480 with x1830967307898112 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.939539:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97480 00000100:00100000:2.0:1746147139.939554:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307898368 00000100:00100000:2.0:1746147139.939556:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307898368 00002000:00100000:2.0:1746147139.939564:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db17100 x1830967307898368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.939571:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17100 with x1830967307898368 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.939573:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17100 00000100:00100000:2.0:1746147139.939583:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3400 00000100:00100000:2.0:1746147139.939590:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307898112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.939722:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3401 00000100:00100000:0.0:1746147139.939728:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967307898368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.946791:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307897856:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11005us (11241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.946806:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3399 00002000:00100000:2.0:1746147139.946820:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091d95500 x1830967307897856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.946829:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95500 with x1830967307897856 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.946835:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d95500 00000100:00100000:2.0:1746147139.952946:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307898112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13343us (13589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147139.952958:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3400 00002000:00100000:2.0:1746147139.952970:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880091d97480 x1830967307898112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.952979:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97480 with x1830967307898112 ext(1048576->2097151) 00002000:00010000:2.0:1746147139.952985:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97480 00000100:00100000:1.0:1746147139.953547:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967307898368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13815us (14143us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147139.953555:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3401 00002000:00100000:1.0:1746147139.953562:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db17100 x1830967307898368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/440 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147139.953569:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17100 with x1830967307898368 ext(1048576->2097151) 00002000:00010000:1.0:1746147139.953574:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17100 00000100:00100000:0.0:1746147139.969303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.969401:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307898496 00000100:00100000:3.0:1746147139.969413:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307898496 00000100:00100000:3.0:1746147139.969474:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14399 00000100:00100000:3.0:1746147139.969482:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32198:x1830967307898496:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.969500:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.969516:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778ba expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.969542:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.969550:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.969557:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.969567:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.969569:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.969572:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [819200->1048575] (req 819200->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.969599:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.969610:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 21 pid: 9585 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.969620:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310649856:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.969719:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.969728:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.969735:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310649984:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.970898:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.970909:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 10 pid: 9586 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.970922:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310650112:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.970955:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.971385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.971669:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307898752 00000100:00100000:3.0:1746147139.971675:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307898752 00000100:00100000:3.0:1746147139.971722:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5437 00000100:00100000:3.0:1746147139.971729:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32200:x1830967307898752:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147139.971880:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32200:x1830967307898752:12345-192.168.204.25@tcp:35:cat.0 Request processed in 150us (499us total) trans 8589935897 rc 0/0 00000100:00100000:3.0:1746147139.971885:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5437 00000100:00100000:3.0:1746147139.972807:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310649856:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.972816:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310649984:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.972822:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310650112:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.972850:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [819200->1048575] (req 819200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.972865:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:3.0:1746147139.973136:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32198:x1830967307898496:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3653us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.973144:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14399 00000100:00100000:0.0:1746147139.975701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.975740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.975784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147139.975809:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307898880 00000100:00100000:0.0:1746147139.975817:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307898880 00010000:00010000:0.0:1746147139.975856:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.976220:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307899136 00000100:00100000:3.0:1746147139.976225:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307899136 00010000:00010000:3.0:1746147139.976241:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 22 pid: 9585 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.976324:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307899008 00000100:00100000:3.0:1746147139.976328:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307899008 00010000:00010000:3.0:1746147139.976340:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 11 pid: 9586 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.976406:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6279 00000100:00100000:1.0:1746147139.976432:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6280 00000100:00100000:1.0:1746147139.976443:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307899008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.976459:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.976480:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 11 pid: 9586 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.976489:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307899136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.976493:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 11 pid: 9586 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.976498:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.976517:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425055712 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77701 expref: 11 pid: 9586 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746147139.976554:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6281 00000100:00100000:0.0:1746147139.976560:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967307898880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147139.976567:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147139.976589:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 22 pid: 9585 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.976598:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 22 pid: 9585 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.976609:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097034a00/0x3139939425055815 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7777f expref: 22 pid: 9585 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746147139.976625:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147139.976678:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307899136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 192us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.976685:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6279 00010000:00010000:1.0:1746147139.977006:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.977040:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307899008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 600us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.977047:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6280 00010000:00010000:0.0:1746147139.977084:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746147139.977114:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746147139.977130:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d48c00/0x3139939425055838 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777a9 expref: 40 pid: 1398 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746147139.977143:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.977145:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147139.977151:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.977160:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147139.977195:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147139.977210:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310650240:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.977421:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.980116:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310650240:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147139.980136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147139.980142:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147139.980173:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307899392 00000100:00100000:0.0:1746147139.980180:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307899392 00002000:00100000:0.0:1746147139.980225:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (819200->823295) req@ffff8800a5574380 x1830967307899392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.980235:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574380 with x1830967307899392 ext(819200->823295) 00002000:00010000:0.0:1746147139.980239:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574380 00000100:00100000:0.0:1746147139.980272:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3402 00000100:00100000:0.0:1746147139.980280:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967307899392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147139.980413:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967307899392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 133us (278us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147139.980420:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3402 00002000:00100000:0.0:1746147139.980426:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (819200->823295) req@ffff8800a5574380 x1830967307899392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147139.980432:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574380 with x1830967307899392 ext(819200->823295) 00002000:00010000:0.0:1746147139.980434:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574380 00000100:00100000:1.0:1746147139.980564:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967307898880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4003us (4869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.980572:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6281 00000100:00100000:0.0:1746147139.984374:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147139.984431:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307899520 00000100:00100000:3.0:1746147139.984441:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307899520 00000100:00100000:3.0:1746147139.984498:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14400 00000100:00100000:3.0:1746147139.984507:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32198:x1830967307899520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147139.984530:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147139.984549:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778c1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.984583:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.984592:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.984599:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.984600:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147139.984603:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.985487:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147139.985505:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746147139.985518:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310650368:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.985636:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147139.985645:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 15 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.985659:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310650496:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147139.985679:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147139.989424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.989497:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307899648 00000100:00100000:1.0:1746147139.989506:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307899648 00000100:00100000:3.0:1746147139.989538:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310650368:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147139.989544:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.989549:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310650496:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147139.989574:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.989576:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6282 00000100:00100000:1.0:1746147139.989583:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307899648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147139.989590:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12c400, rc 0) 00010000:00010000:1.0:1746147139.989597:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.989617:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.989628:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746147139.989637:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32198:x1830967307899520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5131us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147139.989643:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14400 00010000:00010000:1.0:1746147139.989652:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425055934 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7782e expref: 16 pid: 1136 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746147139.989681:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.989701:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307899648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.989707:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6282 00000100:00100000:3.0:1746147139.990430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147139.990522:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307899776 00000100:00100000:1.0:1746147139.990526:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307899776 00010000:00010000:1.0:1746147139.990541:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746147139.990570:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6283 00000100:00100000:1.0:1746147139.990576:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307899776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147139.990583:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147139.990594:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.990605:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.990618:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x3139939425055950 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7784a expref: 37 pid: 9586 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746147139.990627:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.990628:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147139.990635:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.990643:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147139.990669:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147139.990681:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310650624:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147139.990741:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147139.992587:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310650624:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147139.992604:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147139.993168:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307899776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2588us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147139.993178:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6283 00000100:00100000:0.0:1746147139.995612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147139.997521:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307900032 00000100:00100000:2.0:1746147139.997534:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307900032 00002000:00100000:2.0:1746147139.997588:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1363968->1368063) req@ffff8800a5577480 x1830967307900032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/0 e 0 to 0 dl 1746147150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.997598:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5577480 with x1830967307900032 ext(1363968->1368063) 00002000:00010000:2.0:1746147139.997604:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5577480 00000100:00100000:2.0:1746147139.997641:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3403 00000100:00100000:2.0:1746147139.997652:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307900032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147139.997804:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307900032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 156us (2202us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147139.997811:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3403 00002000:00100000:2.0:1746147139.997816:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1363968->1368063) req@ffff8800a5577480 x1830967307900032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:515/0 lens 488/4536 e 0 to 0 dl 1746147150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147139.997824:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5577480 with x1830967307900032 ext(1363968->1368063) 00002000:00010000:2.0:1746147139.997826:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5577480 00000100:00100000:0.0:1746147140.004944:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.005069:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307900288 00000100:00100000:3.0:1746147140.005080:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307900288 00000100:00100000:3.0:1746147140.005197:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5438 00000100:00100000:3.0:1746147140.005206:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32198:x1830967307900288:12345-192.168.204.25@tcp:35:multiop.0 00000100:00080000:2.0:1746147140.005299:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147140.005478:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32198:x1830967307900288:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 272us (544us total) trans 8589935898 rc 0/0 00000100:00100000:3.0:1746147140.005485:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5438 00000100:00100000:0.0:1746147140.023192:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.023455:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307900544 00000100:00100000:3.0:1746147140.023467:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307900544 00000100:00100000:3.0:1746147140.023550:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5439 00000100:00100000:3.0:1746147140.023560:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:32156:x1830967307900544:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00080000:2.0:1746147140.023651:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147140.023780:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32156:x1830967307900544:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 221us (598us total) trans 8589935899 rc 0/0 00000100:00100000:3.0:1746147140.023786:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5439 00000100:00100000:0.0:1746147140.025150:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.025229:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307900672 00000100:00100000:3.0:1746147140.025235:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307900672 00000100:00100000:3.0:1746147140.025287:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14401 00000100:00100000:3.0:1746147140.025294:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:32195:x1830967307900672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.025305:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.025322:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778c8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.025347:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.025356:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.025357:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.025361:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1323008->2097151] (req 1323008->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.025390:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.025408:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 35 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.025420:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310650752:192.168.204.25@tcp:104: 00000100:00080000:2.0:1746147140.025489:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147140.025563:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.025694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.025762:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307900928 00000100:00100000:3.0:1746147140.025766:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307900928 00000100:00100000:3.0:1746147140.025787:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5440 00000100:00100000:3.0:1746147140.025793:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32156:x1830967307900928:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147140.025954:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32156:x1830967307900928:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 159us (258us total) trans 8589935900 rc 0/0 00000100:00100000:3.0:1746147140.025960:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5440 00000100:00100000:3.0:1746147140.026589:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310650752:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.026610:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1323008->2097151] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.026624:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12da00, rc 0) 00000100:00100000:3.0:1746147140.026656:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:32195:x1830967307900672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1362us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.026662:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14401 00000100:00100000:0.0:1746147140.028169:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.028323:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307901056 00000100:00100000:1.0:1746147140.028332:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307901056 00002000:00100000:1.0:1746147140.028466:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1368063) req@ffff88011e500000 x1830967307901056/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.028477:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500000 with x1830967307901056 ext(1048576->1368063) 00010000:00010000:1.0:1746147140.028486:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 36 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.028501:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 36 pid: 9586 timeout: 778 lvb_type: 0 00000100:00080000:2.0:1746147140.028507:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746147140.028508:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e500000 00000100:00100000:1.0:1746147140.028524:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1078 00000100:00100000:1.0:1746147140.028532:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307901056:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147140.032981:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307901056:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4438us (4808us total) trans 21474841449 rc 0/0 00000100:00100000:1.0:1746147140.033004:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1078 00002000:00100000:1.0:1746147140.033017:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1368063) req@ffff88011e500000 x1830967307901056/t21474841449(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.033025:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500000 with x1830967307901056 ext(1048576->1368063) 00010000:00010000:1.0:1746147140.033036:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.033050:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746147140.033062:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e500000 00000100:00100000:0.0:1746147140.034832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.034981:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307901184 00000100:00100000:1.0:1746147140.035156:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307901184 00010000:00010000:1.0:1746147140.035195:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.035238:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6284 00000100:00100000:1.0:1746147140.035247:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967307901184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.035262:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.035282:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.035294:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.035416:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425055a53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c1 expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.035443:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.035445:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.035453:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.035461:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.035505:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.035516:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310650880:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147140.035864:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.038071:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310650880:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.038122:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.038181:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307901184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2934us (3354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.038195:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6284 00000100:00100000:0.0:1746147140.038200:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.038241:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307901440 00000100:00100000:1.0:1746147140.038247:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307901440 00002000:00100000:1.0:1746147140.038286:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->1327103) req@ffff88011e503100 x1830967307901440/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.038295:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503100 with x1830967307901440 ext(1323008->1327103) 00002000:00010000:1.0:1746147140.038300:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e503100 00000100:00100000:1.0:1746147140.038323:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3404 00000100:00100000:1.0:1746147140.038330:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307901440:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147140.038453:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307901440:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 123us (255us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147140.038458:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3404 00002000:00100000:1.0:1746147140.038463:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->1327103) req@ffff88011e503100 x1830967307901440/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.038476:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503100 with x1830967307901440 ext(1323008->1327103) 00002000:00010000:1.0:1746147140.038479:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e503100 00000100:00100000:0.0:1746147140.046487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.046673:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307901568 00000100:00100000:3.0:1746147140.046683:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307901568 00000100:00100000:3.0:1746147140.046727:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14402 00000100:00100000:3.0:1746147140.046735:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:32195:x1830967307901568:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.046756:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.046775:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778cf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.046806:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.046816:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.046822:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.046824:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.046828:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.046861:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.046874:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 36 pid: 9586 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746147140.046887:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651008:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.047006:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.047014:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.047022:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651136:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.047932:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.051525:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651008:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.051539:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651136:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.051576:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.051596:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d200, rc 0) 00000100:00100000:3.0:1746147140.052082:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:32195:x1830967307901568:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5344us (5604us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.052121:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14402 00000100:00100000:2.0:1746147140.052464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.052543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.052563:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307901696 00000100:00100000:2.0:1746147140.052566:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307901824 00000100:00100000:1.0:1746147140.052570:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307901696 00000100:00100000:2.0:1746147140.052571:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307901824 00010000:00010000:2.0:1746147140.052947:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 37 pid: 9586 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.053023:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.053170:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6285 00000100:00100000:2.0:1746147140.053180:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307901824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.053195:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.053214:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 37 pid: 9586 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.053225:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 37 pid: 9586 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.053246:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0200/0x3139939425055a3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ac expref: 37 pid: 9586 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.053276:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.053308:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307901824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 130us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.053314:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6285 00000100:00100000:2.0:1746147140.053327:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6286 00000100:00100000:2.0:1746147140.053332:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307901696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.053339:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.053346:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.053356:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.053368:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x31399394250559c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77889 expref: 17 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.053376:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.053378:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.053385:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.053392:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.053417:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.053428:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310651264:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147140.053486:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.055427:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310651264:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147140.055449:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.055505:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967307901696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2171us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.055515:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6286 00000100:00100000:0.0:1746147140.058640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.058733:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307902080 00000100:00100000:1.0:1746147140.058742:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307902080 00002000:00100000:1.0:1746147140.058778:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1146880->1150975) req@ffff88011e500380 x1830967307902080/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.058787:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500380 with x1830967307902080 ext(1146880->1150975) 00002000:00010000:1.0:1746147140.058792:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e500380 00000100:00100000:1.0:1746147140.058820:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3405 00000100:00100000:1.0:1746147140.058827:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307902080:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147140.058966:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307902080:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 136us (330us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147140.058972:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3405 00002000:00100000:1.0:1746147140.058978:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1146880->1150975) req@ffff88011e500380 x1830967307902080/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.058995:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500380 with x1830967307902080 ext(1146880->1150975) 00002000:00010000:1.0:1746147140.058999:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e500380 00000100:00100000:0.0:1746147140.061555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.061656:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307902336 00000100:00100000:2.0:1746147140.061663:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307902336 00000100:00100000:2.0:1746147140.061716:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5441 00000100:00100000:2.0:1746147140.061722:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:32195:x1830967307902336:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147140.061899:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32195:x1830967307902336:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 176us (350us total) trans 8589935901 rc 0/0 00000100:00100000:2.0:1746147140.061906:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5441 00000100:00080000:0.0:1746147140.061910:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147140.093180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.093302:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307902592 00000100:00100000:2.0:1746147140.093311:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307902592 00000100:00100000:2.0:1746147140.093362:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15231 00000100:00100000:2.0:1746147140.093369:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32209:x1830967307902592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.093390:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.093407:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778d6 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.093469:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093480:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093491:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093502:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093508:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093512:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093609:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093618:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093623:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147140.093632:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147140.093687:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093692:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093697:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093702:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.093705:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093711:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093720:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147140.093722:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.093726:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.093729:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81400/0x3139939425055a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094925:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094955:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094960:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094964:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b80e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.094967:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094972:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094980:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553c00) 00010000:00010000:2.0:1746147140.094982:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.094992:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.094997:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.095037:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 43 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.095047:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.095053:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.095056:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147140.095058:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81a00, rc 0) 00000100:00100000:2.0:1746147140.095432:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32209:x1830967307902592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2062us (2258us total) trans 8589935902 rc 0/0 00000100:00100000:2.0:1746147140.095439:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15231 00000100:00100000:0.0:1746147140.100217:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.100260:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.100285:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307902720 00000100:00100000:3.0:1746147140.100538:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307902720 00000100:00100000:3.0:1746147140.100587:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307902848 00000100:00100000:3.0:1746147140.100590:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307902848 00000100:00100000:3.0:1746147140.100615:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14403 00000100:00100000:3.0:1746147140.100622:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307902720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.100637:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.100652:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0x3139939425055a8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778dd expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.100802:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14404 00000100:00100000:0.0:1746147140.100807:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967307902848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.100813:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.100819:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425055a92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778e4 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.100842:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310651520:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.100921:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.101329:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651392:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.101389:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.103284:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310651520:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.103310:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425055a92 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778e4 expref: 39 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.103322:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425055a92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778e4 expref: 39 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.103348:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee800, rc 0) 00000100:00100000:2.0:1746147140.103396:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967307902848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2587us (3134us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.103404:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14404 00000100:00100000:3.0:1746147140.104040:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651392:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.104060:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0x3139939425055a8b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778dd expref: 37 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.104069:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0x3139939425055a8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778dd expref: 37 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.104109:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12ca00, rc 0) 00000100:00100000:3.0:1746147140.104130:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967307902720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3509us (3919us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.104134:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14403 00000100:00100000:0.0:1746147140.108634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.108995:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307903104 00000100:00100000:3.0:1746147140.109004:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307903104 00002000:00100000:3.0:1746147140.109056:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->819199) req@ffff88011e500700 x1830967307903104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.109065:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500700 with x1830967307903104 ext(0->819199) 00002000:00010000:3.0:1746147140.109069:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500700 00000100:00100000:3.0:1746147140.109118:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3406 00000100:00100000:3.0:1746147140.109124:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967307903104:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:0.0:1746147140.109392:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147140.114613:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967307903104:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5481us (5980us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746147140.114624:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3406 00002000:00100000:3.0:1746147140.114633:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->819199) req@ffff88011e500700 x1830967307903104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.114642:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500700 with x1830967307903104 ext(0->819199) 00002000:00010000:3.0:1746147140.114647:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500700 00000100:00100000:0.0:1746147140.122447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.122573:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307903232 00000100:00100000:3.0:1746147140.122582:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307903232 00000100:00100000:3.0:1746147140.123859:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14405 00000100:00100000:3.0:1746147140.123870:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32209:x1830967307903232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.123890:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.123906:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778eb expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.123937:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.123943:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.123945:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.123948:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.123971:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.123981:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 15 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.123998:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651648:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.124080:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.128561:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310651648:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.128589:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.128605:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12cc00, rc 0) 00000100:00100000:3.0:1746147140.128658:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32209:x1830967307903232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4790us (6218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.128667:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14405 00000100:00100000:0.0:1746147140.130452:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.130628:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307903360 00000100:00100000:3.0:1746147140.130635:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307903360 00002000:00100000:3.0:1746147140.130673:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->2097151) req@ffff88011e503b80 x1830967307903360/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.130682:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503b80 with x1830967307903360 ext(1323008->2097151) 00010000:00010000:3.0:1746147140.130691:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 16 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.130703:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 16 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.130709:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e503b80 00000100:00100000:3.0:1746147140.130739:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1079 00000100:00100000:3.0:1746147140.130746:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307903360:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147140.136614:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307903360:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5860us (6159us total) trans 21474841450 rc 0/0 00000100:00100000:3.0:1746147140.136697:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1079 00002000:00100000:3.0:1746147140.136709:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->2097151) req@ffff88011e503b80 x1830967307903360/t21474841450(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.136718:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e503b80 with x1830967307903360 ext(1323008->2097151) 00010000:00010000:3.0:1746147140.136726:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.136745:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.136751:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e503b80 00000100:00100000:0.0:1746147140.137431:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.137594:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307903616 00000100:00100000:2.0:1746147140.137601:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307903616 00000100:00100000:2.0:1746147140.137645:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15232 00000100:00100000:2.0:1746147140.137651:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:32213:x1830967307903616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.137672:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.137686:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x3139939425055aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778f2 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.137745:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137759:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137768:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137780:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137785:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137789:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137861:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055ab5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137870:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137875:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147140.137883:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147140.137935:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137941:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137946:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137951:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b80200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.137954:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137959:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137968:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147140.137971:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.137974:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.137978:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425055aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138010:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138014:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138019:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138022:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.138024:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138028:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138033:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553e00) 00010000:00010000:2.0:1746147140.138035:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.138037:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138044:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81000/0x3139939425055aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.138071:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x3139939425055aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778f2 expref: 23 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.138079:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778f2 expref: 22 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.138084:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.138086:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147140.138108:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80e00, rc 0) 00000100:00100000:2.0:1746147140.138143:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+22:32213:x1830967307903616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 492us (713us total) trans 8589935903 rc 0/0 00000100:00100000:2.0:1746147140.138148:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15232 00000100:00100000:0.0:1746147140.139411:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.139635:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307903744 00000100:00100000:2.0:1746147140.139640:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307903744 00010000:00010000:2.0:1746147140.139667:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.139699:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6287 00000100:00100000:2.0:1746147140.139705:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307903744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.139716:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.139731:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.139742:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.139758:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12da00/0x3139939425055a5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778c8 expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.139769:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.139771:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.139776:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.139783:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.139810:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.139829:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310651776:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147140.139897:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.142232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.142267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.142295:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.142428:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307903872 00000100:00100000:3.0:1746147140.142435:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307903872 00000100:00100000:3.0:1746147140.142490:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904000 00000100:00100000:3.0:1746147140.142493:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904000 00000100:00100000:3.0:1746147140.142508:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14406 00000100:00100000:3.0:1746147140.142514:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967307903872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.142525:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.142541:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984eee00/0x3139939425055ac3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e778f9 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.142546:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14407 00000100:00100000:2.0:1746147140.142558:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307904000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.142566:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147140.142577:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310651904:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.142578:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77900 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.142585:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904128 00010000:00010000:2.0:1746147140.142588:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.142589:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147140.142590:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904128 00010000:00010000:2.0:1746147140.142596:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.142610:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.142618:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b403a000, rc 0) 00000100:00100000:1.0:1746147140.142618:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 798 00000100:00100000:1.0:1746147140.142623:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967307904128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.142630:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147140.142633:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.142638:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307904000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 85us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.142642:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14407 00010000:00010000:1.0:1746147140.142644:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425055ab5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778f2 expref: 22 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.142659:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147140.142662:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.142668:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310651776:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147140.142678:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967307904128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 55us (382us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147140.142681:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.142683:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 798 00000100:00100000:3.0:1746147140.142699:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307903744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2994us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.142706:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6287 00000100:00080000:0.0:1746147140.142810:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1746147140.145574:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147135 -> 1746147139 00002000:00010000:3.0:1746147140.145581:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147134 -> 1746147140 00002000:00010000:3.0:1746147140.145583:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147135 -> 1746147139 00000100:00100000:3.0:1746147140.145605:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310651904:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.145634:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984eee00/0x3139939425055ac3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778f9 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.145646:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984eee00/0x3139939425055ac3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778f9 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.145676:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eee00, rc 0) 00000100:00100000:3.0:1746147140.145717:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967307903872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3202us (3491us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.145725:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14406 00000100:00100000:0.0:1746147140.145848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.146276:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904384 00000100:00100000:2.0:1746147140.146282:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904384 00002000:00100000:2.0:1746147140.146313:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4395180 x1830967307904384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.146321:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395180 with x1830967307904384 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.146326:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395180 00000100:00100000:2.0:1746147140.146345:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3407 00000100:00100000:2.0:1746147140.146351:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307904384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.153449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.154846:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904512 00000100:00100000:3.0:1746147140.154855:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904512 00000100:00100000:3.0:1746147140.154899:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14408 00000100:00100000:3.0:1746147140.154906:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:32213:x1830967307904512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.154921:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.154936:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77907 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.154960:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.154967:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.154968:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.154971:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.155005:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.155016:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 38 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.155026:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310652032:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.155118:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.155867:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307904384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9514us (10022us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147140.155875:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3407 00002000:00100000:3.0:1746147140.155882:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4395180 x1830967307904384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.155890:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395180 with x1830967307904384 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.155894:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395180 00000100:00100000:3.0:1746147140.157066:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310652032:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.157151:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.157167:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3e00, rc 0) 00000100:00100000:3.0:1746147140.157591:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+22:32213:x1830967307904512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2683us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.157599:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14408 00000100:00100000:0.0:1746147140.157833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.157981:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904640 00000100:00100000:3.0:1746147140.157994:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904640 00002000:00100000:3.0:1746147140.158022:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (819200->1048575) req@ffff880098e11180 x1830967307904640/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.158037:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11180 with x1830967307904640 ext(819200->1048575) 00010000:00010000:3.0:1746147140.158044:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 39 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.158055:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 39 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.158061:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098e11180 00000100:00100000:3.0:1746147140.158077:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1080 00000100:00100000:3.0:1746147140.158083:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967307904640:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147140.161329:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307904640:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3237us (3488us total) trans 17179874187 rc 0/0 00000100:00100000:3.0:1746147140.161340:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1080 00002000:00100000:3.0:1746147140.161349:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (819200->1048575) req@ffff880098e11180 x1830967307904640/t17179874187(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.161357:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11180 with x1830967307904640 ext(819200->1048575) 00010000:00010000:3.0:1746147140.161366:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 41 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.161380:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 41 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.161386:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098e11180 00000001:00080000:2.0:1746147140.162920:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874187 is committed 00000001:00080000:2.0:1746147140.162943:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874184 is committed 00000001:00080000:2.0:1746147140.162949:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874183 is committed 00000001:00080000:2.0:1746147140.163030:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874146 is committed 00000100:00100000:0.0:1746147140.163490:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.163587:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904768 00000100:00100000:3.0:1746147140.163596:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904768 00000100:00100000:3.0:1746147140.163635:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14409 00000100:00100000:3.0:1746147140.163643:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32209:x1830967307904768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.164210:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.164231:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7790e expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.164262:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.164270:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.164272:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.164276:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.164307:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.164318:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 17 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.164331:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310652160:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.164433:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.164738:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.164790:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307904896 00000100:00100000:3.0:1746147140.164793:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307904896 00010000:00010000:3.0:1746147140.164812:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 25 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.164961:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6288 00000100:00100000:3.0:1746147140.164968:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307904896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.164978:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.165007:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 25 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.165017:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 25 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.165036:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x3139939425055a4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778ba expref: 25 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.165531:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.165533:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.165540:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 7 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.165548:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 7 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.165573:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 7 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.165583:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310652288:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.165640:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.166106:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.166181:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307905024 00000100:00100000:2.0:1746147140.166185:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307905024 00002000:00100000:2.0:1746147140.166215:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1150975) req@ffff880099154a80 x1830967307905024/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.166224:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154a80 with x1830967307905024 ext(1048576->1150975) 00010000:00010000:2.0:1746147140.166231:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.166242:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 18 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746147140.166248:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099154a80 00000100:00100000:2.0:1746147140.166260:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1081 00000100:00100000:2.0:1746147140.166265:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307905024:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147140.166412:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310652160:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.166431:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.166443:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a2600, rc 0) 00000100:00100000:3.0:1746147140.166463:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32209:x1830967307904768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2821us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.166470:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14409 00000100:00100000:3.0:1746147140.166898:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310652288:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.166907:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.166926:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307904896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1958us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.166932:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6288 00000100:00100000:2.0:1746147140.172249:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307905024:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5970us (6146us total) trans 21474841451 rc 0/0 00000100:00100000:2.0:1746147140.172263:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1081 00002000:00100000:2.0:1746147140.172275:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1150975) req@ffff880099154a80 x1830967307905024/t21474841451(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.172284:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154a80 with x1830967307905024 ext(1048576->1150975) 00010000:00010000:2.0:1746147140.172294:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 20 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.172309:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 20 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746147140.172315:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099154a80 00000100:00100000:0.0:1746147140.172738:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.172831:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307905280 00000100:00100000:2.0:1746147140.172839:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307905280 00002000:00100000:2.0:1746147140.172873:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098e11f80 x1830967307905280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.172887:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11f80 with x1830967307905280 ext(0->1048575) 00002000:00010000:2.0:1746147140.172891:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e11f80 00000100:00100000:0.0:1746147140.172995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.173027:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307905536 00000100:00100000:2.0:1746147140.173030:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307905536 00002000:00100000:2.0:1746147140.173045:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098e12d80 x1830967307905536/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.173051:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12d80 with x1830967307905536 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.173054:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e12d80 00000100:00100000:2.0:1746147140.173065:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3408 00000100:00100000:2.0:1746147140.173071:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307905280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.173119:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3409 00000100:00100000:3.0:1746147140.173126:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307905536:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.178190:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.178288:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307905664 00000100:00100000:3.0:1746147140.178298:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307905664 00010000:00010000:3.0:1746147140.178337:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 22 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.178378:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6289 00000100:00100000:3.0:1746147140.178386:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307905664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.178399:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.178417:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 22 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.178439:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 22 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.178461:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x3139939425055a61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778cf expref: 22 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.178492:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.178494:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.178501:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.178510:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.178544:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.178557:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310652416:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.178651:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.180624:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307905280:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7544us (7878us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147140.180636:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3408 00002000:00100000:2.0:1746147140.180646:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098e11f80 x1830967307905280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.180656:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11f80 with x1830967307905280 ext(0->1048575) 00002000:00010000:2.0:1746147140.180661:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e11f80 00000100:00100000:3.0:1746147140.183415:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310652416:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.183437:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.183475:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307905664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5090us (5295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.183485:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6289 00000100:00100000:2.0:1746147140.183704:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307905536:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10578us (10708us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147140.183712:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3409 00002000:00100000:2.0:1746147140.183720:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098e12d80 x1830967307905536/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.183728:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12d80 with x1830967307905536 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.183733:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e12d80 00000100:00100000:0.0:1746147140.185875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.186288:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307905920 00000100:00100000:2.0:1746147140.186296:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307905920 00002000:00100000:2.0:1746147140.186333:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098e11880 x1830967307905920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.186343:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11880 with x1830967307905920 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.186347:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e11880 00000100:00100000:2.0:1746147140.186424:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3410 00000100:00100000:2.0:1746147140.186432:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307905920:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147140.187121:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.187357:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307906176 00000100:00100000:3.0:1746147140.187362:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307906176 00000100:00100000:3.0:1746147140.187400:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15233 00000100:00100000:3.0:1746147140.187405:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:32215:x1830967307906176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.187417:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.187432:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77915 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187669:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.187680:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 41 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187686:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 22 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187691:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187697:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.187720:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187730:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.187739:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310652544:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.187819:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 22 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187827:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 22 pid: 16099 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.187834:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310652672:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.187857:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 41 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.187864:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 41 pid: 9138 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.187870:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310652800:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.187888:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.191313:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.191444:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310652672:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.191456:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310652800:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147140.191528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.191606:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307906432 00000100:00100000:2.0:1746147140.191613:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307906432 00010000:00010000:2.0:1746147140.191642:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 42 pid: 9138 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.191672:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307906304 00000100:00100000:2.0:1746147140.191674:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307906304 00010000:00010000:2.0:1746147140.191684:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 23 pid: 16099 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.191709:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6290 00000100:00100000:2.0:1746147140.191716:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967307906432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.191730:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.191736:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 42 pid: 9138 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.191746:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 42 pid: 9138 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.191755:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6291 00000100:00100000:3.0:1746147140.191763:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967307906304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.191771:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.191776:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 23 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.191782:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x31399394250557c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7774e expref: 42 pid: 9138 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.191785:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 23 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.191798:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e000/0x3139939425055800 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7776a expref: 23 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.191799:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.191803:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.191812:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.191818:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.191819:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147140.191822:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.191827:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.191831:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.191860:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967307906304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 98us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.191860:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967307906432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 144us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.191866:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6290 00000100:00100000:3.0:1746147140.191869:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6291 00000100:00100000:0.0:1746147140.192678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.192905:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307906560 00000100:00100000:2.0:1746147140.192909:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307906560 00010000:00010000:2.0:1746147140.192928:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.192939:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310652544:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.192956:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6292 00000100:00100000:2.0:1746147140.192961:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967307906560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.192965:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.192968:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.192973:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.192991:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.193008:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425055a7d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778d6 expref: 41 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.193018:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.193021:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.193028:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.193034:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147140.193051:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.193245:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967307906560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 283us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.193252:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6292 00000100:00100000:3.0:1746147140.193390:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967307905920:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6958us (7521us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147140.193399:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3410 00002000:00100000:3.0:1746147140.193408:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098e11880 x1830967307905920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.193417:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e11880 with x1830967307905920 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.193422:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e11880 00010000:00010000:3.0:1746147140.193441:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.193447:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147140.193467:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147140.193979:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 23 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.194005:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 22 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.194012:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.194014:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147140.194017:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3200, rc 0) 00000100:00100000:3.0:1746147140.194056:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+22:32215:x1830967307906176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6650us (6965us total) trans 8589935904 rc 0/0 00000100:00100000:3.0:1746147140.194063:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15233 00000100:00100000:0.0:1746147140.195080:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.195190:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307906688 00000100:00100000:3.0:1746147140.195198:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307906688 00000100:00100000:3.0:1746147140.195243:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14410 00000100:00100000:3.0:1746147140.195250:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+19:32213:x1830967307906688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.195265:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.195281:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7791c expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.195304:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.195305:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.195312:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.195324:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.195334:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3800, rc 0) 00000100:00100000:3.0:1746147140.195377:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+20:32213:x1830967307906688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 126us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.195382:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14410 00000100:00100000:0.0:1746147140.201248:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.201350:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307906944 00000100:00100000:3.0:1746147140.201361:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307906944 00002000:00100000:3.0:1746147140.201411:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800930ead80 x1830967307906944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.201421:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ead80 with x1830967307906944 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.201427:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ead80 00000100:00100000:3.0:1746147140.201461:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3411 00000100:00100000:3.0:1746147140.201471:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307906944:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.202212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.202272:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307907072 00000100:00100000:2.0:1746147140.202277:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307907072 00000100:00100000:2.0:1746147140.202318:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14411 00000100:00100000:2.0:1746147140.202324:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307907072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.202336:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.202355:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77923 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.202377:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.202379:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.202389:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.202415:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.202426:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0c00, rc 0) 00000100:00100000:2.0:1746147140.202480:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307907072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 156us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.202486:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14411 00000100:00100000:0.0:1746147140.209832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.210010:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307906944:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8537us (8770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147140.210022:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3411 00002000:00100000:3.0:1746147140.210080:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800930ead80 x1830967307906944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.210119:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ead80 with x1830967307906944 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.210125:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ead80 00000100:00100000:2.0:1746147140.210136:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307907328 00000100:00100000:2.0:1746147140.210144:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307907328 00000100:00100000:2.0:1746147140.210176:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5442 00000100:00100000:2.0:1746147140.210182:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32209:x1830967307907328:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147140.210534:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32209:x1830967307907328:12345-192.168.204.25@tcp:35:cat.0 Request processed in 349us (711us total) trans 8589935905 rc 0/0 00000100:00100000:2.0:1746147140.210540:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5442 00000100:00100000:0.0:1746147140.212621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.212742:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307907456 00000100:00100000:2.0:1746147140.212756:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307907456 00000100:00100000:2.0:1746147140.212814:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14412 00000100:00100000:2.0:1746147140.212821:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+20:32215:x1830967307907456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147140.212840:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.212860:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7792a expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.212890:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.212902:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.212908:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.212909:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.212912:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1638400->1929215] (req 1638400->1929215) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.212939:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.212949:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.212960:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310652928:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.213152:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.213160:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 37 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.213168:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310653056:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.213210:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.215675:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310652928:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.215688:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310653056:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.215724:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1638400->1929215] (req 1638400->1929215) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.215744:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e573600, rc 0) 00000100:00100000:2.0:1746147140.215800:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:32215:x1830967307907456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2978us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.215810:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14412 00000100:00100000:0.0:1746147140.217867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.218208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.218484:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307907584 00000100:00100000:1.0:1746147140.218493:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307907584 00010000:00010000:1.0:1746147140.218532:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.218537:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307907712 00000100:00100000:2.0:1746147140.218542:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307907712 00010000:00010000:2.0:1746147140.218559:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 38 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.218565:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6293 00000100:00100000:1.0:1746147140.218571:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307907584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147140.218579:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6294 00010000:00010000:1.0:1746147140.218582:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147140.218584:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967307907712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.218591:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.218598:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.218599:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 38 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.218685:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.218702:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 38 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.218765:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x3139939425055af4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7791c expref: 21 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.218769:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982a2600/0x3139939425055ad8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7790e expref: 38 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.218785:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.218787:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147140.218793:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.218794:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.218801:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.218851:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147140.218869:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.218881:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310653184:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.218899:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307907840 00000100:00100000:3.0:1746147140.218903:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307907840 00000100:00100000:1.0:1746147140.218905:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307907584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 333us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.218927:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14413 00000100:00100000:1.0:1746147140.218932:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6293 00000100:00100000:3.0:1746147140.218933:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307907840:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147140.218938:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147140.218948:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.218959:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a3a00/0x3139939425055b09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77931 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.218998:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310653312:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.219066:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00002000:00010000:3.0:1746147140.221001:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147139 -> 1746147140 00000100:00100000:3.0:1746147140.221025:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310653312:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.221053:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3a00/0x3139939425055b09 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77931 expref: 21 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.221065:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3a00/0x3139939425055b09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77931 expref: 21 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147140.221075:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310653184:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.221080:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3a00, rc 0) 00010000:00010000:2.0:1746147140.221114:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.221157:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307907712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2571us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.221158:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307907840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2222us (2362us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.221166:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14413 00000100:00100000:2.0:1746147140.221166:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6294 00000100:00100000:2.0:1746147140.221466:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.221681:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307908096 00000100:00100000:3.0:1746147140.221687:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307908096 00002000:00100000:3.0:1746147140.221740:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1638400->1642495) req@ffff88012e321880 x1830967307908096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.221750:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321880 with x1830967307908096 ext(1638400->1642495) 00002000:00010000:3.0:1746147140.221754:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e321880 00000100:00100000:3.0:1746147140.221779:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3412 00000100:00100000:3.0:1746147140.221787:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967307908096:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147140.221904:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967307908096:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 117us (437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147140.221909:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3412 00002000:00100000:3.0:1746147140.221913:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1638400->1642495) req@ffff88012e321880 x1830967307908096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.221920:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321880 with x1830967307908096 ext(1638400->1642495) 00002000:00010000:3.0:1746147140.221922:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e321880 00000100:00100000:0.0:1746147140.226784:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.226845:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.226912:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307908352 00000100:00100000:3.0:1746147140.226924:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307908352 00002000:00100000:3.0:1746147140.226995:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1925120->1929215) req@ffff8800930e8380 x1830967307908352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.227007:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8380 with x1830967307908352 ext(1925120->1929215) 00002000:00010000:3.0:1746147140.227014:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e8380 00000100:00100000:3.0:1746147140.227039:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3413 00000100:00100000:3.0:1746147140.227048:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307908352:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.227082:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307908608 00000100:00100000:2.0:1746147140.227106:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307908608 00000100:00100000:2.0:1746147140.227136:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5443 00000100:00100000:2.0:1746147140.227143:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:32213:x1830967307908608:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147140.227221:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307908352:12345-192.168.204.25@tcp:3:cat.0 Request processed in 174us (450us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147140.227227:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3413 00002000:00100000:3.0:1746147140.227233:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1925120->1929215) req@ffff8800930e8380 x1830967307908352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.227239:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8380 with x1830967307908352 ext(1925120->1929215) 00002000:00010000:3.0:1746147140.227242:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e8380 00000100:00100000:2.0:1746147140.227333:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:32213:x1830967307908608:12345-192.168.204.25@tcp:35:cat.0 Request processed in 190us (486us total) trans 8589935906 rc 0/0 00000100:00100000:2.0:1746147140.227339:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5443 00000100:00100000:0.0:1746147140.229321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.229566:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307908864 00000100:00100000:3.0:1746147140.229574:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307908864 00000100:00100000:3.0:1746147140.229636:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15234 00000100:00100000:3.0:1746147140.229644:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32218:x1830967307908864:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.229663:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.229683:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3800/0x3139939425055b10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77938 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.229755:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229768:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229779:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229790:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229796:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229801:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229894:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229902:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229908:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147140.229916:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147140.229991:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.229999:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230004:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230010:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a2600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.230014:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230020:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230032:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147140.230035:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.230039:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230043:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x3139939425055b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230055:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230059:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230064:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230072:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a2e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.230074:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230079:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230083:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5c00) 00010000:00010000:3.0:1746147140.230085:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.230138:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230144:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x3139939425055b1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147140.230177:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3800/0x3139939425055b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 44 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.230188:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 43 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.230193:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.230195:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147140.230197:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a2200, rc 0) 00000100:00100000:3.0:1746147140.230240:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32218:x1830967307908864:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 592us (922us total) trans 8589935907 rc 0/0 00000100:00100000:3.0:1746147140.230246:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15234 00000100:00100000:0.0:1746147140.265333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.265390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.265424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.265473:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.265498:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307909248 00000100:00100000:2.0:1746147140.265509:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307909248 00000100:00080000:0.0:1746147140.265539:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147140.265565:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307909120 00000100:00100000:2.0:1746147140.265568:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307909120 00000100:00100000:0.0:1746147140.265570:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307909376 00000100:00100000:0.0:1746147140.265574:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307909376 00000100:00100000:2.0:1746147140.265595:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 855 00000100:00100000:0.0:1746147140.265601:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 856 00000100:00100000:2.0:1746147140.265603:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+5:2003:x1830967307909248:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147140.265608:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967307909120:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147140.265672:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+5:2003:x1830967307909248:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.265678:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 855 00000100:00100000:2.0:1746147140.265695:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 857 00000100:00100000:2.0:1746147140.265699:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2003:x1830967307909376:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147140.265814:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967307909120:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 205us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.265818:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2003:x1830967307909376:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 117us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.265820:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 856 00000100:00100000:2.0:1746147140.265824:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 857 00000100:00080000:0.0:1746147140.265834:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746147140.265997:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307908992 00000100:00100000:3.0:1746147140.266002:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307908992 00000100:00100000:3.0:1746147140.266030:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 182 00000100:00100000:3.0:1746147140.266035:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967307908992:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1746147140.266077:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967307908992:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 41us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.266082:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 182 00000100:00100000:0.0:1746147140.316645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.316717:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307909504 00000100:00100000:3.0:1746147140.316728:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307909504 00000100:00100000:3.0:1746147140.316791:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14414 00000100:00100000:3.0:1746147140.316800:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32218:x1830967307909504:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.316822:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.316842:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7793f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.316874:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.316883:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.316889:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.316891:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.316895:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1314816->2097151] (req 1314816->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.316928:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.316945:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746147140.316957:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310653440:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.317086:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.317190:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 7 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.317200:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310653568:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.317561:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.318997:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310653440:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147140.320445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.320466:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310653568:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.320494:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1314816->2097151] (req 1314816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.320512:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff200, rc 0) 00000100:00100000:2.0:1746147140.320530:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307909632 00000100:00100000:2.0:1746147140.320540:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307909632 00000100:00100000:3.0:1746147140.320567:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32218:x1830967307909504:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3768us (3933us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147140.320570:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 8 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.320576:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14414 00000100:00100000:0.0:1746147140.320883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.320929:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307909760 00000100:00100000:2.0:1746147140.320932:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307909760 00000100:00100000:0.0:1746147140.320941:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6295 00010000:00010000:2.0:1746147140.320945:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746147140.320949:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307909632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147140.320961:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147140.320991:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 8 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.321001:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 8 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.321025:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984efc00/0x31399394250559ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77890 expref: 8 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.321040:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.321042:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6296 00000100:00100000:2.0:1746147140.321048:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307909760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.321056:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147140.321058:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307909632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 111us (619us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147140.321063:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746147140.321064:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6295 00010000:00010000:2.0:1746147140.321072:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.321083:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425055a45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778b3 expref: 26 pid: 12201 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.321120:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.321122:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.321128:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.321136:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.321502:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.321514:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310653696:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147140.321574:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.323696:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310653696:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147140.323718:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.323769:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967307909760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2719us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.323781:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6296 00000100:00100000:0.0:1746147140.323851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.324223:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307910016 00000100:00100000:2.0:1746147140.324230:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307910016 00002000:00100000:2.0:1746147140.324266:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1314816->1318911) req@ffff8800930e8a80 x1830967307910016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.324277:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8a80 with x1830967307910016 ext(1314816->1318911) 00002000:00010000:2.0:1746147140.324282:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e8a80 00000100:00100000:2.0:1746147140.324513:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3414 00000100:00100000:2.0:1746147140.324521:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307910016:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147140.324803:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307910016:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 281us (950us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147140.324810:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3414 00002000:00100000:2.0:1746147140.324815:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1314816->1318911) req@ffff8800930e8a80 x1830967307910016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.324822:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8a80 with x1830967307910016 ext(1314816->1318911) 00002000:00010000:2.0:1746147140.324824:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e8a80 00000100:00100000:0.0:1746147140.328580:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.328694:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307910272 00000100:00100000:1.0:1746147140.328704:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307910272 00000100:00100000:1.0:1746147140.328775:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15235 00000100:00100000:1.0:1746147140.328783:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32223:x1830967307910272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147140.328897:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147140.328919:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x3139939425055b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77946 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.329006:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329019:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329028:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329039:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329044:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329053:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329443:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x3139939425055b4f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329452:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x3139939425055b4f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329458:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x3139939425055b4f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147140.329465:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147140.329539:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329545:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329551:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329557:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329562:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c11800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147140.329565:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329571:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329580:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147140.329583:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147140.329587:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329591:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x3139939425055b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329638:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329643:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329647:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329651:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c10400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147140.329654:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329658:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329664:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23e00) 00010000:00010000:1.0:1746147140.329666:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147140.329667:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329671:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x3139939425055b48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.329708:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x3139939425055b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77946 expref: 46 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.329719:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x3139939425055b4f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77946 expref: 45 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.329726:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147140.329728:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147140.329730:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c11400, rc 0) 00000100:00100000:1.0:1746147140.330104:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32223:x1830967307910272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1304us (1517us total) trans 8589935908 rc 0/0 00000100:00100000:1.0:1746147140.330111:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15235 00000100:00100000:0.0:1746147140.333637:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.333941:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307910400 00000100:00100000:3.0:1746147140.333951:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307910400 00000100:00100000:3.0:1746147140.334020:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14415 00000100:00100000:3.0:1746147140.334028:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307910400:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.334048:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.334067:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425055b5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7794d expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.334148:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310653824:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.334248:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.334436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.334497:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307910528 00000100:00100000:3.0:1746147140.334501:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307910528 00000100:00100000:0.0:1746147140.334563:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 799 00000100:00100000:0.0:1746147140.334625:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967307910528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147140.334638:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147140.334661:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x3139939425055b4f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77946 expref: 45 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.334680:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147140.334685:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147140.334713:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967307910528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 144us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.334720:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 799 00000100:00100000:3.0:1746147140.334861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.334978:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307910656 00000100:00100000:0.0:1746147140.334993:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307910656 00000100:00100000:0.0:1746147140.335015:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14416 00000100:00100000:0.0:1746147140.335021:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32218:x1830967307910656:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147140.335030:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.335041:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77954 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.335059:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 6 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.335067:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.335074:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.335075:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.335078:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.335240:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.335252:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 26 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.335261:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310653952:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147140.335346:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 6 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.335355:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 6 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.335577:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310654080:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147140.335609:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00002000:00010000:3.0:1746147140.338829:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147139 -> 1746147140 00002000:00010000:3.0:1746147140.338839:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147139 -> 1746147140 00000100:00100000:3.0:1746147140.338864:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310653824:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.338897:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425055b5d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7794d expref: 38 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.338911:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425055b5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7794d expref: 38 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.338943:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ffe00, rc 0) 00000100:00100000:3.0:1746147140.339025:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307910400:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4995us (5395us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.339033:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14415 00000100:00100000:0.0:1746147140.339197:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310653952:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147140.345889:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.345968:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310654080:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147140.346017:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.346042:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b400, rc 0) 00000100:00100000:0.0:1746147140.346118:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32218:x1830967307910656:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11095us (11255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.346128:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14416 00000100:00100000:3.0:1746147140.346277:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307911168 00000100:00100000:3.0:1746147140.346286:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307911168 00000100:00100000:3.0:1746147140.346334:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15236 00000100:00100000:3.0:1746147140.346343:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+23:32225:x1830967307911168:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:2.0:1746147140.346390:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147140.346406:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310654208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746147140.346444:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147140.346534:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.346553:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055b6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7795b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.346629:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.346641:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.346862:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.346877:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.346882:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.346887:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147140.346905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.346926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.346950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147140.347000:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347009:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347014:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147140.347022:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147140.347126:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347134:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347139:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147140.347141:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307911296 00010000:00010000:3.0:1746147140.347144:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147140.347145:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307911296 00010000:00010000:3.0:1746147140.347150:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.347153:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347160:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347170:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147140.347172:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.347176:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00002000:00100000:2.0:1746147140.347178:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880093146a00 x1830967307911296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147140.347181:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055b72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00002000:00100000:2.0:1746147140.347193:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146a00 with x1830967307911296 ext(0->1048575) 00002000:00010000:2.0:1746147140.347198:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146a00 00000100:00100000:2.0:1746147140.347214:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3415 00000100:00100000:2.0:1746147140.347220:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307911296:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.347253:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307910784 00000100:00100000:0.0:1746147140.347257:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307910784 00010000:00010000:0.0:1746147140.347275:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746147140.347293:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307911424 00000100:00100000:0.0:1746147140.347295:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307911424 00010000:00010000:0.0:1746147140.347305:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 7 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.347858:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347865:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347870:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347875:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.347878:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347883:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347891:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5c00) 00010000:00010000:3.0:1746147140.347893:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.347896:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347901:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.347948:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 26 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.347960:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 25 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.347966:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.347968:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147140.347970:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff600, rc 0) 00000100:00100000:3.0:1746147140.348005:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+25:32225:x1830967307911168:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1663us (2128us total) trans 8589935909 rc 0/0 00000100:00100000:3.0:1746147140.348012:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15236 00000100:00100000:3.0:1746147140.348041:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310654208 00000100:00100000:3.0:1746147140.348045:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310654208 00000100:00100000:3.0:1746147140.348074:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1746147140.348079:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310654208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746147140.348114:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 806912 granted 1167070272 pending 0 free 3904991232 avail 3666857984 00000100:00100000:3.0:1746147140.348162:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310654208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.348167:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1746147140.348382:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310654208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147140.348645:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6297 00000100:00100000:0.0:1746147140.348653:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307910784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147140.348664:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147140.348680:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 28 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.348691:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 28 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.348706:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d200/0x313993942505588c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777f6 expref: 28 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.348804:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147140.348829:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307910784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 176us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.348835:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6297 00000100:00100000:0.0:1746147140.348848:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6298 00000100:00100000:0.0:1746147140.348852:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307911424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147140.348858:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147140.348865:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 7 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.348873:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 7 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.348884:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425055877 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e1 expref: 7 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.348891:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.348893:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.348900:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.348907:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.348933:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.348945:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310654336:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147140.348999:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00080000:0.0:1746147140.349068:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147140.352813:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310654336:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147140.352830:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.352886:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+6:2002:x1830967307911424:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4034us (5936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.352894:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6298 00000100:00100000:0.0:1746147140.353074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.353558:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307911680 00000100:00100000:2.0:1746147140.353566:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307911680 00002000:00100000:2.0:1746147140.353606:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2134016->2138111) req@ffff880098e12a00 x1830967307911680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.353615:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12a00 with x1830967307911680 ext(2134016->2138111) 00002000:00010000:2.0:1746147140.353621:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e12a00 00000100:00100000:2.0:1746147140.353718:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3416 00000100:00100000:2.0:1746147140.353725:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307911680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.353869:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307911680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 143us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147140.353875:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3416 00002000:00100000:2.0:1746147140.353880:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2134016->2138111) req@ffff880098e12a00 x1830967307911680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.353892:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e12a00 with x1830967307911680 ext(2134016->2138111) 00002000:00010000:2.0:1746147140.353895:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e12a00 00000100:00100000:2.0:1746147140.355617:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307911296:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8388us (8680us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147140.355628:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3415 00002000:00100000:2.0:1746147140.355636:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880093146a00 x1830967307911296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.355643:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146a00 with x1830967307911296 ext(0->1048575) 00002000:00010000:2.0:1746147140.355647:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146a00 00000100:00100000:0.0:1746147140.355700:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.355796:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307911936 00000100:00100000:2.0:1746147140.355801:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307911936 00000100:00100000:2.0:1746147140.355835:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5444 00000100:00100000:2.0:1746147140.355841:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:32225:x1830967307911936:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147140.356611:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:32225:x1830967307911936:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 768us (909us total) trans 8589935910 rc 0/0 00000100:00100000:2.0:1746147140.356617:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5444 00000100:00100000:0.0:1746147140.357003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.357046:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307912192 00000100:00100000:2.0:1746147140.357050:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307912192 00000100:00100000:2.0:1746147140.357081:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5445 00000100:00100000:2.0:1746147140.357086:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32218:x1830967307912192:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147140.357210:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32218:x1830967307912192:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 122us (206us total) trans 8589935911 rc 0/0 00000100:00100000:2.0:1746147140.357217:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5445 00000100:00100000:0.0:1746147140.364364:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.364493:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307912320 00000100:00100000:2.0:1746147140.364503:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307912320 00000100:00100000:2.0:1746147140.364562:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14417 00000100:00100000:2.0:1746147140.364571:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32223:x1830967307912320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.364591:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.364610:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77962 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.364640:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.364648:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.364650:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.364653:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.364686:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.364699:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 19 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.364711:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310654464:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.364825:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.366556:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310654464:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.366591:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.366615:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09e800, rc 0) 00000100:00100000:2.0:1746147140.366655:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32223:x1830967307912320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2084us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.366663:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14417 00000100:00100000:0.0:1746147140.367056:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.367115:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307912448 00000100:00100000:2.0:1746147140.367121:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307912448 00002000:00100000:2.0:1746147140.367155:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1638400->1929215) req@ffff880095063800 x1830967307912448/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.367168:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063800 with x1830967307912448 ext(1638400->1929215) 00010000:00010000:2.0:1746147140.367174:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 20 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.367187:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 20 pid: 12201 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746147140.367193:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095063800 00000100:00100000:2.0:1746147140.367600:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1082 00000100:00100000:2.0:1746147140.367608:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967307912448:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147140.370961:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307912448:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3342us (3893us total) trans 21474841452 rc 0/0 00000100:00100000:2.0:1746147140.370973:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1082 00002000:00100000:2.0:1746147140.370996:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1638400->1929215) req@ffff880095063800 x1830967307912448/t21474841452(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.371011:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063800 with x1830967307912448 ext(1638400->1929215) 00010000:00010000:2.0:1746147140.371022:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 22 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.371036:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 22 pid: 12201 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746147140.371043:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095063800 00000100:00100000:1.0:1746147140.372626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.372705:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307912576 00000100:00100000:3.0:1746147140.372716:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307912576 00000001:00080000:2.0:1746147140.372721:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841452 is committed 00000001:00080000:2.0:1746147140.372735:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841449 is committed 00010000:00010000:3.0:1746147140.372753:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 12 pid: 12201 timeout: 778 lvb_type: 0 00000001:00080000:2.0:1746147140.372756:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841442 is committed 00000100:00100000:3.0:1746147140.372782:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6299 00000100:00100000:3.0:1746147140.372790:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307912576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.372805:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1746147140.372810:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841408 is committed 00010000:00010000:3.0:1746147140.372826:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.372837:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.372863:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425055b02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1929215) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7792a expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.372884:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.372887:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.372894:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.372903:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.372941:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.372954:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310654592:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.373056:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.375043:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310654592:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.375064:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.375166:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967307912576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2375us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.375178:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6299 00000100:00100000:0.0:1746147140.378315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.378380:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307912960 00000100:00100000:2.0:1746147140.378390:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307912960 00000100:00100000:0.0:1746147140.378416:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147140.378431:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880095061880 x1830967307912960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.378440:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061880 with x1830967307912960 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.378444:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095061880 00000100:00100000:2.0:1746147140.379237:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307913088 00000100:00100000:2.0:1746147140.379241:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307913088 00002000:00100000:2.0:1746147140.379260:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1314815) req@ffff880095061c00 x1830967307913088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.379266:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061c00 with x1830967307913088 ext(1048576->1314815) 00002000:00010000:2.0:1746147140.379269:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095061c00 00000100:00100000:3.0:1746147140.379905:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3417 00000100:00100000:3.0:1746147140.379921:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967307912960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.380125:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3418 00000100:00100000:2.0:1746147140.380146:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307913088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.385563:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307913088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5411us (7139us total) trans 0 rc 266240/266240 00000100:00100000:2.0:1746147140.385573:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3418 00002000:00100000:2.0:1746147140.385583:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1314815) req@ffff880095061c00 x1830967307913088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 266240/266240 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.385591:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061c00 with x1830967307913088 ext(1048576->1314815) 00002000:00010000:2.0:1746147140.385595:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095061c00 00000100:00100000:3.0:1746147140.387679:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967307912960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7752us (9362us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147140.387693:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3417 00002000:00100000:3.0:1746147140.387704:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880095061880 x1830967307912960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.387713:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061880 with x1830967307912960 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.387719:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095061880 00000100:00100000:0.0:1746147140.401720:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.401931:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307913344 00000100:00100000:3.0:1746147140.401943:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307913344 00002000:00100000:3.0:1746147140.402003:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2138112->4194303) req@ffff880095062d80 x1830967307913344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.402019:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062d80 with x1830967307913344 ext(2138112->4194303) 00002000:00010000:3.0:1746147140.402025:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062d80 00000100:00100000:3.0:1746147140.402066:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3419 00000100:00100000:3.0:1746147140.402074:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307913344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.412927:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967307913344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10842us (11208us total) trans 0 rc 2056192/2056192 00000100:00100000:3.0:1746147140.412939:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3419 00002000:00100000:3.0:1746147140.412950:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2138112->4194303) req@ffff880095062d80 x1830967307913344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 2056192/2056192 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.412960:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062d80 with x1830967307913344 ext(2138112->4194303) 00002000:00010000:3.0:1746147140.412966:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062d80 00000100:00100000:0.0:1746147140.424556:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.424664:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307913600 00000100:00100000:3.0:1746147140.424674:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307913600 00002000:00100000:3.0:1746147140.424723:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095063480 x1830967307913600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.424734:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063480 with x1830967307913600 ext(4194304->4919295) 00002000:00010000:3.0:1746147140.424741:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063480 00000100:00100000:3.0:1746147140.424776:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3420 00000100:00100000:3.0:1746147140.424785:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307913600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.433176:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307913600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8378us (8617us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147140.433189:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3420 00002000:00100000:3.0:1746147140.433203:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095063480 x1830967307913600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.433212:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063480 with x1830967307913600 ext(4194304->4919295) 00002000:00010000:3.0:1746147140.433219:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063480 00000100:00100000:0.0:1746147140.442262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.444077:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307913856 00000100:00100000:2.0:1746147140.444102:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307913856 00000100:00100000:2.0:1746147140.444156:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5446 00000100:00100000:2.0:1746147140.444164:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32223:x1830967307913856:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147140.444364:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32223:x1830967307913856:12345-192.168.204.25@tcp:35:cat.0 Request processed in 200us (2110us total) trans 8589935912 rc 0/0 00000100:00100000:2.0:1746147140.444371:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5446 00000100:00100000:0.0:1746147140.453773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.454440:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307914112 00000100:00100000:3.0:1746147140.454450:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307914112 00000100:00100000:3.0:1746147140.454601:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15237 00000100:00100000:3.0:1746147140.454610:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:32229:x1830967307914112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.454633:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.454652:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055b95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77969 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.454724:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454736:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454746:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454759:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454764:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454769:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454865:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055baa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454875:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055baa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454880:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055baa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147140.454887:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147140.454961:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454967:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454972:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454987:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.454992:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.454996:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455002:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455013:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147140.455016:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.455019:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455024:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425055b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455054:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455058:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455062:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455066:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.455068:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455073:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455078:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5300) 00010000:00010000:3.0:1746147140.455080:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.455082:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455086:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055ba3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.455478:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77969 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.455491:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055baa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77969 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.455497:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.455499:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147140.455502:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ffe00, rc 0) 00000100:00100000:3.0:1746147140.455559:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:32229:x1830967307914112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 950us (1796us total) trans 8589935913 rc 0/0 00000100:00100000:3.0:1746147140.455565:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15237 00000100:00100000:0.0:1746147140.458578:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.458653:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.458748:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307914368 00000100:00100000:0.0:1746147140.458752:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.458757:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307914368 00000100:00100000:2.0:1746147140.458795:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307914496 00000100:00100000:2.0:1746147140.458797:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307914496 00000100:00100000:0.0:1746147140.458831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.458865:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307914240 00000100:00100000:3.0:1746147140.458869:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307914240 00000100:00100000:3.0:1746147140.458907:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 800 00000100:00100000:3.0:1746147140.458921:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2002:x1830967307914240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.458938:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.459034:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055baa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77969 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.459267:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.459271:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.459334:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:2002:x1830967307914240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 419us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.459340:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 800 00000100:00100000:2.0:1746147140.459407:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307914624 00000100:00100000:2.0:1746147140.459411:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307914624 00000100:00100000:0.0:1746147140.459416:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14418 00000100:00100000:0.0:1746147140.459423:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307914368:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147140.459432:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14419 00000100:00100000:2.0:1746147140.459438:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307914496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.459444:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.459446:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.459459:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x3139939425055bbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77977 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.459459:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77970 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.459477:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.459479:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.459487:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.459501:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147140.459505:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310654720:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147140.459508:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8fc00, rc 0) 00000100:00100000:0.0:1746147140.459526:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307914368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 104us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.459531:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14418 00000100:00100000:0.0:1746147140.459543:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14420 00000100:00100000:0.0:1746147140.459547:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307914624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.459552:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.459558:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x3139939425055bc6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7797e expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.459563:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.459578:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310654848:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.459596:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00002000:00010000:3.0:1746147140.462312:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147139 -> 1746147140 00002000:00010000:3.0:1746147140.462321:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147139 -> 1746147140 00002000:00010000:3.0:1746147140.462323:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147139 -> 1746147140 00002000:00010000:2.0:1746147140.462323:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147139 -> 1746147140 00002000:00010000:2.0:1746147140.462327:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147137 -> 1746147140 00002000:00010000:2.0:1746147140.462328:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147139 -> 1746147140 00000100:00100000:3.0:1746147140.462345:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310654720:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.462345:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310654848:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.462375:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x3139939425055bbf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77977 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.462375:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x3139939425055bc6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7797e expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.462387:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x3139939425055bc6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7797e expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.462388:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x3139939425055bbf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77977 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.462402:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6200, rc 0) 00000100:00100000:3.0:1746147140.462451:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307914496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3012us (3697us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.462459:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14419 00010000:00010000:2.0:1746147140.462617:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e000, rc 0) 00000100:00100000:2.0:1746147140.462644:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+6:2000:x1830967307914624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3095us (3812us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.462649:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14420 00000100:00100000:2.0:1746147140.471148:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.471269:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307914880 00000100:00100000:3.0:1746147140.471280:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307914880 00002000:00100000:3.0:1746147140.471334:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880093147100 x1830967307914880/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.471345:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093147100 with x1830967307914880 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.471351:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093147100 00000100:00100000:3.0:1746147140.471388:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3421 00000100:00100000:3.0:1746147140.471397:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307914880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.485841:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307914880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14431us (14693us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147140.485855:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3421 00002000:00100000:2.0:1746147140.485868:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880093147100 x1830967307914880/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.485878:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093147100 with x1830967307914880 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.485885:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093147100 00000100:00100000:0.0:1746147140.488271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.488354:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915136 00000100:00100000:3.0:1746147140.488367:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915136 00000100:00100000:3.0:1746147140.488443:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15238 00000100:00100000:3.0:1746147140.488452:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32232:x1830967307915136:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.488480:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.488504:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425055bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77985 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.488588:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488602:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488617:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488631:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488637:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488642:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488747:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055be2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488757:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055be2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488763:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055be2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147140.488771:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147140.488850:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488856:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488862:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488868:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488873:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ffe00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.488877:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488884:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488895:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147140.488898:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.488902:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488907:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffe00/0x3139939425055bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488939:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488945:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488949:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488953:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.488955:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488960:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488966:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5b00) 00010000:00010000:3.0:1746147140.488969:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.488971:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.488990:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe200/0x3139939425055bdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.489026:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425055bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77985 expref: 49 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.489037:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055be2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77985 expref: 48 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.489043:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.489050:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147140.489052:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe000, rc 0) 00000100:00100000:3.0:1746147140.489160:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32232:x1830967307915136:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 708us (895us total) trans 8589935914 rc 0/0 00000100:00100000:3.0:1746147140.489167:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15238 00000100:00100000:0.0:1746147140.492885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.492991:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915264 00000100:00100000:2.0:1746147140.493001:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915264 00000100:00100000:2.0:1746147140.493059:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14421 00000100:00100000:2.0:1746147140.493069:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+6:32229:x1830967307915264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.493124:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.493145:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7798c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.493176:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.493184:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.493186:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.493189:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.493221:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.493233:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 24 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.493246:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310654976:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.494146:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.494518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.495315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.495410:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915520 00000100:00100000:2.0:1746147140.495417:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915520 00000100:00100000:2.0:1746147140.495717:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14422 00000100:00100000:2.0:1746147140.495726:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:32232:x1830967307915520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147140.495742:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.495762:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77993 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.495789:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.495798:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 7 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.495804:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.495806:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.495808:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1888256->1994751] (req 1888256->1994751) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.495836:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 7 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.495847:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 7 pid: 12225 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746147140.495859:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655104:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.495986:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915392 00000100:00100000:3.0:1746147140.495990:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915392 00010000:00010000:2.0:1746147140.496729:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.496740:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 23 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.496751:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.496821:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 801 00000100:00100000:3.0:1746147140.496829:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2003:x1830967307915392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.496839:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.496861:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425055be2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77985 expref: 48 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.496875:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.496879:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.496901:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2003:x1830967307915392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.496911:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 801 00000100:00100000:2.0:1746147140.497208:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.497952:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310654976:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.497974:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.498000:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e573600, rc 0) 00000100:00100000:2.0:1746147140.498038:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:32229:x1830967307915264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4970us (5164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.498045:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14421 00000100:00100000:0.0:1746147140.498416:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.498597:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915648 00000100:00100000:3.0:1746147140.498604:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915648 00002000:00100000:3.0:1746147140.498641:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1314816->2097151) req@ffff880099889f80 x1830967307915648/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.498651:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889f80 with x1830967307915648 ext(1314816->2097151) 00010000:00010000:3.0:1746147140.498658:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 25 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.498668:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 25 pid: 12201 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.498675:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099889f80 00000100:00100000:3.0:1746147140.498691:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1083 00000100:00100000:3.0:1746147140.498697:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307915648:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147140.501416:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655104:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.501432:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655232:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147140.501435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.501465:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1888256->1994751] (req 1888256->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.501487:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ff6200, rc 0) 00000100:00100000:3.0:1746147140.501509:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915904 00000100:00100000:0.0:1746147140.501511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.501515:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915904 00000100:00100000:2.0:1746147140.501528:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32232:x1830967307915520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5803us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.501536:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14422 00010000:00010000:3.0:1746147140.501545:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 24 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.501797:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307915776 00000100:00100000:3.0:1746147140.501801:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307915776 00010000:00010000:3.0:1746147140.501814:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 8 pid: 12225 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746147140.501971:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6300 00000100:00100000:3.0:1746147140.501990:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967307915904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.502003:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.502023:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 23 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.502033:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 23 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.502056:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425055a99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e778eb expref: 23 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.502551:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6301 00000100:00100000:1.0:1746147140.502561:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967307915776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.502570:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.502582:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 8 pid: 12225 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.502591:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 8 pid: 12225 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.502605:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b403a000/0x3139939425055aca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77900 expref: 8 pid: 12225 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.502625:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.502627:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.502633:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.502640:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.502669:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.502680:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310655360:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.502793:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.502847:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.503120:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967307915904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1141us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.503128:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6300 00000100:00100000:1.0:1746147140.506237:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310655360:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.506262:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.506306:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307915776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3747us (4794us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.506316:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6301 00000100:00100000:0.0:1746147140.509333:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307915648:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 10621us (10903us total) trans 17179874188 rc 0/0 00000100:00100000:0.0:1746147140.509349:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1083 00002000:00100000:0.0:1746147140.509368:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1314816->2097151) req@ffff880099889f80 x1830967307915648/t17179874188(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.509378:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889f80 with x1830967307915648 ext(1314816->2097151) 00010000:00010000:0.0:1746147140.509389:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.509406:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746147140.509412:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099889f80 00000100:00100000:1.0:1746147140.509484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.510734:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307916160 00000100:00100000:0.0:1746147140.510745:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307916160 00002000:00100000:0.0:1746147140.510787:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1888256->1892351) req@ffff880099151180 x1830967307916160/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.510796:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151180 with x1830967307916160 ext(1888256->1892351) 00002000:00010000:0.0:1746147140.510801:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151180 00000100:00100000:0.0:1746147140.510832:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3422 00000100:00100000:0.0:1746147140.510840:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967307916160:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147140.510988:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967307916160:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (1502us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147140.510995:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3422 00002000:00100000:0.0:1746147140.511001:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1888256->1892351) req@ffff880099151180 x1830967307916160/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.511014:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151180 with x1830967307916160 ext(1888256->1892351) 00002000:00010000:0.0:1746147140.511016:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151180 00000100:00100000:0.0:1746147140.515294:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.515518:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307916288 00000100:00100000:1.0:1746147140.515528:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307916288 00010000:00010000:1.0:1746147140.515566:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.515609:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6302 00000100:00100000:1.0:1746147140.515618:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307916288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.515634:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.515655:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.515668:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.515691:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff200/0x3139939425055b33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7793f expref: 27 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.515711:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.515713:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.515721:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 6 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.515729:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 6 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.515774:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 6 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.515788:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310655488:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147140.515859:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.516451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.516647:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307916544 00000100:00100000:2.0:1746147140.516653:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307916544 00002000:00100000:2.0:1746147140.516687:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1990656->1994751) req@ffff880099889880 x1830967307916544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.516703:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889880 with x1830967307916544 ext(1990656->1994751) 00002000:00010000:2.0:1746147140.516708:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099889880 00000100:00100000:2.0:1746147140.516736:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3423 00000100:00100000:2.0:1746147140.516743:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967307916544:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147140.516870:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967307916544:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 126us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147140.516876:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3423 00002000:00100000:2.0:1746147140.516882:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1990656->1994751) req@ffff880099889880 x1830967307916544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.516889:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889880 with x1830967307916544 ext(1990656->1994751) 00002000:00010000:2.0:1746147140.516892:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099889880 00000100:00100000:1.0:1746147140.521504:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310655488:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.521533:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.521721:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307916288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6102us (6438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.521732:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6302 00000100:00100000:0.0:1746147140.521893:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.522000:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307916800 00000100:00100000:2.0:1746147140.522007:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307916800 00002000:00100000:2.0:1746147140.522046:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009988aa00 x1830967307916800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.522055:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988aa00 with x1830967307916800 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.522059:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988aa00 00000100:00100000:2.0:1746147140.522075:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3424 00000100:00100000:2.0:1746147140.522082:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307916800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.522250:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.522382:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917056 00000100:00100000:1.0:1746147140.522386:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917056 00000100:00100000:1.0:1746147140.522421:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5447 00000100:00100000:1.0:1746147140.522427:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32232:x1830967307917056:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147140.522590:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32232:x1830967307917056:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 163us (340us total) trans 8589935915 rc 0/0 00000100:00100000:1.0:1746147140.522596:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5447 00000100:00100000:2.0:1746147140.535427:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967307916800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13332us (13522us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147140.535442:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3424 00002000:00100000:2.0:1746147140.535455:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009988aa00 x1830967307916800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.535465:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988aa00 with x1830967307916800 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.535471:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988aa00 00000100:00100000:0.0:1746147140.542511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.542614:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.542721:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917184 00000100:00100000:2.0:1746147140.542731:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917184 00000100:00100000:2.0:1746147140.542785:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917312 00000100:00100000:2.0:1746147140.542788:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917312 00000100:00100000:3.0:1746147140.542792:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14423 00000100:00100000:3.0:1746147140.542804:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:32229:x1830967307917184:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147140.542807:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14424 00000100:00100000:2.0:1746147140.542812:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:32225:x1830967307917312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.542824:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.542824:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.542843:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7799a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.542843:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779a1 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.542870:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.542870:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.542878:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.542885:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.542887:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.542890:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2441216->3145727] (req 2441216->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.542924:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.542940:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.542953:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655616:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.543082:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.543114:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 21 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.543122:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655744:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.543153:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147140.543614:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.543616:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.543620:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.543639:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.543647:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.543655:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310655872:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.543681:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.545817:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310655872:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.545818:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655616:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.545832:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310655744:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.545845:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.545860:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2441216->3145727] (req 2441216->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.545861:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ec00, rc 0) 00010000:00010000:2.0:1746147140.545875:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cc800, rc 0) 00000100:00100000:3.0:1746147140.545903:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:32229:x1830967307917184:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3100us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.545912:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14423 00000100:00100000:2.0:1746147140.545917:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+8:32225:x1830967307917312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3103us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.545925:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14424 00000100:00100000:0.0:1746147140.546252:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.546429:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917440 00000100:00100000:2.0:1746147140.546435:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917440 00002000:00100000:2.0:1746147140.546470:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2138111) req@ffff880094534e00 x1830967307917440/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.546479:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534e00 with x1830967307917440 ext(2097152->2138111) 00010000:00010000:2.0:1746147140.546486:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.546495:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 26 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746147140.546501:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094534e00 00000100:00100000:2.0:1746147140.546827:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1084 00000100:00100000:2.0:1746147140.546835:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307917440:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147140.549343:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.549431:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917568 00000100:00100000:1.0:1746147140.549440:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917568 00010000:00010000:1.0:1746147140.549478:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 22 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.549516:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6303 00000100:00100000:1.0:1746147140.549524:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967307917568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.549537:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.549555:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 22 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.549566:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 22 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.549587:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4200/0x313993942505587e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777e8 expref: 22 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.549815:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.549857:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967307917568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 334us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.549867:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6303 00000100:00100000:0.0:1746147140.549971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.550176:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917696 00000100:00100000:1.0:1746147140.550180:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917696 00010000:00010000:1.0:1746147140.550197:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.550225:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6304 00000100:00100000:1.0:1746147140.550231:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307917696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.550239:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.550247:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.550255:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.550267:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425055885 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e777ef expref: 8 pid: 12201 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.550275:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.550277:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.550283:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 7 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.550290:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 7 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.550319:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 7 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.550330:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310656000:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147140.550455:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.550837:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307917440:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4002us (4586us total) trans 17179874189 rc 0/0 00000100:00100000:0.0:1746147140.550845:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1084 00002000:00100000:0.0:1746147140.550853:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2138111) req@ffff880094534e00 x1830967307917440/t17179874189(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.550862:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534e00 with x1830967307917440 ext(2097152->2138111) 00010000:00010000:0.0:1746147140.550869:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 28 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.550879:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 28 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746147140.550884:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094534e00 00000100:00100000:1.0:1746147140.552602:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310656000:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.552624:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.552690:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307917696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2458us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.552700:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6304 00000100:00100000:0.0:1746147140.553238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.553312:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307917952 00000100:00100000:2.0:1746147140.553320:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307917952 00002000:00100000:2.0:1746147140.553357:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2441216->2445311) req@ffff880094536a00 x1830967307917952/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.553367:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536a00 with x1830967307917952 ext(2441216->2445311) 00002000:00010000:2.0:1746147140.553371:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094536a00 00000100:00100000:2.0:1746147140.553422:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3425 00000100:00100000:2.0:1746147140.553429:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307917952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147140.553553:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307917952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 125us (316us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147140.553558:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3425 00002000:00100000:2.0:1746147140.553563:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2441216->2445311) req@ffff880094536a00 x1830967307917952/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.553571:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536a00 with x1830967307917952 ext(2441216->2445311) 00002000:00010000:2.0:1746147140.553574:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094536a00 00000100:00100000:0.0:1746147140.557086:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.557348:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307918080 00000100:00100000:1.0:1746147140.557358:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307918080 00010000:00010000:1.0:1746147140.557399:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 28 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.557510:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6305 00000100:00100000:1.0:1746147140.557519:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307918080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.557536:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.557556:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 28 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.557569:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 28 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.557595:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425055b64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77954 expref: 28 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.557613:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.557615:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.557623:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.557631:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.557668:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.557680:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310656128:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147140.558359:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.562486:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310656128:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.562515:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.562563:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307918080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5044us (5485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.562573:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6305 00000100:00100000:0.0:1746147140.567180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.567214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.567435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.568205:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307918720 00000100:00100000:1.0:1746147140.568215:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307918720 00002000:00100000:1.0:1746147140.568263:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880094534000 x1830967307918720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.568274:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534000 with x1830967307918720 ext(2097152->4194303) 00002000:00010000:1.0:1746147140.568280:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094534000 00000100:00100000:3.0:1746147140.568293:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307918592 00000100:00100000:3.0:1746147140.568298:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307918592 00000100:00100000:1.0:1746147140.568300:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307918848 00000100:00100000:1.0:1746147140.568303:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307918848 00002000:00100000:1.0:1746147140.568314:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880094535180 x1830967307918848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 504/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.568321:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535180 with x1830967307918848 ext(2097152->4194303) 00002000:00010000:1.0:1746147140.568324:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094535180 00000100:00100000:1.0:1746147140.568336:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3426 00000100:00100000:3.0:1746147140.568338:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15239 00000100:00100000:1.0:1746147140.568343:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307918720:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147140.568344:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32236:x1830967307918592:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147140.568345:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3427 00000100:00100000:0.0:1746147140.568351:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307918848:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:3.0:1746147140.568363:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.568382:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055c0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779a8 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.568455:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568467:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568493:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568503:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568508:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568512:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568607:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x3139939425055c21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568617:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x3139939425055c21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568622:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x3139939425055c21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147140.568629:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147140.568702:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568708:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568717:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568722:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568727:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.568731:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568737:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568747:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147140.568749:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.568753:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568758:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x3139939425055c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568775:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568779:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568783:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568786:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256ee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.568788:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568796:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568801:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f2c5e00) 00010000:00010000:3.0:1746147140.568802:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.568804:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568808:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x3139939425055c1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.568842:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x3139939425055c0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a8 expref: 51 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.568851:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x3139939425055c21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a8 expref: 50 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.568857:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.568859:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147140.568861:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e600, rc 0) 00000100:00100000:3.0:1746147140.568908:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32236:x1830967307918592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 564us (1473us total) trans 8589935916 rc 0/0 00000100:00100000:3.0:1746147140.568913:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15239 00000100:00100000:3.0:1746147140.571954:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.572257:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307918976 00000100:00100000:1.0:1746147140.572266:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307918976 00000100:00100000:1.0:1746147140.572330:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 802 00000100:00100000:1.0:1746147140.572339:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307918976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.572355:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.572381:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x3139939425055c21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a8 expref: 50 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.572408:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147140.572412:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.572443:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967307918976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 105us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.573144:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 802 00000100:00100000:0.0:1746147140.574076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.574130:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307919104 00000100:00100000:2.0:1746147140.574137:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307919104 00000100:00100000:0.0:1746147140.574161:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.574174:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307919232 00000100:00100000:2.0:1746147140.574177:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307919232 00000100:00100000:2.0:1746147140.574196:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14425 00000100:00100000:2.0:1746147140.574204:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307919104:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147140.574215:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14426 00000100:00100000:3.0:1746147140.574221:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307919232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.574221:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.574226:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.574237:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779b6 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.574259:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.574260:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.574268:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.574284:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.574294:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372c400, rc 0) 00000100:00100000:3.0:1746147140.574453:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307919232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 231us (291us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147140.574455:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779af expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.574459:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14426 00010000:00010000:2.0:1746147140.574466:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.574467:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.574472:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.574483:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.574491:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cc000, rc 0) 00000100:00100000:2.0:1746147140.574514:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307919104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 311us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.574519:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14425 00000100:00100000:0.0:1746147140.575692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.575737:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307919360 00000100:00100000:2.0:1746147140.575744:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307919360 00000100:00100000:2.0:1746147140.575783:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14427 00000100:00100000:2.0:1746147140.575789:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967307919360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.575802:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.575817:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055c3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779bd expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.575859:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310656256:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.575944:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.589019:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307918720:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 20664us (21838us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147140.589031:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3426 00002000:00100000:1.0:1746147140.589043:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880094534000 x1830967307918720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.589053:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534000 with x1830967307918720 ext(2097152->4194303) 00002000:00010000:1.0:1746147140.589058:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094534000 00002000:00010000:2.0:1746147140.589300:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147139 -> 1746147140 00002000:00010000:2.0:1746147140.589304:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147138 -> 1746147140 00002000:00010000:2.0:1746147140.589306:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147139 -> 1746147140 00000100:00100000:2.0:1746147140.589320:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310656256:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.589353:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055c3d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779bd expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.589366:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055c3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779bd expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.589382:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cca00, rc 0) 00000100:00100000:2.0:1746147140.589731:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967307919360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 13940us (14041us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.589737:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14427 00000100:00100000:0.0:1746147140.590344:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307918848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21993us (23128us total) trans 0 rc 1392640/1392640 00000100:00100000:0.0:1746147140.590352:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3427 00002000:00100000:0.0:1746147140.590358:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880094535180 x1830967307918848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 504/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1392640/1392640 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.590365:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535180 with x1830967307918848 ext(2097152->4194303) 00002000:00010000:0.0:1746147140.590369:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094535180 00000100:00100000:0.0:1746147140.598326:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.598447:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307919744 00000100:00100000:2.0:1746147140.598457:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307919744 00000100:00100000:2.0:1746147140.598526:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14428 00000100:00100000:2.0:1746147140.598535:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+8:32225:x1830967307919744:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147140.598556:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.598576:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779c4 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.598607:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.598611:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.598618:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 28 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.598624:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.598625:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.598628:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3473407] (req 3145728->3473407) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 9 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.598998:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 28 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.599014:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 28 pid: 1136 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746147140.599164:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310656384:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.599311:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.599319:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.599333:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310656512:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.599359:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.599707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.599846:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307919872 00000100:00100000:1.0:1746147140.599852:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307919872 00000100:00100000:2.0:1746147140.599863:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307920000 00000100:00100000:2.0:1746147140.599867:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307920000 00002000:00100000:2.0:1746147140.599887:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880094537100 x1830967307920000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.599887:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094535c00 x1830967307919872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 504/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.599896:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537100 with x1830967307920000 ext(1048576->2097151) 00002000:00100000:1.0:1746147140.599896:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535c00 with x1830967307919872 ext(1048576->2097151) 00002000:00010000:2.0:1746147140.599900:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094537100 00002000:00010000:1.0:1746147140.599905:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094535c00 00000100:00100000:1.0:1746147140.599935:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3428 00000100:00100000:1.0:1746147140.599943:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307920000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.600056:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3429 00000100:00100000:3.0:1746147140.600063:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967307919872:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.604697:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310656384:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.604711:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310656512:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.604745:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3473407] (req 3145728->3473407) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 9 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.604764:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cdc00, rc 0) 00000100:00100000:2.0:1746147140.604819:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+9:32225:x1830967307919744:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6284us (6503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.604829:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14428 00000100:00100000:1.0:1746147140.605572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.605596:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307920256 00000100:00100000:1.0:1746147140.605603:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307920256 00000100:00100000:3.0:1746147140.605709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147140.605771:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 31 pid: 1136 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746147140.605792:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6306 00000100:00100000:1.0:1746147140.605798:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307920256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.605811:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.605828:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 31 pid: 1136 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.605838:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 31 pid: 1136 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.605858:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425055c2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779b6 expref: 31 pid: 1136 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.605878:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.605895:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307920256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.605899:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6306 00000100:00100000:2.0:1746147140.606149:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307920128 00000100:00100000:2.0:1746147140.606152:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307920128 00000100:00100000:2.0:1746147140.606172:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14429 00000100:00100000:2.0:1746147140.606177:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307920128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.606191:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.606204:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098db1e00/0x3139939425055c4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779cb expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.606247:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310656640:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.606294:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.609690:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.610008:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307920384 00000100:00100000:3.0:1746147140.610017:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307920384 00010000:00010000:3.0:1746147140.610050:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.610078:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6307 00000100:00100000:3.0:1746147140.610085:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307920384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.610119:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.610137:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.610155:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.610176:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256ec00/0x3139939425055c05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7799a expref: 9 pid: 1136 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.610204:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.610206:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.610212:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.610223:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.610255:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.610266:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310656768:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.610333:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.610532:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307920000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10588us (10824us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147140.610541:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3428 00002000:00100000:1.0:1746147140.610549:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880094537100 x1830967307920000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.610558:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537100 with x1830967307920000 ext(1048576->2097151) 00002000:00010000:1.0:1746147140.610562:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094537100 00002000:00010000:2.0:1746147140.611520:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746147139 -> 1746147140 00002000:00010000:2.0:1746147140.611524:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147139 -> 1746147140 00002000:00010000:2.0:1746147140.611527:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746147139 -> 1746147140 00000100:00100000:2.0:1746147140.611538:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310656640:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.611561:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098db1e00/0x3139939425055c4b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779cb expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.611572:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098db1e00/0x3139939425055c4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779cb expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.611595:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098db1e00, rc 0) 00000100:00100000:2.0:1746147140.611629:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307920128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5451us (5919us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.611636:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14429 00000100:00100000:3.0:1746147140.613287:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967307919872:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13215us (14667us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746147140.613298:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3429 00002000:00100000:3.0:1746147140.613308:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094535c00 x1830967307919872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 504/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.613318:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535c00 with x1830967307919872 ext(1048576->2097151) 00002000:00010000:3.0:1746147140.613324:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094535c00 00000100:00100000:3.0:1746147140.613572:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310656768:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.613588:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.613612:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307920384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3527us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.613621:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6307 00000100:00100000:0.0:1746147140.614372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.614480:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307920640 00000100:00100000:3.0:1746147140.614487:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307920640 00002000:00100000:3.0:1746147140.614517:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094535f80 x1830967307920640/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.614526:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535f80 with x1830967307920640 ext(4194304->4919295) 00002000:00010000:3.0:1746147140.614530:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535f80 00000100:00100000:3.0:1746147140.614639:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3430 00000100:00100000:3.0:1746147140.614647:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307920640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.619748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.620998:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307920896 00000100:00100000:1.0:1746147140.621008:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307920896 00002000:00100000:1.0:1746147140.621056:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3469312->3473407) req@ffff880094536680 x1830967307920896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.621066:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536680 with x1830967307920896 ext(3469312->3473407) 00002000:00010000:1.0:1746147140.621072:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094536680 00000100:00100000:1.0:1746147140.621147:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3431 00000100:00100000:1.0:1746147140.621156:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307920896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147140.621307:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307920896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 151us (1569us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147140.621313:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3431 00002000:00100000:1.0:1746147140.621319:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3469312->3473407) req@ffff880094536680 x1830967307920896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.621325:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536680 with x1830967307920896 ext(3469312->3473407) 00002000:00010000:1.0:1746147140.621328:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094536680 00000100:00100000:3.0:1746147140.622004:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307920640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7356us (7633us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147140.622012:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3430 00002000:00100000:3.0:1746147140.622017:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094535f80 x1830967307920640/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.622024:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535f80 with x1830967307920640 ext(4194304->4919295) 00002000:00010000:3.0:1746147140.622028:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535f80 00010000:00010000:0.0:1746147140.623958:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147140.627897:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.627993:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921024 00000100:00100000:2.0:1746147140.628002:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921024 00000100:00100000:2.0:1746147140.628059:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14430 00000100:00100000:2.0:1746147140.628068:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307921024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.628120:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.628142:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425055c52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779d2 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.628201:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310656896:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.628294:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.632902:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.632949:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.632990:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921152 00000100:00100000:3.0:1746147140.633001:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921152 00000100:00100000:3.0:1746147140.633039:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921280 00000100:00100000:3.0:1746147140.633041:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921280 00000100:00100000:3.0:1746147140.633057:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14431 00000100:00100000:3.0:1746147140.633064:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307921152:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147140.633064:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14432 00000100:00100000:0.0:1746147140.633073:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967307921280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.633083:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.633083:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.633125:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425055c59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779d9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.633125:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b7000/0x3139939425055c60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779e0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.633174:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310657152:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.633174:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310657024:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.633610:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.633669:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.634025:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310656896:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.634054:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425055c52 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779d2 expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.634065:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x3139939425055c52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779d2 expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.634087:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932e3800, rc 0) 00000100:00100000:2.0:1746147140.634143:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307921024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6076us (6258us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.634150:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14430 00000100:00100000:0.0:1746147140.639033:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310657024:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147140.639070:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7000/0x3139939425055c60 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779e0 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.639086:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7000/0x3139939425055c60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779e0 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147140.639245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.639271:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921408 00000100:00100000:2.0:1746147140.639277:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921408 00000100:00100000:2.0:1746147140.639322:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14433 00000100:00100000:2.0:1746147140.639331:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307921408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.639347:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.639362:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055c67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779e7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.639408:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310657280:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.639491:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.639590:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310657152:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.639609:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425055c59 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779d9 expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.639618:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4e00/0x3139939425055c59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779d9 expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.639641:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4e00, rc 0) 00000100:00100000:3.0:1746147140.639666:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307921152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6601us (6776us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.639672:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14431 00010000:00010000:0.0:1746147140.639724:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7000, rc 0) 00000100:00100000:0.0:1746147140.639765:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967307921280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6693us (6814us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147140.639770:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14432 00000100:00100000:2.0:1746147140.640948:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310657280:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.640969:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055c67 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779e7 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.640995:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cca00/0x3139939425055c67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779e7 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.641018:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cca00, rc 0) 00000100:00100000:2.0:1746147140.641367:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307921408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2036us (2122us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.641374:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14433 00000100:00100000:0.0:1746147140.644884:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.644941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.645330:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921536 00000100:00100000:2.0:1746147140.645339:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921536 00000100:00100000:2.0:1746147140.645394:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14434 00000100:00100000:2.0:1746147140.645404:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32236:x1830967307921536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.645424:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.645444:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779ee expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.645475:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 7 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.645482:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.645484:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.645487:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.645516:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 7 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.645532:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 7 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.645544:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310657408:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.645624:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.646556:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921792 00000100:00100000:1.0:1746147140.646563:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921792 00000100:00100000:1.0:1746147140.646602:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5448 00000100:00100000:1.0:1746147140.646608:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:32229:x1830967307921792:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147140.646786:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:32229:x1830967307921792:12345-192.168.204.25@tcp:35:cat.0 Request processed in 177us (1844us total) trans 8589935917 rc 0/0 00000100:00100000:1.0:1746147140.646792:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5448 00000100:00100000:2.0:1746147140.650900:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310657408:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.650938:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.650958:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:2.0:1746147140.651251:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32236:x1830967307921536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5670us (6199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.651261:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14434 00000100:00100000:3.0:1746147140.652590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.652657:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307922176 00000100:00100000:2.0:1746147140.652664:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307922176 00000100:00100000:2.0:1746147140.652708:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15240 00000100:00100000:2.0:1746147140.652716:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32239:x1830967307922176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147140.652740:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.652759:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425055c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779f5 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.652835:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652847:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652858:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652870:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652875:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652880:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652972:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425055c8a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652992:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425055c8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.652998:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425055c8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147140.653005:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147140.653079:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147140.653469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.653971:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.653988:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.653993:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0d000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.653997:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654007:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654019:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147140.654021:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.654025:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654029:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654058:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654063:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654067:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654071:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7ee400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.654074:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654078:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654084:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553100) 00010000:00010000:2.0:1746147140.654085:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.654101:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654106:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7ee400/0x3139939425055c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.654152:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425055c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779f5 expref: 52 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.654163:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425055c8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779f5 expref: 51 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.654169:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.654171:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147140.654173:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80400, rc 0) 00000100:00100000:2.0:1746147140.654219:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32239:x1830967307922176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1503us (1633us total) trans 8589935918 rc 0/0 00000100:00100000:2.0:1746147140.654226:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15240 00000100:00100000:3.0:1746147140.654641:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307921920 00000100:00100000:3.0:1746147140.654648:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307921920 00002000:00100000:3.0:1746147140.654684:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3473407) req@ffff8800a499b800 x1830967307921920/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.654694:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499b800 with x1830967307921920 ext(3145728->3473407) 00010000:00010000:3.0:1746147140.654703:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 8 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.654722:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 8 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.654729:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a499b800 00000100:00100000:3.0:1746147140.654754:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1085 00000100:00100000:3.0:1746147140.654761:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307921920:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147140.658914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.658967:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307922304 00000100:00100000:3.0:1746147140.658987:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307922304 00000100:00100000:3.0:1746147140.659047:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 803 00000100:00100000:3.0:1746147140.659055:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2003:x1830967307922304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.659071:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.659115:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425055c8a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779f5 expref: 51 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.659664:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.659670:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.659725:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967307922304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 671us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.659734:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 803 00000100:00100000:3.0:1746147140.663680:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307921920:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8904us (10195us total) trans 17179874190 rc 0/0 00000100:00100000:3.0:1746147140.663694:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1085 00002000:00100000:3.0:1746147140.663707:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3473407) req@ffff8800a499b800 x1830967307921920/t17179874190(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.663723:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499b800 with x1830967307921920 ext(3145728->3473407) 00010000:00010000:3.0:1746147140.663735:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 10 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.663752:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 10 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.663759:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a499b800 00000100:00100000:0.0:1746147140.673238:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.673719:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307922432 00000100:00100000:3.0:1746147140.673730:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307922432 00010000:00010000:3.0:1746147140.673769:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 10 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.673907:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6308 00000100:00100000:3.0:1746147140.673917:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307922432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.673933:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.673955:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 10 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.673968:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 10 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.674002:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x3139939425055c44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3473407) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779c4 expref: 10 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.674681:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.674684:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.674694:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.674703:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.674742:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.674755:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310657536:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.675178:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.679296:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310657536:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.679320:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.679416:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307922432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5498us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.679431:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6308 00000100:00100000:0.0:1746147140.684613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.684761:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307922688 00000100:00100000:3.0:1746147140.684770:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307922688 00002000:00100000:3.0:1746147140.684820:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800a4998e00 x1830967307922688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.684831:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998e00 with x1830967307922688 ext(2097152->3145727) 00002000:00010000:3.0:1746147140.684837:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998e00 00000100:00100000:3.0:1746147140.684873:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3432 00000100:00100000:3.0:1746147140.684880:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307922688:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.708321:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307922688:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23428us (23707us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147140.708335:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3432 00002000:00100000:3.0:1746147140.708349:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800a4998e00 x1830967307922688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.708359:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998e00 with x1830967307922688 ext(2097152->3145727) 00002000:00010000:3.0:1746147140.708366:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998e00 00000100:00100000:0.0:1746147140.711462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.711587:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307922816 00000100:00100000:2.0:1746147140.711597:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307922816 00000100:00100000:2.0:1746147140.711660:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14435 00000100:00100000:2.0:1746147140.711669:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:32236:x1830967307922816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.711688:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.711777:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e779fc expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.711811:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.711819:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.711821:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.711824:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.711860:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.711873:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 6 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.711885:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310657664:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.712000:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.715340:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.715374:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307922944 00000100:00100000:0.0:1746147140.715382:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307922944 00002000:00100000:0.0:1746147140.715426:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2441216->3145727) req@ffff8800a4999180 x1830967307922944/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.715435:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999180 with x1830967307922944 ext(2441216->3145727) 00010000:00010000:0.0:1746147140.715446:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 7 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746147140.715460:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 7 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746147140.715466:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4999180 00000100:00100000:0.0:1746147140.715501:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1086 00000100:00100000:0.0:1746147140.715509:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967307922944:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147140.715511:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310657664:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.716337:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.716357:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80200, rc 0) 00000100:00100000:2.0:1746147140.716392:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:32236:x1830967307922816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4723us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.716399:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14435 00000100:00100000:2.0:1746147140.723191:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307922944:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7666us (7846us total) trans 21474841453 rc 0/0 00000100:00100000:2.0:1746147140.723208:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1086 00002000:00100000:2.0:1746147140.723224:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2441216->3145727) req@ffff8800a4999180 x1830967307922944/t21474841453(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.723234:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999180 with x1830967307922944 ext(2441216->3145727) 00010000:00010000:2.0:1746147140.723248:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 9 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.723266:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 9 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746147140.723274:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4999180 00000100:00100000:0.0:1746147140.728255:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.728397:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307923072 00000100:00100000:3.0:1746147140.728407:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307923072 00010000:00010000:3.0:1746147140.728449:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 9 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.728483:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6309 00000100:00100000:3.0:1746147140.728491:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307923072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147140.728505:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.728525:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 9 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.728538:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 9 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.728561:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425055bfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2441216->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779a1 expref: 9 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.728595:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.728598:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.728606:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.728619:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.728654:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.728667:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310657792:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.728748:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.731580:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310657792:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147140.731606:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147140.731734:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307923072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3239us (3487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.731745:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6309 00000100:00100000:0.0:1746147140.740876:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.740994:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307923328 00000100:00100000:2.0:1746147140.741004:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307923328 00002000:00100000:2.0:1746147140.741055:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800a4998000 x1830967307923328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.741065:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998000 with x1830967307923328 ext(2097152->4194303) 00002000:00010000:2.0:1746147140.741071:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4998000 00000100:00100000:2.0:1746147140.741140:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3433 00000100:00100000:2.0:1746147140.741150:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967307923328:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.746810:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.748934:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307923584 00000100:00100000:3.0:1746147140.748947:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307923584 00002000:00100000:3.0:1746147140.749007:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a499ad80 x1830967307923584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.749017:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499ad80 with x1830967307923584 ext(3145728->4194303) 00002000:00010000:3.0:1746147140.749024:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499ad80 00000100:00100000:3.0:1746147140.749051:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3434 00000100:00100000:3.0:1746147140.749060:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307923584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.751249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.752898:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307923712 00000100:00100000:2.0:1746147140.752911:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307923712 00000100:00100000:2.0:1746147140.753159:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15241 00000100:00100000:2.0:1746147140.753171:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32241:x1830967307923712:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147140.753197:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.753219:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a03 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.753286:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753301:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753316:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753332:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753338:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753343:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753420:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753432:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.753438:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.753473:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.753484:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 27 pid: 16099 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.753497:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310657920:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.755043:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.758384:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967307923328:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17225us (17510us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147140.758399:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3433 00002000:00100000:2.0:1746147140.758410:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800a4998000 x1830967307923328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.758419:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998000 with x1830967307923328 ext(2097152->4194303) 00002000:00010000:2.0:1746147140.758425:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4998000 00000100:00100000:3.0:1746147140.759732:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307923584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10669us (12928us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147140.759744:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3434 00002000:00100000:3.0:1746147140.759753:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a499ad80 x1830967307923584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.759761:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499ad80 with x1830967307923584 ext(3145728->4194303) 00002000:00010000:3.0:1746147140.759766:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499ad80 00000100:00100000:2.0:1746147140.760001:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310657920:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.760024:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147140.760686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.761063:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307923968 00000100:00100000:1.0:1746147140.761070:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307923968 00000100:00100000:1.0:1746147140.761137:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5449 00000100:00100000:1.0:1746147140.761144:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:8486:x1830967307923968:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147140.761347:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:8486:x1830967307923968:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 203us (661us total) trans 8589935919 rc 0/0 00000100:00100000:1.0:1746147140.761353:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5449 00000100:00100000:0.0:1746147140.767143:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.767198:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307924224 00000100:00100000:0.0:1746147140.767204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.767208:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307924224 00002000:00100000:3.0:1746147140.767255:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a4998a80 x1830967307924224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.767265:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998a80 with x1830967307924224 ext(4194304->4919295) 00002000:00010000:3.0:1746147140.767271:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998a80 00000100:00100000:3.0:1746147140.767294:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3435 00000100:00100000:3.0:1746147140.767303:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307924224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.767921:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307924352 00000100:00100000:2.0:1746147140.767926:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307924352 00010000:00010000:2.0:1746147140.767950:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 29 pid: 16099 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.767995:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6310 00000100:00100000:2.0:1746147140.768000:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967307924352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.768011:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.768017:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 29 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.768028:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 29 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.768052:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425055ae6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77915 expref: 29 pid: 16099 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.768073:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.768078:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.768106:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.768114:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.768135:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.768165:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967307924352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 163us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.768171:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6310 00010000:00010000:3.0:1746147140.768514:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768521:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147140.768574:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147140.768578:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147140.768596:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768606:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768615:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768621:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768627:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768632:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.768636:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768642:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768650:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147140.768653:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.768656:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768660:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425055ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768683:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768688:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768692:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768696:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147140.768698:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768705:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768711:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553f00) 00010000:00010000:3.0:1746147140.768713:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147140.768715:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768720:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425055cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147140.768751:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425055c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.768762:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.768768:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147140.768771:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147140.768773:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33c00, rc 0) 00000100:00100000:3.0:1746147140.768810:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32241:x1830967307923712:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 15642us (17570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.768817:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15241 00000100:00100000:0.0:1746147140.774791:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307924224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7476us (7646us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147140.774805:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3435 00002000:00100000:0.0:1746147140.774818:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a4998a80 x1830967307924224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.774827:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998a80 with x1830967307924224 ext(4194304->4919295) 00002000:00010000:0.0:1746147140.774834:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998a80 00000100:00100000:0.0:1746147140.775841:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.775873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.775893:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.775903:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.775914:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307924736 00000100:00100000:0.0:1746147140.775920:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.775923:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307924736 00000100:00100000:3.0:1746147140.775965:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307924864 00000100:00100000:3.0:1746147140.775966:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307924864 00000100:00100000:1.0:1746147140.775970:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307924992 00000100:00100000:1.0:1746147140.775982:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307924992 00000100:00080000:0.0:1746147140.776007:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147140.776271:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147140.776317:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307925120 00000100:00100000:1.0:1746147140.776321:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307925120 00000100:00100000:3.0:1746147140.776327:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307925248 00000100:00100000:3.0:1746147140.776335:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307925248 00000100:00100000:1.0:1746147140.776339:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14436 00000100:00100000:1.0:1746147140.776346:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307924736:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147140.776361:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14437 00010000:00010000:1.0:1746147140.776363:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147140.776369:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307924992:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147140.776386:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.776415:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a1f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.776446:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.776448:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.776456:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.776472:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.776482:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbe00, rc 0) 00000100:00100000:3.0:1746147140.776548:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307924992:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 179us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.776554:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14437 00000100:00100000:3.0:1746147140.776580:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14438 00000100:00100000:3.0:1746147140.776586:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307924864:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147140.776592:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.776599:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055cc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a18 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.776632:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310658048:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.776682:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.776691:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14439 00000100:00100000:2.0:1746147140.776699:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14440 00000100:00100000:0.0:1746147140.776700:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307925120:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147140.776709:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147140.776724:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307925248:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147140.776732:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147140.776965:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a11 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.776965:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a26 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.776984:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a2d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.776990:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.776990:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.776991:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.776991:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.776997:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.776997:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.776997:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.776998:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.777003:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147140.777007:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.777007:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.777013:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147140.777014:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae600, rc 0) 00010000:00010000:0.0:1746147140.777014:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260400, rc 0) 00010000:00010000:2.0:1746147140.777024:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33800, rc 0) 00000100:00100000:1.0:1746147140.777032:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307924736:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 687us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.777032:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307925120:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 334us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.777043:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967307925248:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 321us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.777585:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14439 00000100:00100000:1.0:1746147140.777591:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14436 00000100:00100000:2.0:1746147140.777597:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14440 00000100:00100000:3.0:1746147140.777647:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.777729:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307924608 00000100:00100000:2.0:1746147140.777734:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307924608 00000100:00100000:2.0:1746147140.777782:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15242 00000100:00100000:2.0:1746147140.777787:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+28:32244:x1830967307924608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.777800:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.777810:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425055cde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a0a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.777875:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.777884:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.777892:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147140.778003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.778340:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778350:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778356:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778486:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778495:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778501:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147140.778509:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147140.778574:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778580:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778585:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778590:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.778592:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778598:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778607:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147140.778609:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.778612:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.778616:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33600/0x3139939425055ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147140.778809:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307925376 00000100:00100000:0.0:1746147140.778814:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307925376 00000100:00100000:0.0:1746147140.778843:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14441 00000100:00100000:0.0:1746147140.778849:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307925376:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147140.778857:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.778866:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a34 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.778880:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.778881:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.778887:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.778897:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.778904:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260000, rc 0) 00000100:00100000:0.0:1746147140.778928:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307925376:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 79us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.778934:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14441 00010000:00010000:2.0:1746147140.779336:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779341:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779346:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779350:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.779352:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779357:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779365:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553d00) 00010000:00010000:2.0:1746147140.779367:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.779369:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779373:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425055cec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147140.779408:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425055cde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.779417:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.779422:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.779429:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147140.779431:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db32e00, rc 0) 00000100:00100000:2.0:1746147140.779453:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+30:32244:x1830967307924608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1666us (1807us total) trans 8589935920 rc 0/0 00000100:00100000:2.0:1746147140.779458:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15242 00000100:00100000:3.0:1746147140.780483:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310658048:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.780504:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055cc2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a18 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.780515:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425055cc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a18 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.780526:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa800, rc 0) 00000100:00100000:3.0:1746147140.780760:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307924864:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4172us (4884us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.780767:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14438 00000100:00100000:0.0:1746147140.782455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.782486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.782547:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307925632 00000100:00100000:3.0:1746147140.782553:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307925632 00000100:00100000:3.0:1746147140.782592:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15243 00000100:00100000:3.0:1746147140.782599:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32241:x1830967307925632:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147140.782614:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.782627:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425055d08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a3b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.782700:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.782712:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.782718:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.782727:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147140.782752:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.782762:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 29 pid: 6215 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.782772:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310658176:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.782841:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.782847:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 10 pid: 6215 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.782855:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310658304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.782870:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.782915:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307925888 00000100:00100000:1.0:1746147140.782919:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307925888 00000100:00100000:1.0:1746147140.783633:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5450 00000100:00100000:1.0:1746147140.783640:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32236:x1830967307925888:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147140.784181:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32236:x1830967307925888:12345-192.168.204.25@tcp:35:cat.0 Request processed in 540us (1692us total) trans 8589935921 rc 0/0 00000100:00100000:1.0:1746147140.784186:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5450 00000100:00100000:0.0:1746147140.785141:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.785170:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.785221:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.785241:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307926016 00000100:00100000:0.0:1746147140.785246:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307926016 00000100:00100000:0.0:1746147140.785272:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307926144 00000100:00100000:0.0:1746147140.785274:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307926144 00000100:00100000:0.0:1746147140.785285:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307926272 00000100:00100000:0.0:1746147140.785287:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307926272 00000100:00100000:0.0:1746147140.785308:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14442 00000100:00100000:0.0:1746147140.785314:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307926016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.785325:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.785340:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425055d16 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a42 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.785377:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310658432:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.785434:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.785450:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14443 00000100:00100000:0.0:1746147140.785456:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307926144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.785462:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.785471:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a49 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.785481:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.785483:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.785491:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.785503:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.785512:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261a00, rc 0) 00000100:00100000:0.0:1746147140.785530:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307926144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 73us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.785538:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14443 00000100:00100000:0.0:1746147140.785549:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14444 00000100:00100000:0.0:1746147140.785553:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307926272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.785559:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.785564:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a50 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.785573:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.785574:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.785578:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.785587:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147140.785593:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260a00, rc 0) 00000100:00100000:0.0:1746147140.785606:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307926272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.785611:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14444 00000100:00100000:3.0:1746147140.788212:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310658176:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.788224:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310658304:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.788243:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147140.789775:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.790549:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.791185:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307926400 00000100:00100000:1.0:1746147140.791193:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307926400 00010000:00010000:1.0:1746147140.791224:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 30 pid: 6215 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.791252:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307926528 00000100:00100000:1.0:1746147140.791254:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307926528 00010000:00010000:1.0:1746147140.791263:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 11 pid: 6215 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.791280:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6311 00000100:00100000:1.0:1746147140.791286:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967307926400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.791297:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.791302:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 30 pid: 6215 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.791310:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 30 pid: 6215 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.791327:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425055cf3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a0a expref: 30 pid: 6215 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.791345:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147140.791349:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.791356:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.791359:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.791391:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967307926400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 105us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.791397:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6311 00000100:00100000:1.0:1746147140.791435:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6312 00000100:00100000:1.0:1746147140.791439:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307926528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.791445:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.791448:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 11 pid: 6215 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.791455:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 11 pid: 6215 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.791465:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425055cb4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a03 expref: 11 pid: 6215 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.791472:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147140.791475:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.791480:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.791486:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.791503:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.791518:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307926528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.791523:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6312 00010000:00010000:1.0:1746147140.791619:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147140.791626:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147140.791643:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147140.791782:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425055d08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a3b expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.791794:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a3b expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.791799:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147140.791801:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147140.791803:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbc00, rc 0) 00000100:00100000:1.0:1746147140.791824:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32241:x1830967307925632:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 9226us (9374us total) trans 8589935922 rc 0/0 00000100:00100000:1.0:1746147140.791834:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15243 00000100:00100000:2.0:1746147140.798267:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310658432:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.798295:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.798298:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425055d16 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a42 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.798312:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425055d16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a42 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.798331:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261200, rc 0) 00000100:00100000:0.0:1746147140.798338:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307926784 00000100:00100000:0.0:1746147140.798347:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307926784 00000100:00100000:0.0:1746147140.798428:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15244 00000100:00100000:0.0:1746147140.798438:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32241:x1830967307926784:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147140.798472:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307926016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 13152us (13329us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.798481:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14442 00010000:00010000:0.0:1746147140.798572:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.798577:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147140.798605:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425055d0f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a3b expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.798626:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147140.798631:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147140.798643:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055d32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a57 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.798786:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798798:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798807:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798822:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798827:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798833:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798838:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.798841:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798846:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798853:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.798855:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147140.798858:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798861:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x3139939425055d39 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.798885:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055d32 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a57 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.798890:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055d32 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a57 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.798896:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261400, rc 0) 00000100:00100000:2.0:1746147140.798931:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32241:x1830967307926784:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 495us (645us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.798937:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15244 00000100:00100000:0.0:1746147140.802420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.802473:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.802479:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927040 00000100:00100000:1.0:1746147140.802491:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927040 00000100:00100000:2.0:1746147140.802525:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927168 00000100:00100000:2.0:1746147140.802529:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927168 00000100:00100000:1.0:1746147140.802547:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5451 00000100:00100000:2.0:1746147140.802553:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14445 00000100:00100000:1.0:1746147140.802554:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32241:x1830967307927040:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147140.802557:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32244:x1830967307927168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.802568:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.802584:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a5e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.802603:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.802609:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.802611:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147140.802614:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.802640:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.802651:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 21 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.802660:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310658560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.802733:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.802911:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32241:x1830967307927040:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 356us (501us total) trans 8589935923 rc 0/0 00000100:00100000:1.0:1746147140.802917:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5451 00000100:00100000:2.0:1746147140.803896:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310658560:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.803923:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.803938:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33c00, rc 0) 00000100:00100000:2.0:1746147140.804183:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:32244:x1830967307927168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1619us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.804191:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14445 00000100:00100000:1.0:1746147140.804620:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.804643:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927296 00000100:00100000:0.0:1746147140.804650:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927296 00002000:00100000:1.0:1746147140.804714:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1888256->1994751) req@ffff880099150000 x1830967307927296/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.804724:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967307927296 ext(1888256->1994751) 00010000:00010000:1.0:1746147140.804731:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 22 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.804745:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 22 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746147140.804752:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150000 00000100:00100000:1.0:1746147140.804776:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1087 00000100:00100000:1.0:1746147140.804782:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967307927296:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147140.808499:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967307927296:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3701us (3865us total) trans 21474841454 rc 0/0 00000100:00100000:1.0:1746147140.808518:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1087 00002000:00100000:1.0:1746147140.808533:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1888256->1994751) req@ffff880099150000 x1830967307927296/t21474841454(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.808542:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967307927296 ext(1888256->1994751) 00010000:00010000:1.0:1746147140.808554:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 24 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.808571:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 24 pid: 12225 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746147140.808578:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150000 00000100:00100000:0.0:1746147140.811346:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.811401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.811430:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927552 00000100:00100000:2.0:1746147140.811439:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927552 00010000:00010000:2.0:1746147140.811478:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 24 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.811485:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927424 00000100:00100000:3.0:1746147140.811488:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927424 00000100:00100000:2.0:1746147140.811507:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6313 00000100:00100000:3.0:1746147140.811510:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14446 00000100:00100000:3.0:1746147140.811515:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32239:x1830967307927424:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:2.0:1746147140.811515:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307927552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.811528:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147140.811532:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.811545:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a65 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.811546:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.811559:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 26 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.811640:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147140.811646:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.811652:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147140.811656:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.811840:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x3139939425055bf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->1994751) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77993 expref: 26 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.811860:0:9586:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.811868:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.811870:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.811875:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.811881:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.811895:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.811903:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffaa00, rc 0) 00010000:00010000:2.0:1746147140.811904:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.811914:0:7225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 9 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.811925:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310658816:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147140.811955:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32239:x1830967307927424:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 439us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.811960:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14446 00000100:00100000:2.0:1746147140.811984:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.815172:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310658816:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147140.815175:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147140.815192:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.815233:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927808 00000100:00100000:1.0:1746147140.815239:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927808 00000100:00100000:0.0:1746147140.815243:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967307927552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3728us (3907us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.815254:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6313 00002000:00100000:1.0:1746147140.815280:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880093145880 x1830967307927808/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.815290:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145880 with x1830967307927808 ext(1048576->2097151) 00010000:00010000:1.0:1746147140.815298:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.815312:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746147140.815318:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093145880 00000100:00100000:1.0:1746147140.815333:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1088 00000100:00100000:1.0:1746147140.815340:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307927808:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147140.819966:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307927808:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4612us (4781us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147140.819992:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1088 00002000:00100000:1.0:1746147140.820004:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880093145880 x1830967307927808/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.820013:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145880 with x1830967307927808 ext(1048576->2097151) 00010000:00010000:1.0:1746147140.820025:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.820039:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746147140.820046:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093145880 00000100:00100000:0.0:1746147140.828406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.828507:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307927936 00000100:00100000:2.0:1746147140.828517:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307927936 00010000:00010000:2.0:1746147140.828554:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.828581:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6314 00000100:00100000:2.0:1746147140.828589:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307927936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.828603:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.828623:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.828635:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.828657:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db33c00/0x3139939425055d40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a5e expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.828693:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.828695:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.828703:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.828711:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.828745:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.828757:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310658944:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147140.828852:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.830234:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.830287:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310658944:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147140.830304:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.830334:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307927936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1745us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.830350:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6314 00000100:00100000:1.0:1746147140.830487:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307928192 00000100:00100000:1.0:1746147140.830493:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307928192 00002000:00100000:1.0:1746147140.830527:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (2035712->2039807) req@ffff8801323d4000 x1830967307928192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.830537:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4000 with x1830967307928192 ext(2035712->2039807) 00002000:00010000:1.0:1746147140.830541:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d4000 00000100:00100000:1.0:1746147140.830788:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3436 00000100:00100000:1.0:1746147140.830795:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307928192:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147140.831504:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307928192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 708us (1274us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147140.831510:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3436 00002000:00100000:1.0:1746147140.831516:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (2035712->2039807) req@ffff8801323d4000 x1830967307928192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.831523:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4000 with x1830967307928192 ext(2035712->2039807) 00002000:00010000:1.0:1746147140.831526:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d4000 00000100:00100000:0.0:1746147140.833380:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.833744:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307928576 00000100:00100000:0.0:1746147140.833748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.833753:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307928576 00000100:00100000:0.0:1746147140.833790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.833807:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14447 00000100:00100000:0.0:1746147140.833807:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307928704 00000100:00100000:0.0:1746147140.833811:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307928704 00000100:00100000:3.0:1746147140.833814:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32239:x1830967307928576:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147140.833829:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746147140.833836:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801323d5880 x1830967307928704/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.833844:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5880 with x1830967307928704 ext(2097152->4194303) 00010000:00010000:3.0:1746147140.833848:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a6c expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147140.833848:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d5880 00000100:00100000:0.0:1746147140.833863:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307928832 00000100:00100000:0.0:1746147140.833865:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307928832 00010000:00010000:3.0:1746147140.833876:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147140.833878:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d6680 x1830967307928832/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.833884:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6680 with x1830967307928832 ext(2097152->4194303) 00010000:00010000:3.0:1746147140.833885:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746147140.833887:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d6680 00010000:00010000:3.0:1746147140.833891:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.833896:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147140.833898:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147140.833898:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3437 00010000:00010000:3.0:1746147140.833901:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->1912831] (req 1048576->1912831) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.833902:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307928704:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147140.833935:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.833946:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 9 pid: 1136 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746147140.833956:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310659072:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.834046:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.834054:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 8 pid: 12201 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746147140.834066:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310659200:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147140.834118:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.834125:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.834132:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310659328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.834161:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.834274:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3438 00000100:00100000:1.0:1746147140.834282:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307928832:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.836043:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310659200:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.836483:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310659072:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.836491:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310659328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147140.836517:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147140.836518:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->1912831] (req 1048576->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147140.836534:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb600, rc 0) 00000100:00100000:2.0:1746147140.836536:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307928960 00000100:00100000:2.0:1746147140.836542:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307928960 00000100:00100000:3.0:1746147140.836561:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32239:x1830967307928576:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2747us (3189us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147140.836566:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 9 pid: 12201 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746147140.836568:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14447 00000100:00100000:2.0:1746147140.836603:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6315 00000100:00100000:2.0:1746147140.836610:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307928960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.836623:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.836641:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 9 pid: 12201 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.836650:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 9 pid: 12201 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.836673:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425055cbb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a1f expref: 9 pid: 12201 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746147140.836686:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.836702:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307928960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.836707:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6315 00000100:00100000:2.0:1746147140.838718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.838768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.838794:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307929216 00000100:00100000:2.0:1746147140.838803:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307929216 00010000:00010000:2.0:1746147140.838837:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746147140.838864:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307929088 00000100:00100000:2.0:1746147140.838867:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307929088 00010000:00010000:2.0:1746147140.838876:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 11 pid: 1136 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746147140.838892:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6316 00000100:00100000:2.0:1746147140.838899:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967307929216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147140.838911:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147140.838928:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.838937:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.838958:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f09e800/0x3139939425055b8e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77962 expref: 25 pid: 12225 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746147140.838986:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147140.839000:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6317 00000100:00100000:0.0:1746147140.839016:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307929088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147140.839021:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307929216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.839027:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6316 00010000:00010000:0.0:1746147140.839034:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147140.839066:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 11 pid: 1136 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746147140.839080:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 11 pid: 1136 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746147140.839122:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425055bb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77970 expref: 11 pid: 1136 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746147140.839145:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.839146:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147140.839152:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.839160:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.839191:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.839202:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310659456:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147140.839278:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147140.845940:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310659456:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147140.845963:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147140.846350:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307929088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7337us (7579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.846363:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6317 00000100:00100000:0.0:1746147140.850656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.850721:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307929472 00000100:00100000:2.0:1746147140.850730:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307929472 00000100:00100000:2.0:1746147140.850792:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15245 00000100:00100000:2.0:1746147140.850801:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+29:32248:x1830967307929472:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147140.850830:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.850851:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x3139939425055d55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a73 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.850943:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.850956:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.850967:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.850993:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.850998:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851003:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851148:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851158:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851164:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147140.851172:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147140.851248:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851254:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851263:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851268:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851397:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.851402:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851408:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851419:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147140.851422:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.851426:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851430:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425055d5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851441:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851446:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851450:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851454:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.851456:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851465:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851470:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553300) 00010000:00010000:2.0:1746147140.851472:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.851474:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851478:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x3139939425055d63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.851516:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x3139939425055d55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.851539:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.851544:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.851546:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147140.851548:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563400, rc 0) 00000100:00100000:2.0:1746147140.851611:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:32248:x1830967307929472:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 812us (966us total) trans 8589935924 rc 0/0 00000100:00100000:2.0:1746147140.851619:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15245 00000100:00100000:3.0:1746147140.854442:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.855858:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307928832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21569us (22060us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147140.855872:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3438 00002000:00100000:0.0:1746147140.855884:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d6680 x1830967307928832/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.855894:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6680 with x1830967307928832 ext(2097152->4194303) 00002000:00010000:0.0:1746147140.855900:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d6680 00000100:00100000:1.0:1746147140.855905:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307929728 00000100:00100000:1.0:1746147140.855915:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307929728 00002000:00100000:1.0:1746147140.855949:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1908736->1912831) req@ffff880094527100 x1830967307929728/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.855957:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094527100 with x1830967307929728 ext(1908736->1912831) 00002000:00010000:1.0:1746147140.855961:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094527100 00000100:00100000:1.0:1746147140.855986:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3439 00000100:00100000:1.0:1746147140.855994:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307929728:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147140.856133:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307929728:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (1701us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147140.856138:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3439 00002000:00100000:1.0:1746147140.856143:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1908736->1912831) req@ffff880094527100 x1830967307929728/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.856149:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094527100 with x1830967307929728 ext(1908736->1912831) 00002000:00010000:1.0:1746147140.856152:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094527100 00000100:00100000:1.0:1746147140.859266:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307928704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 25350us (25505us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147140.859279:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3437 00002000:00100000:1.0:1746147140.859291:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801323d5880 x1830967307928704/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.859301:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5880 with x1830967307928704 ext(2097152->4194303) 00002000:00010000:1.0:1746147140.859306:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d5880 00000100:00100000:0.0:1746147140.864755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.864811:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307929984 00000100:00100000:1.0:1746147140.864822:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307929984 00000100:00100000:1.0:1746147140.864882:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5452 00000100:00100000:1.0:1746147140.864890:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32239:x1830967307929984:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147140.865676:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32239:x1830967307929984:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 786us (932us total) trans 8589935925 rc 0/0 00000100:00100000:1.0:1746147140.865683:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5452 00000100:00100000:0.0:1746147140.872941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.873006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.873077:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307930240 00000100:00100000:2.0:1746147140.873124:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307930240 00000100:00100000:2.0:1746147140.873177:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307930112 00000100:00100000:2.0:1746147140.873179:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307930112 00000100:00100000:2.0:1746147140.873194:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14448 00000100:00100000:2.0:1746147140.873202:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307930240:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147140.873207:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14449 00000100:00100000:0.0:1746147140.873214:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307930112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.873222:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.873222:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.873241:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425055d7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a81 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.873241:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261800/0x3139939425055d78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a7a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.873289:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310659712:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.873289:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310659584:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.873441:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.873446:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.876430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.876960:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310659712:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.877004:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425055d7f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a81 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.877018:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425055d7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a81 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.877035:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562400, rc 0) 00000100:00100000:2.0:1746147140.877079:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307930240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3876us (4147us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.877116:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14448 00000100:00100000:2.0:1746147140.877145:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307930368 00000100:00100000:2.0:1746147140.877151:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307930368 00000100:00100000:2.0:1746147140.877179:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14450 00000100:00100000:2.0:1746147140.877185:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:32248:x1830967307930368:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147140.877201:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.877215:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a88 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.877239:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.877248:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.877255:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.877261:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.877263:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147140.877265:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2535424->2867199] (req 2535424->2867199) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.877290:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.877301:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 7 pid: 9586 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746147140.877313:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310659840:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.877372:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.877380:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 11 pid: 17600 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746147140.877388:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310659968:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.877418:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.877425:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 23 pid: 1854 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.877426:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310659584:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.877433:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310660096:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147140.877449:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261800/0x3139939425055d78 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a7a expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147140.877451:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147140.877460:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261800/0x3139939425055d78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a7a expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147140.877474:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261800, rc 0) 00000100:00100000:1.0:1746147140.877498:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307930112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4286us (4491us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147140.877507:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14449 00000100:00100000:0.0:1746147140.881131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.881178:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307930496 00000100:00100000:1.0:1746147140.881187:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307930496 00010000:00010000:1.0:1746147140.881226:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 8 pid: 9586 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746147140.881257:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6318 00000100:00100000:1.0:1746147140.881264:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307930496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.881276:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.881296:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 8 pid: 9586 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.881311:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 8 pid: 9586 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.881337:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.881389:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307930496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.881395:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6318 00010000:00010000:1.0:1746147140.881476:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260000/0x3139939425055d01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a34 expref: 7 pid: 9586 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746147140.881501:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310659840:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147140.881512:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310659968:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147140.881520:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310660096:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147140.882052:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2535424->2867199] (req 2535424->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.882063:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562000, rc 0) 00000100:00100000:1.0:1746147140.882110:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32248:x1830967307930368:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4925us (5691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.882117:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14450 00000100:00100000:0.0:1746147140.882238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.882649:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307930624 00000100:00100000:1.0:1746147140.882653:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307930624 00010000:00010000:1.0:1746147140.882671:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 9 pid: 17600 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746147140.882704:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6319 00000100:00100000:1.0:1746147140.882709:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307930624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.882717:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.882728:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 9 pid: 17600 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.882737:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 9 pid: 17600 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.882750:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x3139939425055d24 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a50 expref: 9 pid: 17600 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746147140.882759:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.883169:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307930624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 459us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.883175:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6319 00000100:00100000:2.0:1746147140.885272:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.885374:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.885448:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307930752 00000100:00100000:1.0:1746147140.885457:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307930752 00010000:00010000:1.0:1746147140.885490:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 24 pid: 1854 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.885518:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6320 00000100:00100000:1.0:1746147140.885526:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967307930752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.885539:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.885560:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 24 pid: 1854 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.885572:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 24 pid: 1854 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.885595:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db80200/0x3139939425055c98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779fc expref: 24 pid: 1854 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746147140.885607:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307931008 00010000:00010000:1.0:1746147140.885609:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.885611:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147140.885611:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307931008 00010000:00010000:1.0:1746147140.885618:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.885625:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147140.885642:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880093145f80 x1830967307931008/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.885651:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145f80 with x1830967307931008 ext(4194304->4919295) 00010000:00010000:1.0:1746147140.885656:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147140.885656:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145f80 00000100:00100000:1.0:1746147140.885666:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310660224:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147140.885675:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3440 00000100:00100000:0.0:1746147140.885681:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307931008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147140.885745:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.887649:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310660224:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.887669:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.888039:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967307930752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2512us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.888049:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6320 00000100:00100000:2.0:1746147140.888254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.888338:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307931264 00000100:00100000:0.0:1746147140.888345:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307931264 00002000:00100000:0.0:1746147140.888377:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2535424->2539519) req@ffff880093146680 x1830967307931264/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.888386:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146680 with x1830967307931264 ext(2535424->2539519) 00002000:00010000:0.0:1746147140.888390:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093146680 00000100:00100000:0.0:1746147140.888414:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3441 00000100:00100000:0.0:1746147140.888421:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307931264:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.888514:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307931264:12345-192.168.204.25@tcp:3:cat.0 Request processed in 93us (262us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147140.888519:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3441 00002000:00100000:0.0:1746147140.888524:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2535424->2539519) req@ffff880093146680 x1830967307931264/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.888530:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146680 with x1830967307931264 ext(2535424->2539519) 00002000:00010000:0.0:1746147140.888533:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093146680 00000100:00100000:1.0:1746147140.892516:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307931008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6822us (7129us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147140.892529:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3440 00002000:00100000:1.0:1746147140.892541:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880093145f80 x1830967307931008/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.892550:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145f80 with x1830967307931008 ext(4194304->4919295) 00002000:00010000:1.0:1746147140.892555:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145f80 00000100:00100000:0.0:1746147140.895601:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.895634:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.895661:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.895690:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307931648 00000100:00100000:0.0:1746147140.895698:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307931648 00000100:00100000:0.0:1746147140.895740:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307931776 00000100:00100000:0.0:1746147140.895741:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307931776 00000100:00100000:0.0:1746147140.895753:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14451 00000100:00100000:0.0:1746147140.895759:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307931648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.895776:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.895792:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425055d8d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a8f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.895837:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310660352:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147140.895902:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.896034:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307931520 00000100:00100000:2.0:1746147140.896037:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14452 00000100:00100000:1.0:1746147140.896038:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307931520 00000100:00100000:2.0:1746147140.896044:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307931776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.896050:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.896058:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425055d94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a96 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147140.896062:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2863104->2867199) req@ffff8801323d5500 x1830967307931520/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.896070:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5500 with x1830967307931520 ext(2863104->2867199) 00002000:00010000:1.0:1746147140.896075:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d5500 00000100:00100000:2.0:1746147140.896082:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310660480:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147140.896112:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3442 00000100:00100000:1.0:1746147140.896117:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307931520:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.896133:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147140.896229:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307931520:12345-192.168.204.25@tcp:3:cat.0 Request processed in 111us (637us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147140.896236:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3442 00002000:00100000:1.0:1746147140.896241:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2863104->2867199) req@ffff8801323d5500 x1830967307931520/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/4536 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147140.896248:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5500 with x1830967307931520 ext(2863104->2867199) 00002000:00010000:1.0:1746147140.896251:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d5500 00000100:00100000:0.0:1746147140.899765:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.899851:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310660352:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.899868:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310660480:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.899885:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425055d94 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a96 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.899885:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425055d8d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a8f expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.899899:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425055d94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a96 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.899899:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425055d8d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a8f expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.899914:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79bc00, rc 0) 00010000:00010000:2.0:1746147140.899915:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261200, rc 0) 00000100:00100000:1.0:1746147140.900116:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307932032 00000100:00100000:1.0:1746147140.900124:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307932032 00000100:00100000:1.0:1746147140.900173:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5453 00000100:00100000:1.0:1746147140.900181:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:32248:x1830967307932032:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147140.900399:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307931776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4354us (4734us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.900406:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14452 00000100:00100000:2.0:1746147140.900772:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307931648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5011us (5133us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.900777:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14451 00000100:00100000:1.0:1746147140.901198:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+32:32248:x1830967307932032:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1016us (1442us total) trans 8589935926 rc 0/0 00000100:00100000:1.0:1746147140.901206:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5453 00000100:00100000:0.0:1746147140.903252:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.903311:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307932288 00000100:00100000:2.0:1746147140.903320:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307932288 00000100:00100000:2.0:1746147140.903380:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15246 00000100:00100000:2.0:1746147140.903388:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32252:x1830967307932288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.903419:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.903443:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x3139939425055d9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77a9d expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.903525:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903539:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903552:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903564:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903570:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903576:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903681:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903691:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903697:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147140.903705:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147140.903781:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903787:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903793:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903798:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903804:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c42c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.903808:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903814:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903825:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147140.903828:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.903832:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903841:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425055da2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903852:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903857:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903861:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903865:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c42a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147140.903868:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903872:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903878:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553b00) 00010000:00010000:2.0:1746147140.903880:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147140.903882:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903887:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425055da9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147140.903921:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x3139939425055d9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 55 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.903932:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 54 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147140.903943:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147140.903945:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147140.903947:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f972c00, rc 0) 00000100:00100000:2.0:1746147140.904012:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:32252:x1830967307932288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 624us (848us total) trans 8589935927 rc 0/0 00000100:00100000:2.0:1746147140.904019:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15246 00000100:00100000:0.0:1746147140.904923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.905062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.905123:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307932544 00000100:00100000:3.0:1746147140.905129:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307932544 00000100:00100000:3.0:1746147140.905165:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307932416 00000100:00100000:3.0:1746147140.905167:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307932416 00000100:00100000:3.0:1746147140.905180:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14453 00000100:00100000:3.0:1746147140.905186:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967307932544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.905196:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.905210:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055dbe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77aab expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.905255:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310660608:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.905320:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.905336:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14454 00000100:00100000:3.0:1746147140.905341:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307932416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147140.905347:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147140.905353:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425055dc5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77aa4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.905376:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310660736:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147140.905392:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.908174:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.908232:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307932672 00000100:00100000:2.0:1746147140.908241:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307932672 00000100:00100000:2.0:1746147140.908292:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14455 00000100:00100000:2.0:1746147140.908300:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307932672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147140.908318:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147140.908341:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42a00/0x3139939425055dcc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ab2 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147140.908393:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310660864:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147140.908475:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.909076:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310660608:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147140.909135:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055dbe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aab expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.909152:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055dbe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aab expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147140.909176:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01bc00, rc 0) 00000100:00100000:3.0:1746147140.909213:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307932544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4026us (4292us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147140.909219:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14453 00000100:00100000:2.0:1746147140.909300:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310660736:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.909313:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425055dc5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aa4 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.909321:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425055dc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aa4 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.909331:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01a200, rc 0) 00000100:00100000:2.0:1746147140.909351:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967307932416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4010us (4289us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.909356:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14454 00000100:00100000:2.0:1746147140.910187:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310660864:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147140.910207:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42a00/0x3139939425055dcc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab2 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.910216:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42a00/0x3139939425055dcc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab2 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147140.910223:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42a00, rc 0) 00000100:00100000:2.0:1746147140.910263:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307932672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1963us (2098us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147140.910268:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14455 00000100:00100000:0.0:1746147140.913919:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.914033:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307932928 00000100:00100000:1.0:1746147140.914043:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307932928 00000100:00100000:1.0:1746147140.914496:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5454 00000100:00100000:1.0:1746147140.914507:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+32:32244:x1830967307932928:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147140.915375:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:32244:x1830967307932928:12345-192.168.204.25@tcp:35:cat.0 Request processed in 868us (1466us total) trans 8589935928 rc 0/0 00000100:00100000:1.0:1746147140.915440:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5454 00000100:00100000:0.0:1746147140.921050:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.921556:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307933184 00000100:00100000:2.0:1746147140.921566:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307933184 00002000:00100000:2.0:1746147140.921614:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2035711) req@ffff880095237100 x1830967307933184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.921626:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237100 with x1830967307933184 ext(1048576->2035711) 00002000:00010000:2.0:1746147140.921632:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237100 00000100:00100000:2.0:1746147140.921670:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3443 00000100:00100000:2.0:1746147140.921679:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307933184:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147140.921728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147140.921768:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307933440 00000100:00100000:0.0:1746147140.921775:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307933440 00002000:00100000:0.0:1746147140.921810:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1912832->2097151) req@ffff880095234000 x1830967307933440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147140.921819:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234000 with x1830967307933440 ext(1912832->2097151) 00002000:00010000:0.0:1746147140.921824:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095234000 00000100:00100000:0.0:1746147140.921847:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3444 00000100:00100000:0.0:1746147140.921854:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307933440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147140.928024:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307933440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6161us (6295us total) trans 0 rc 184320/184320 00000100:00100000:2.0:1746147140.928039:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3444 00002000:00100000:2.0:1746147140.928049:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1912832->2097151) req@ffff880095234000 x1830967307933440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 184320/184320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147140.928058:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234000 with x1830967307933440 ext(1912832->2097151) 00002000:00010000:2.0:1746147140.928063:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095234000 00000100:00100000:3.0:1746147140.929525:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967307933184:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7838us (8477us total) trans 0 rc 987136/987136 00000100:00100000:3.0:1746147140.929536:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3443 00002000:00100000:3.0:1746147140.929545:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2035711) req@ffff880095237100 x1830967307933184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.929554:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237100 with x1830967307933184 ext(1048576->2035711) 00002000:00010000:3.0:1746147140.929560:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237100 00000100:00100000:0.0:1746147140.937193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147140.937449:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3764:1830967310661248:0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937465:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310661120:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937505:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147140.937531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147140.937555:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3764:1830967310661760:0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937564:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3767:1830967310661632:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937576:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147140.937590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147140.937593:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310662272:0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937607:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310662144:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147140.937629:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147140.937635:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746147140.937640:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310661376:0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937650:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746147140.937655:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3767:1830967310660992:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937657:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147140.937675:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3764:1830967310661888:0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937681:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147140.937687:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307933568 00000100:00100000:2.0:1746147140.937693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147140.937695:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307933568 00000100:00100000:1.0:1746147140.937707:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3767:1830967310661504:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937708:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967310662400:0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937728:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147140.937735:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310662272 00000100:00100000:3.0:1746147140.937737:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310662272 00000100:00100000:2.0:1746147140.937745:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661248 00000100:00100000:2.0:1746147140.937748:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661248 00000100:00100000:1.0:1746147140.937750:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310662016:0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.937753:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310662144 00000100:00100000:3.0:1746147140.937755:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310662144 00000100:00100000:3.0:1746147140.937765:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661376 00000100:00100000:3.0:1746147140.937766:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661376 00000100:00100000:1.0:1746147140.937766:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147140.937774:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661760 00000100:00100000:2.0:1746147140.937776:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661760 00000100:00100000:2.0:1746147140.937787:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661632 00000100:00100000:3.0:1746147140.937788:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1746147140.937789:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661632 00000100:00100000:1.0:1746147140.937794:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661888 00000100:00100000:3.0:1746147140.937795:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310662272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937799:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661504 00000100:00100000:1.0:1746147140.937800:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661888 00000100:00100000:2.0:1746147140.937801:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661504 00000100:00100000:2.0:1746147140.937810:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:2.0:1746147140.937815:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3764:x1830967310661248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937834:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1746147140.937841:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830967310661760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.937846:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310662272:12345-0@lo:400:kworker.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.937848:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3764:x1830967310661248:12345-0@lo:400:kworker.0 Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.937852:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1746147140.937853:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1746147140.937864:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1746147140.937865:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1746147140.937868:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310662144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.937869:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830967310661632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147140.937883:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830967310661760:12345-0@lo:400:kworker.0 Request processed in 43us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.937889:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1746147140.937904:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:1.0:1746147140.937908:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967310661504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.937935:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1746147140.937947:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310661376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.937989:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310661376:12345-0@lo:400:kworker.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.937994:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1746147140.938006:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14456 00000100:00100000:0.0:1746147140.938010:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:32252:x1830967307933568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147140.938022:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147140.938041:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ab9 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147140.938070:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.938072:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310662144:12345-0@lo:400:kworker.0 Request processed in 202us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.938077:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1746147140.938077:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147140.938078:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147140.938082:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.938110:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310661120 00000100:00100000:3.0:1746147140.938113:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310661120 00010000:00010000:0.0:1746147140.938127:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147140.938131:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310662016 00000100:00100000:3.0:1746147140.938133:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310662016 00010000:00010000:0.0:1746147140.938138:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 7 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746147140.938141:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1746147140.938146:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967310661120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.938147:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310662528:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147140.938195:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967310661120:12345-0@lo:400:kworker.0 Request processed in 48us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.938200:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1746147140.938202:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147140.938209:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1746147140.938213:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310662016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.938220:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310660992 00000100:00100000:0.0:1746147140.938223:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310660992 00000100:00100000:3.0:1746147140.938232:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310662016:12345-0@lo:400:kworker.0 Request processed in 19us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.938239:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1746147140.938246:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1746147140.938250:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967310660992:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1746147140.938252:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1746147140.938255:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746147140.938257:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147140.938269:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1746147140.938274:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3764:x1830967310661888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.938275:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967310660992:12345-0@lo:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147140.938279:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1746147140.938293:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3764:x1830967310661888:12345-0@lo:400:kworker.0 Request processed in 20us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.938297:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1746147140.938328:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3767:1830967310660992:0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.938330:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147140.938350:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3764:1830967310661248:0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.938359:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3764:1830967310661760:0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.938366:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874183 gen 2 00000004:00080000:3.0:1746147140.938370:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094529180, transno 17179874111 00000004:00080000:3.0:1746147140.938377:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009452b800, transno 17179874112 00000004:00080000:3.0:1746147140.938379:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094524a80, transno 17179874113 00000004:00080000:3.0:1746147140.938380:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009452b100, transno 17179874114 00000004:00080000:3.0:1746147140.938382:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094527800, transno 17179874115 00000004:00080000:3.0:1746147140.938384:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094528000, transno 17179874116 00000004:00080000:3.0:1746147140.938387:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132099500, transno 17179874117 00000004:00080000:3.0:1746147140.938389:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094525880, transno 17179874118 00000004:00080000:3.0:1746147140.938391:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098820a80, transno 17179874119 00000004:00080000:3.0:1746147140.938392:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988b100, transno 17179874121 00000004:00080000:3.0:1746147140.938394:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988b800, transno 17179874122 00000004:00080000:3.0:1746147140.938396:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099889500, transno 17179874123 00000004:00080000:3.0:1746147140.938398:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099888e00, transno 17179874124 00000004:00080000:3.0:1746147140.938401:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ce00, transno 17179874125 00000004:00080000:3.0:1746147140.938402:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897c380, transno 17179874126 00000004:00080000:3.0:1746147140.938404:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ed80, transno 17179874127 00000004:00080000:3.0:1746147140.938406:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897ca80, transno 17179874128 00000004:00080000:3.0:1746147140.938408:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a897c000, transno 17179874129 00000004:00080000:3.0:1746147140.938410:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ea680, transno 17179874137 00000004:00080000:3.0:1746147140.938412:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312eaa00, transno 17179874138 00000004:00080000:3.0:1746147140.938413:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ebb80, transno 17179874139 00000004:00080000:3.0:1746147140.938415:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8380, transno 17179874140 00000004:00080000:3.0:1746147140.938417:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ead80, transno 17179874141 00000004:00080000:3.0:1746147140.938419:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8700, transno 17179874142 00000004:00080000:3.0:1746147140.938420:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8e00, transno 17179874143 00000004:00080000:3.0:1746147140.938422:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8000, transno 17179874144 00000004:00080000:3.0:1746147140.938423:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74380, transno 17179874145 00000004:00080000:3.0:1746147140.938425:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394380, transno 17179874147 00000004:00080000:3.0:1746147140.938427:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395f80, transno 17179874148 00000004:00080000:3.0:1746147140.938429:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394e00, transno 17179874149 00000004:00080000:3.0:1746147140.938430:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395c00, transno 17179874150 00000004:00080000:3.0:1746147140.938432:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397100, transno 17179874151 00000004:00080000:3.0:1746147140.938434:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397800, transno 17179874152 00000004:00080000:3.0:1746147140.938435:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396d80, transno 17179874153 00000004:00080000:3.0:1746147140.938437:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576d80, transno 17179874154 00000004:00080000:3.0:1746147140.938439:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397b80, transno 17179874155 00000004:00080000:3.0:1746147140.938440:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576a00, transno 17179874156 00000004:00080000:3.0:1746147140.938442:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575500, transno 17179874157 00000004:00080000:3.0:1746147140.938444:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5574700, transno 17179874158 00000004:00080000:3.0:1746147140.938457:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094526a00, transno 17179874159 00000004:00080000:3.0:1746147140.938459:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575880, transno 17179874160 00000004:00080000:3.0:1746147140.938461:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5577100, transno 17179874161 00000004:00080000:3.0:1746147140.938462:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575180, transno 17179874162 00000004:00080000:3.0:1746147140.938465:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094524000, transno 17179874163 00000004:00080000:3.0:1746147140.938467:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8700, transno 17179874164 00000004:00080000:3.0:1746147140.938469:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfb800, transno 17179874166 00000004:00080000:3.0:1746147140.938471:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf8700, transno 17179874167 00000004:00080000:3.0:1746147140.938473:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf8a80, transno 17179874168 00000004:00080000:3.0:1746147140.938475:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094572300, transno 17179874169 00000004:00080000:3.0:1746147140.938477:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9180, transno 17179874170 00000004:00080000:3.0:1746147140.938478:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094572d80, transno 17179874171 00000004:00080000:3.0:1746147140.938480:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9f80, transno 17179874172 00000004:00080000:3.0:1746147140.938482:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9500, transno 17179874173 00000004:00080000:3.0:1746147140.938484:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094571f80, transno 17179874174 00000004:00080000:3.0:1746147140.938486:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097094380, transno 17179874175 00000100:00100000:2.0:1746147140.938487:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830967310661632:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000004:00080000:3.0:1746147140.938488:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095c00, transno 17179874176 00000004:00080000:3.0:1746147140.938489:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097100, transno 17179874177 00000004:00080000:3.0:1746147140.938491:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097094700, transno 17179874178 00000004:00080000:3.0:1746147140.938493:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3d180, transno 17179874179 00000100:00100000:2.0:1746147140.938493:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000004:00080000:3.0:1746147140.938495:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3ca80, transno 17179874180 00000004:00080000:3.0:1746147140.938497:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3ce00, transno 17179874181 00000004:00080000:3.0:1746147140.938499:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3f480, transno 17179874182 00000004:00080000:3.0:1746147140.938500:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094571880, transno 17179874183 00000100:00100000:3.0:1746147140.938503:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310662272:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.938503:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310662400 00000100:00100000:2.0:1746147140.938505:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310662400 00000100:00100000:2.0:1746147140.938517:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1746147140.938521:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3764:x1830967310662400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.938525:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310661376:0@lo:400:kworker.0 00000100:00100000:3.0:1746147140.938530:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3764:1830967310661888:0@lo:400:kworker.0 00000100:00100000:2.0:1746147140.938547:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3764:x1830967310662400:12345-0@lo:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.938552:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1746147140.938582:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967310662400:0@lo:400:kworker.0 00000004:00080000:3.0:1746147140.938896:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:1.0:1746147140.939114:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967310661504:12345-0@lo:400:kworker.0 Request processed in 1201us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.939122:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1746147140.939226:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3767:1830967310661504:0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.939237:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310662016:0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.939247:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310661120:0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.939257:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3767:1830967310661632:0@lo:400:kworker.0 00000100:00100000:0.0:1746147140.939266:0:3767:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841442 gen 2 00000004:00080000:0.0:1746147140.939269:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094537800, transno 21474841382 00000004:00080000:0.0:1746147140.939286:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9880, transno 21474841383 00000004:00080000:0.0:1746147140.939289:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801323d7800, transno 21474841384 00000004:00080000:0.0:1746147140.939291:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095234700, transno 21474841385 00000004:00080000:0.0:1746147140.939293:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094535500, transno 21474841386 00000004:00080000:0.0:1746147140.939296:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801323d6d80, transno 21474841387 00000004:00080000:0.0:1746147140.939298:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098823100, transno 21474841388 00000004:00080000:0.0:1746147140.939300:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988ad80, transno 21474841389 00000004:00080000:0.0:1746147140.939302:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094570000, transno 21474841391 00000004:00080000:0.0:1746147140.939304:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063100, transno 21474841392 00000004:00080000:0.0:1746147140.939306:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486300, transno 21474841393 00000004:00080000:0.0:1746147140.939309:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ebb80, transno 21474841394 00000004:00080000:0.0:1746147140.939310:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486a00, transno 21474841395 00000004:00080000:0.0:1746147140.939313:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062300, transno 21474841396 00000004:00080000:0.0:1746147140.939315:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094570a80, transno 21474841397 00000004:00080000:0.0:1746147140.939317:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063b80, transno 21474841398 00000004:00080000:0.0:1746147140.939319:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75c00, transno 21474841400 00000004:00080000:0.0:1746147140.939321:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77800, transno 21474841401 00000004:00080000:0.0:1746147140.939323:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75180, transno 21474841402 00000004:00080000:0.0:1746147140.939325:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74a80, transno 21474841403 00000004:00080000:0.0:1746147140.939327:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74700, transno 21474841404 00000004:00080000:0.0:1746147140.939329:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75f80, transno 21474841405 00000004:00080000:0.0:1746147140.939331:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76a00, transno 21474841406 00000004:00080000:0.0:1746147140.939334:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77100, transno 21474841407 00000004:00080000:0.0:1746147140.939336:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db17800, transno 21474841409 00000004:00080000:0.0:1746147140.939338:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14a80, transno 21474841410 00000004:00080000:0.0:1746147140.939340:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db17480, transno 21474841411 00000004:00080000:0.0:1746147140.939342:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db15880, transno 21474841412 00000004:00080000:0.0:1746147140.939344:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db15500, transno 21474841413 00000004:00080000:0.0:1746147140.939346:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14000, transno 21474841414 00000004:00080000:0.0:1746147140.939348:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db15f80, transno 21474841415 00000004:00080000:0.0:1746147140.939350:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14700, transno 21474841416 00000004:00080000:0.0:1746147140.939352:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396a00, transno 21474841417 00000004:00080000:0.0:1746147140.939355:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57100, transno 21474841418 00000004:00080000:0.0:1746147140.939357:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157100, transno 21474841419 00000004:00080000:0.0:1746147140.939359:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db16d80, transno 21474841420 00000004:00080000:0.0:1746147140.939361:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55180, transno 21474841421 00000004:00080000:0.0:1746147140.939363:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6a00, transno 21474841422 00000004:00080000:0.0:1746147140.939365:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394a80, transno 21474841423 00000004:00080000:0.0:1746147140.939367:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f56300, transno 21474841424 00000004:00080000:0.0:1746147140.939369:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5880, transno 21474841427 00000004:00080000:0.0:1746147140.939372:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6300, transno 21474841428 00000004:00080000:0.0:1746147140.939374:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4380, transno 21474841429 00000004:00080000:0.0:1746147140.939376:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4000, transno 21474841430 00000004:00080000:0.0:1746147140.939378:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6d80, transno 21474841431 00000004:00080000:0.0:1746147140.939380:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e321c00, transno 21474841432 00000004:00080000:0.0:1746147140.939382:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5c00, transno 21474841433 00000004:00080000:0.0:1746147140.939384:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5180, transno 21474841434 00000004:00080000:0.0:1746147140.939385:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f087100, transno 21474841435 00000004:00080000:0.0:1746147140.939388:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f085c00, transno 21474841436 00000004:00080000:0.0:1746147140.939391:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f087b80, transno 21474841437 00000004:00080000:0.0:1746147140.939393:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3df80, transno 21474841438 00000004:00080000:0.0:1746147140.939395:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f087480, transno 21474841439 00000004:00080000:0.0:1746147140.939397:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f084a80, transno 21474841440 00000004:00080000:0.0:1746147140.939400:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f086680, transno 21474841441 00000004:00080000:0.0:1746147140.939402:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f084000, transno 21474841442 00000100:00100000:0.0:1746147140.939405:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310662144:0@lo:400:kworker.0 00000004:00080000:2.0:1746147140.939772:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 56 done 00000100:00100000:2.0:1746147140.941641:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310662528:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147140.941670:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147140.941681:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147140.941688:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae800, rc 0) 00000100:00100000:2.0:1746147140.941739:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32252:x1830967307933568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3726us (4559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.941747:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14456 00000100:00100000:3.0:1746147140.941766:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307933696 00000100:00100000:3.0:1746147140.941772:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307933696 00002000:00100000:3.0:1746147140.941802:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2535424->2867199) req@ffff880095235880 x1830967307933696/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.941812:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235880 with x1830967307933696 ext(2535424->2867199) 00010000:00010000:3.0:1746147140.941818:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 8 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.941827:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 8 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.941832:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095235880 00000100:00100000:3.0:1746147140.942101:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1089 00000100:00100000:3.0:1746147140.942109:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307933696:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147140.949153:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307933696:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7035us (7464us total) trans 21474841455 rc 0/0 00000100:00100000:3.0:1746147140.949164:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1089 00002000:00100000:3.0:1746147140.949175:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2535424->2867199) req@ffff880095235880 x1830967307933696/t21474841455(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:516/0 lens 488/448 e 0 to 0 dl 1746147151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.949183:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235880 with x1830967307933696 ext(2535424->2867199) 00010000:00010000:3.0:1746147140.949193:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746147140.949207:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746147140.949213:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095235880 00000100:00100000:0.0:1746147140.951329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.951537:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307933824 00000100:00100000:1.0:1746147140.951545:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307933824 00010000:00010000:1.0:1746147140.951578:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746147140.951613:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6321 00000100:00100000:1.0:1746147140.951620:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307933824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147140.951631:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147140.951649:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.951662:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.951686:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092562000/0x3139939425055d86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2867199) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a88 expref: 10 pid: 9586 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746147140.951708:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.951710:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147140.951717:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.951724:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147140.951750:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147140.951760:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310662656:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147140.951842:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147140.953491:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310662784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746147140.953538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147140.953573:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147140.953578:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310662912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746147140.953592:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310662784 00000100:00100000:0.0:1746147140.953594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147140.953600:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310662784 00000100:00100000:2.0:1746147140.954021:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310662912 00000100:00100000:2.0:1746147140.954025:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310662912 00000100:00100000:3.0:1746147140.954033:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1746147140.954045:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310662784:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746147140.954045:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1746147140.954052:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967310662912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746147140.954074:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000004:00000024:2.0:1746147140.954082:0:7243:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445658624 avail 1316196352 00000100:00100000:2.0:1746147140.954164:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967310662912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147140.954171:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1746147140.954177:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310662784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147140.954183:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1746147140.954264:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310662912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746147140.954274:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310662784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746147140.955021:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310662656:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147140.955038:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147140.955079:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967307933824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3459us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147140.955086:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6321 00000100:00100000:0.0:1746147140.962316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147140.962445:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307934080 00000100:00100000:3.0:1746147140.962454:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307934080 00002000:00100000:3.0:1746147140.962494:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880095235180 x1830967307934080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/0 e 0 to 0 dl 1746147151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.962508:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235180 with x1830967307934080 ext(2097152->4194303) 00002000:00010000:3.0:1746147140.962513:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095235180 00000100:00100000:3.0:1746147140.962540:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3445 00000100:00100000:3.0:1746147140.962547:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307934080:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147140.973468:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967307934080:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10910us (11148us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147140.973481:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3445 00002000:00100000:3.0:1746147140.973491:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880095235180 x1830967307934080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:516/0 lens 488/440 e 0 to 0 dl 1746147151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147140.973501:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235180 with x1830967307934080 ext(2097152->4194303) 00002000:00010000:3.0:1746147140.973507:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095235180 00000100:00100000:0.0:1746147140.984225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147140.984494:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307934336 00000100:00100000:1.0:1746147140.984504:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307934336 00000100:00100000:1.0:1746147140.984565:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5455 00000100:00100000:1.0:1746147140.984574:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:32252:x1830967307934336:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147140.984805:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:32252:x1830967307934336:12345-192.168.204.25@tcp:35:cat.0 Request processed in 230us (592us total) trans 8589935929 rc 0/0 00000100:00100000:1.0:1746147140.984812:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5455 00000100:00100000:1.0:1746147141.016333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.016387:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307934464 00000100:00100000:0.0:1746147141.016396:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307934464 00000100:00100000:0.0:1746147141.016444:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15247 00000100:00100000:0.0:1746147141.016451:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32258:x1830967307934464:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147141.016471:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147141.016486:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425055dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ac0 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.016533:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016543:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016553:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016562:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016566:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016571:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016625:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016632:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016637:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147141.016667:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147141.016670:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147141.016685:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016693:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016699:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016704:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016711:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016716:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016721:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147141.016724:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016730:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016739:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147141.016741:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147141.016744:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016748:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425055de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016760:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016765:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016774:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016778:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147141.016780:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016788:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016798:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f00c400) 00010000:00010000:0.0:1746147141.016800:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147141.016801:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016805:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425055de8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.016826:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x3139939425055dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.016835:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.016841:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147141.016842:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147141.016844:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260800, rc 0) 00000100:00100000:0.0:1746147141.016884:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32258:x1830967307934464:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 433us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147141.016889:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15247 00000100:00100000:3.0:1746147141.017422:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310663040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147141.017457:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147141.017530:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310663040 00000100:00100000:2.0:1746147141.017533:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310663040 00000100:00100000:2.0:1746147141.017561:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1746147141.017565:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310663040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746147141.017583:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1168294976 pending 1224704 free 3904991232 avail 3673468928 00000100:00100000:2.0:1746147141.017608:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310663040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.017612:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00080000:2.0:1746147141.017629:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147141.017818:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310663040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147141.017832:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746147141.017836:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310663168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147141.017850:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147141.017922:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310663168 00000100:00100000:2.0:1746147141.017924:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310663168 00000100:00100000:2.0:1746147141.017940:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1746147141.017943:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310663168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746147141.018327:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 974848 granted 1217492032 pending 1216512 free 3909718016 avail 3673448448 00000100:00100000:2.0:1746147141.018354:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310663168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 409us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.018359:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:3.0:1746147141.018402:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147141.018594:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310663168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147141.023504:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147141.023597:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307934592 00000100:00100000:2.0:1746147141.023606:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307934592 00000100:00100000:2.0:1746147141.023648:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14457 00000100:00100000:2.0:1746147141.023655:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2000:x1830967307934592:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147141.023672:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147141.023687:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x3139939425055df6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ac7 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.023726:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310663296:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147141.023798:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147141.024653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.024675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147141.025050:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307934720 00000100:00100000:2.0:1746147141.025054:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307934720 00000100:00100000:2.0:1746147141.025079:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307934848 00000100:00100000:2.0:1746147141.025081:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307934848 00000100:00100000:2.0:1746147141.025112:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14458 00000100:00100000:2.0:1746147141.025118:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307934720:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147141.025127:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147141.025137:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98e00/0x3139939425055dfd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ace expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.025166:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310663424:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147141.025209:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147141.025310:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14459 00000100:00100000:1.0:1746147141.025317:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307934848:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147141.025323:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147141.025330:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ad5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.025339:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.025341:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.025347:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147141.025360:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147141.025369:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31800, rc 0) 00000100:00100000:1.0:1746147141.025393:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307934848:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 78us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.025404:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14459 00000100:00100000:2.0:1746147141.025982:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310663296:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147141.026135:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x3139939425055df6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac7 expref: 11 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.026146:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x3139939425055df6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac7 expref: 11 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.026170:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99200, rc 0) 00000100:00100000:2.0:1746147141.026190:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307934592:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 2535us (2692us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147141.026195:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14457 00000100:00100000:2.0:1746147141.026805:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310663424:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147141.026819:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d98e00/0x3139939425055dfd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ace expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.026828:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98e00/0x3139939425055dfd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ace expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.026834:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98e00, rc 0) 00000100:00100000:2.0:1746147141.026888:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307934720:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 1770us (2236us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147141.026894:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14458 00000100:00100000:0.0:1746147141.029604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147141.029706:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307935104 00000100:00100000:2.0:1746147141.029713:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307935104 00000100:00100000:2.0:1746147141.029755:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15248 00000100:00100000:2.0:1746147141.029762:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32258:x1830967307935104:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147141.029777:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147141.029796:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425055e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77adc expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.029879:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.029892:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.029898:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 54 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.029904:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.029910:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.029932:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.029942:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 12 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.029953:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310663552:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.030046:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 54 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.030053:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 54 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.030060:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310663680:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.030081:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.030107:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 32 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.030114:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310663808:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147141.030139:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147141.033385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.033419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.033459:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147141.033480:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307935360 00000100:00100000:3.0:1746147141.033488:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307935360 00010000:00010000:3.0:1746147141.033518:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 55 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.033540:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307935488 00000100:00100000:3.0:1746147141.033542:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307935488 00010000:00010000:3.0:1746147141.033552:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 33 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.033564:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307935232 00000100:00100000:3.0:1746147141.033566:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307935232 00010000:00010000:3.0:1746147141.033574:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 13 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.033581:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6322 00000100:00100000:1.0:1746147141.033590:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2000:x1830967307935360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.033603:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.033609:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 55 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.033618:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6323 00010000:00010000:1.0:1746147141.033620:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 55 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.033623:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2002:x1830967307935488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147141.033630:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.033633:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 33 pid: 9138 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.033638:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147141.033642:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147141.033723:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147141.033729:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147141.033739:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6324 00010000:00010000:3.0:1746147141.033742:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 33 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.033750:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307935232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147141.033752:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147141.033755:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.033758:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.033761:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.033762:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 13 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.033764:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2000:x1830967307935360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 176us (387us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147141.033765:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.033770:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6322 00010000:00010000:2.0:1746147141.033772:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 13 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.033782:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2002:x1830967307935488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 158us (362us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147141.033783:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147141.033786:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:3.0:1746147141.033787:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6323 00010000:00010000:2.0:1746147141.033793:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.033799:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.033812:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147141.033828:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307935232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.033833:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6324 00010000:00010000:2.0:1746147141.033869:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x3139939425055def lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ac0 expref: 12 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.033880:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310663552:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.033889:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x3139939425055db0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a9d expref: 54 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.033902:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310663680:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.033910:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x3139939425055d6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a73 expref: 32 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.033918:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967310663808:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.033939:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.033945:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.033950:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147141.033975:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147141.034073:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425055e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77adc expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.034084:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77adc expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.034117:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147141.034120:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147141.034122:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99400, rc 0) 00000100:00100000:2.0:1746147141.034144:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32258:x1830967307935104:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4383us (4546us total) trans 8589935930 rc 0/0 00000100:00100000:2.0:1746147141.034150:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15248 00000100:00100000:0.0:1746147141.035883:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147141.035960:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307935744 00000100:00100000:2.0:1746147141.037251:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307935744 00000100:00100000:2.0:1746147141.037315:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15249 00000100:00100000:2.0:1746147141.037323:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32258:x1830967307935744:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147141.037351:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147141.037355:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147141.037377:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425055e12 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77adc expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.037393:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147141.037396:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147141.037406:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425055e20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ae3 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.037481:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425055e27 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.037491:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425055e27 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147141.037498:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425055e27 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147141.037507:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147141.037584:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425055e20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ae3 expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.037596:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425055e27 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ae3 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.037601:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147141.037604:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147141.037605:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98c00, rc 0) 00000100:00100000:2.0:1746147141.037656:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32258:x1830967307935744:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 333us (1780us total) trans 8589935931 rc 0/0 00000100:00100000:2.0:1746147141.037662:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15249 00000100:00100000:0.0:1746147141.039687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.039778:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307935872 00000100:00100000:1.0:1746147141.039808:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307935872 00000100:00100000:1.0:1746147141.040470:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15250 00000100:00100000:1.0:1746147141.040479:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32258:x1830967307935872:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147141.040494:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147141.040507:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425055e35 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77aea expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.040547:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425055e35 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aea expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.040557:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425055e35 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aea expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.040574:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147141.040577:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147141.040579:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31000, rc 0) 00000100:00100000:1.0:1746147141.041084:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32258:x1830967307935872:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 504us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.041105:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15250 00000100:00100000:0.0:1746147141.043288:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.043330:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.043354:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.043372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.043404:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.043431:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.043472:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936000 00000100:00100000:0.0:1746147141.043481:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936000 00000100:00100000:0.0:1746147141.043521:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936256 00000100:00100000:0.0:1746147141.043524:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936256 00000100:00100000:0.0:1746147141.043536:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936512 00000100:00100000:0.0:1746147141.043538:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936512 00000100:00100000:0.0:1746147141.043547:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936128 00000100:00100000:0.0:1746147141.043549:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936128 00000100:00100000:0.0:1746147141.043558:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936384 00000100:00100000:0.0:1746147141.043560:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936384 00000100:00100000:0.0:1746147141.043571:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14460 00000100:00100000:0.0:1746147141.043579:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307936000:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147141.043628:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.043649:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.043658:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.043667:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 28 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.043673:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.043675:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.043678:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.043711:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 28 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.043724:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 28 pid: 12201 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746147141.043738:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310663936:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147141.043828:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.043836:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 13 pid: 9585 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746147141.043844:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310664064:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147141.043868:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.043880:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 9 pid: 12201 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746147141.043887:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310664192:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147141.043904:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147141.043922:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936640 00000100:00100000:0.0:1746147141.043925:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936640 00000100:00100000:0.0:1746147141.043943:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14461 00000100:00100000:0.0:1746147141.043948:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307936256:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147141.043981:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.043992:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.043998:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147141.044000:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147141.044002:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.044018:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.044026:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 23 pid: 12201 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746147141.044042:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310664320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147141.044063:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147141.044079:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14462 00000100:00100000:0.0:1746147141.044121:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307936512:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147141.044138:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.044148:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.044155:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 9 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.044162:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.044167:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.044168:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.044171:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.044185:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.044193:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746147141.044201:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310664448:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147141.044256:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 9 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.044264:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 9 pid: 17600 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746147141.044271:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310664576:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147141.044294:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.044300:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 28 pid: 1854 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746147141.044307:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310664704:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147141.044318:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14463 00000100:00100000:0.0:1746147141.044320:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147141.044336:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307936128:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147141.044380:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044397:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044404:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147141.044405:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147141.044408:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044437:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044448:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 23 pid: 9586 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.044460:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310664832:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147141.044497:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14464 00000100:00100000:2.0:1746147141.044505:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307936384:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147141.044527:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.044529:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00010000:00010000:2.0:1746147141.044537:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 9 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.044544:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.044550:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147141.044553:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14465 00010000:00010000:2.0:1746147141.044556:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.044557:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147141.044560:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307936640:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147141.044560:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044576:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.044576:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.044584:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 779 lvb_type: 1 00010000:00010000:3.0:1746147141.044585:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044592:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147141.044592:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310664960:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147141.044597:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.044599:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.044601:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 5/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044617:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.044620:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147141.044625:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 10 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746147141.044628:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 13 pid: 17600 timeout: 779 lvb_type: 1 00000100:00100000:3.0:1746147141.044634:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310665088:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147141.044636:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310665216:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147141.044666:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.044677:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 23 pid: 12201 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.044685:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310665344:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.045400:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 9 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.045419:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 9 pid: 1136 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.045426:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147141.045428:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310665472:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147141.045452:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147141.048336:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310663936:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147141.048353:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310664064:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147141.048361:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310664192:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147141.048385:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147141.048753:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310664448:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147141.048826:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310664320:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.048841:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147141.053261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.053391:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310664576:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147141.053403:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310664704:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.053522:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.053635:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937152 00000100:00100000:3.0:1746147141.053648:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937152 00000100:00100000:0.0:1746147141.053657:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.053673:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:3.0:1746147141.053696:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1912831) req@ffff880097d75180 x1830967307937152/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:517/0 lens 488/0 e 0 to 0 dl 1746147152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147141.053707:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75180 with x1830967307937152 ext(1048576->1912831) 00010000:00010000:3.0:1746147141.053716:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 24 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.053728:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 24 pid: 12201 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746147141.053735:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d75180 00000100:00100000:1.0:1746147141.053891:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936768 00000100:00100000:1.0:1746147141.053896:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936768 00010000:00010000:1.0:1746147141.053923:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 14 pid: 9585 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746147141.053951:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937024 00000100:00100000:1.0:1746147141.053954:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937024 00010000:00010000:1.0:1746147141.053963:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 15 pid: 9586 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746147141.053992:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6325 00000100:00100000:1.0:1746147141.053999:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967307936768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.054016:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.054034:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 15 pid: 9585 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.054043:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 15 pid: 9585 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.054065:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425055cd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a11 expref: 15 pid: 9585 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.054082:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.054136:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967307936768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 138us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.054142:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6325 00000100:00100000:1.0:1746147141.054186:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6326 00000100:00100000:1.0:1746147141.054189:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967307937024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.054195:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.054202:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.054208:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.054218:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425055cd7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a2d expref: 13 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.054229:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.054238:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307937024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.054243:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6326 00000100:00100000:3.0:1746147141.054384:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1090 00000100:00100000:3.0:1746147141.054392:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967307937152:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147141.054442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.054465:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307936896 00000100:00100000:0.0:1746147141.054468:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307936896 00010000:00010000:0.0:1746147141.054483:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 29 pid: 12201 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746147141.054507:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6327 00000100:00100000:0.0:1746147141.054513:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307936896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147141.054519:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147141.054527:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 29 pid: 12201 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746147141.054536:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 29 pid: 12201 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746147141.054548:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425055afb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77923 expref: 29 pid: 12201 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746147141.054558:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147141.054578:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307936896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147141.054584:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6327 00000100:00100000:0.0:1746147141.055467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.055479:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147141.055549:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310664832:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147141.055568:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.055588:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310665088:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147141.055596:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310665344:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147141.055607:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.055622:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937280 00000100:00100000:3.0:1746147141.055626:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937280 00002000:00100000:3.0:1746147141.055652:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (2035712->2097151) req@ffff880097d75f80 x1830967307937280/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:517/0 lens 488/0 e 0 to 0 dl 1746147152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147141.055660:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75f80 with x1830967307937280 ext(2035712->2097151) 00010000:00010000:3.0:1746147141.055666:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 26 pid: 9586 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.055675:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 26 pid: 9586 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746147141.055681:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d75f80 00000100:00100000:3.0:1746147141.055705:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1091 00000100:00100000:3.0:1746147141.055710:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307937280:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147141.056433:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310664960:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147141.056442:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310665216:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147141.056650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.056663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.056675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.056710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.056725:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937536 00000100:00100000:1.0:1746147141.056727:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937536 00010000:00010000:1.0:1746147141.056743:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 10 pid: 17600 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746147141.056759:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937792 00000100:00100000:1.0:1746147141.056760:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937792 00010000:00010000:1.0:1746147141.056767:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 12 pid: 17600 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746147141.056774:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937408 00000100:00100000:1.0:1746147141.056776:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937408 00010000:00010000:1.0:1746147141.056783:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746147141.056789:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937664 00000100:00100000:1.0:1746147141.056790:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937664 00010000:00010000:1.0:1746147141.056797:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 11 pid: 9586 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746147141.056808:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307937920 00000100:00100000:1.0:1746147141.056809:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307937920 00010000:00010000:1.0:1746147141.056815:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 11 pid: 12201 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.056823:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6328 00000100:00100000:1.0:1746147141.056827:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307937536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.056834:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.056849:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 11 pid: 17600 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.056857:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 11 pid: 17600 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.056874:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e261a00/0x3139939425055d1d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a49 expref: 11 pid: 17600 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.056885:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.056910:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307937536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.056915:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6328 00000100:00100000:1.0:1746147141.056926:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6329 00000100:00100000:1.0:1746147141.056930:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307937792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.056935:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.056942:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 12 pid: 17600 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.056949:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 12 pid: 17600 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.056958:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x3139939425055cc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a26 expref: 12 pid: 17600 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.056964:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.056985:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307937792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.056990:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6329 00000100:00100000:1.0:1746147141.056997:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6330 00000100:00100000:1.0:1746147141.057001:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307937408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.057007:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.057012:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.057020:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.057032:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cc000/0x3139939425055c36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779af expref: 28 pid: 12225 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.057039:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.057052:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307937408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.057058:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6330 00000100:00100000:1.0:1746147141.057067:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6331 00000100:00100000:1.0:1746147141.057072:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307937664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.057078:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.057087:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 11 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.057110:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 11 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.057123:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425055e04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ad5 expref: 11 pid: 9586 timeout: 779 lvb_type: 1 00010000:00010000:1.0:1746147141.057131:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.057143:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307937664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 71us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.057148:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6331 00000100:00100000:1.0:1746147141.057155:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6332 00000100:00100000:1.0:1746147141.057160:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307937920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.057167:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.057174:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 9 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.057182:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 9 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.057197:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3e00/0x3139939425055ad1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77907 expref: 9 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.057206:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.057207:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.057212:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057220:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057241:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.057254:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307937920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.057258:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6332 00010000:00010000:1.0:1746147141.057289:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057297:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057310:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057316:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057337:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057343:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147141.057347:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.057754:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310665472:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147141.057779:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057869:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057880:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.057886:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x3139939425055e3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147141.058532:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307936000:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 14952us (15252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.058542:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14460 00000100:00100000:0.0:1746147141.063070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.063139:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.063176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.063322:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938048 00000100:00100000:1.0:1746147141.063335:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938048 00010000:00010000:1.0:1746147141.063373:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 8 pid: 1136 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.063405:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6333 00000100:00100000:1.0:1746147141.063413:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307938048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147141.063429:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938176 00000100:00100000:2.0:1746147141.063433:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938176 00010000:00010000:1.0:1746147141.063434:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.063450:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 8 pid: 1136 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746147141.063454:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 27 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.063460:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 8 pid: 1136 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746147141.063474:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938304 00000100:00100000:2.0:1746147141.063477:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938304 00010000:00010000:1.0:1746147141.063478:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e573600/0x3139939425055bf0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7798c expref: 8 pid: 1136 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746147141.063488:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 28 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.063491:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147141.063493:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6334 00010000:00010000:1.0:1746147141.063493:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.063497:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.063502:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307938176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.063504:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.063505:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6335 00010000:00010000:3.0:1746147141.063509:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147141.063510:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307938304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147141.063517:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.063519:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 27 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.063527:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147141.063528:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 28 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.063529:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 27 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746147141.063536:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 28 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.063542:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425055c6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e779ee expref: 27 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746147141.063549:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425055dd3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ab9 expref: 28 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746147141.063561:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.063562:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.063565:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147141.063568:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307938048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 156us (511us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147141.063571:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147141.063575:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6333 00010000:00010000:2.0:1746147141.063582:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147141.063599:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307938304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 89us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.063605:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6335 00010000:00010000:2.0:1746147141.063623:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.063629:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063633:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.063634:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.063637:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.063642:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063643:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.063648:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063655:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147141.063658:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063661:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.063664:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147141.063667:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063668:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.063674:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.063677:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967307938176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 177us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.063683:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6334 00010000:00010000:2.0:1746147141.063683:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.063688:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99600/0x3139939425055e58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063701:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063706:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063708:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063714:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063718:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063720:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.063723:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307936384:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 19218us (20318us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147141.063724:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063724:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8ea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147141.063726:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.063730:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14464 00010000:00010000:1.0:1746147141.063731:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063734:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063739:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01b000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147141.063739:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063741:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.063744:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063747:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063754:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.063760:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01b000/0x3139939425055e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147141.063772:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307936512:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 19687us (20417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.063777:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14462 00000100:00100000:3.0:1746147141.063792:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307936640:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 19232us (20361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.063798:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14465 00000100:00100000:2.0:1746147141.068802:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307937280:12345-192.168.204.25@tcp:4:cat.0 Request processed in 13078us (13323us total) trans 21474841456 rc 0/0 00000100:00100000:2.0:1746147141.068816:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1091 00002000:00100000:2.0:1746147141.068829:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (2035712->2097151) req@ffff880097d75f80 x1830967307937280/t21474841456(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:517/0 lens 488/448 e 0 to 0 dl 1746147152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147141.068839:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75f80 with x1830967307937280 ext(2035712->2097151) 00010000:00010000:2.0:1746147141.068852:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 29 pid: 9586 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746147141.068863:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 29 pid: 9586 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746147141.068869:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d75f80 00000100:00100000:3.0:1746147141.073220:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307937152:12345-192.168.204.25@tcp:4:cat.0 Request processed in 18816us (19958us total) trans 21474841457 rc 0/0 00000100:00100000:3.0:1746147141.073234:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1090 00002000:00100000:3.0:1746147141.073247:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1912831) req@ffff880097d75180 x1830967307937152/t21474841457(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:517/0 lens 488/448 e 0 to 0 dl 1746147152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147141.073257:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75180 with x1830967307937152 ext(1048576->1912831) 00010000:00010000:3.0:1746147141.073268:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 27 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.073282:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 27 pid: 12201 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746147141.073289:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d75180 00000100:00100000:0.0:1746147141.073576:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.073734:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938432 00000100:00100000:1.0:1746147141.073742:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938432 00010000:00010000:1.0:1746147141.073768:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 27 pid: 9586 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.073786:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6336 00000100:00100000:1.0:1746147141.073791:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967307938432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147141.073806:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.073820:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 27 pid: 9586 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.073829:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 27 pid: 9586 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.073851:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x3139939425055d47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a65 expref: 27 pid: 9586 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746147141.073864:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.073866:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147141.073871:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.073879:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.073900:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147141.073917:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307938432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.073921:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6336 00010000:00010000:3.0:1746147141.073985:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.073993:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074008:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074015:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074021:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074027:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01bc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147141.074031:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074037:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074051:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.074057:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01bc00/0x3139939425055e51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147141.074112:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307936128:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 29783us (30739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.074119:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14463 00000100:00100000:0.0:1746147141.076162:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147141.076288:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938560 00000100:00100000:3.0:1746147141.076297:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938560 00010000:00010000:3.0:1746147141.076334:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 26 pid: 12201 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.076364:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6337 00000100:00100000:3.0:1746147141.076371:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967307938560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147141.076385:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.076408:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 26 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.076419:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 26 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.076442:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb600/0x3139939425055d4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1912831) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77a6c expref: 26 pid: 12201 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.076463:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.076465:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.076470:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.076477:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.076650:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147141.076697:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967307938560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 325us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.076704:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6337 00010000:00010000:2.0:1746147141.076768:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076777:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076792:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076799:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076805:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076811:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8ec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147141.076815:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076821:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076834:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147141.076839:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425055e43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147141.076886:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2001:x1830967307936256:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 32938us (33555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.076894:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14461 00000100:00100000:0.0:1746147141.080042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.080240:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938816 00000100:00100000:1.0:1746147141.080249:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938816 00000100:00100000:1.0:1746147141.080707:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15251 00000100:00100000:1.0:1746147141.080717:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32258:x1830967307938816:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147141.080769:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147141.080799:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425055e35 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aea expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.080815:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147141.080820:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147141.080850:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147141.080865:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 53 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.080873:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.080879:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 53 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.080886:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.080893:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147141.080930:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.080949:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 31 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.080964:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665600:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.081125:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 53 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.081133:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 53 pid: 16099 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.081140:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665728:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.081177:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.081183:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 31 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.081190:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095235500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665856:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.081210:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 53 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.081216:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 53 pid: 16099 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.081222:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665984:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147141.081239:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147141.085947:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.085986:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.086003:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147141.086017:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307938944 00000100:00100000:3.0:1746147141.086027:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307938944 00010000:00010000:3.0:1746147141.086064:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 32 pid: 7238 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746147141.086077:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147141.086110:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939200 00000100:00100000:3.0:1746147141.086113:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939200 00000100:00100000:0.0:1746147141.086115:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939072 00000100:00100000:0.0:1746147141.086118:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939072 00010000:00010000:3.0:1746147141.086124:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 33 pid: 9138 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746147141.086132:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 54 pid: 16099 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746147141.086138:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939328 00000100:00100000:3.0:1746147141.086140:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939328 00010000:00010000:3.0:1746147141.086149:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 55 pid: 16099 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746147141.086149:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6338 00000100:00100000:0.0:1746147141.086156:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307938944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147141.086165:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6339 00010000:00010000:0.0:1746147141.086168:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147141.086171:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307939200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147141.086173:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 33 pid: 7238 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086178:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.086181:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 33 pid: 9138 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746147141.086184:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 33 pid: 7238 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086200:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 33 pid: 9138 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086222:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147141.086227:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147141.086236:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147141.086274:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967307939200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.086280:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6339 00000100:00100000:3.0:1746147141.086295:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6340 00000100:00100000:3.0:1746147141.086300:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2001:x1830967307939072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147141.086306:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.086309:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 55 pid: 16099 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086317:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 55 pid: 16099 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086327:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147141.086331:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147141.086336:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147141.086346:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2001:x1830967307939072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.086351:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6340 00000100:00100000:3.0:1746147141.086359:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6341 00000100:00100000:3.0:1746147141.086363:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2000:x1830967307939328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147141.086368:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147141.086371:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 54 pid: 16099 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086380:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 54 pid: 16099 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746147141.086387:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147141.086390:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147141.086395:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147141.086403:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2000:x1830967307939328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.086408:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6341 00000100:00100000:1.0:1746147141.086620:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665600:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.086632:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1200/0x31399394250557b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77747 expref: 53 pid: 16099 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.086643:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665728:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.086650:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425055b80 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7795b expref: 32 pid: 9138 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.086658:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095235500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665856:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.086664:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2200/0x3139939425055b25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77938 expref: 52 pid: 16099 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746147141.086671:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310665984:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147141.086698:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.087030:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x31399394250557c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77755 expref: 31 pid: 7238 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746147141.087064:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147141.087068:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.087075:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.087082:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147141.087126:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147141.087157:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147141.087162:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967307938944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1004us (1224us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147141.087164:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147141.087169:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6338 00000040:00080000:1.0:1746147141.087577:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].569, 88 off58136 00000004:00080000:1.0:1746147141.087586:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679077495922ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.088474:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].508, 88 off52760 00000004:00080000:1.0:1746147141.088482:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078392279ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.088601:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].509, 88 off52848 00000004:00080000:1.0:1746147141.088605:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078515491ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.088617:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].570, 88 off58224 00000004:00080000:1.0:1746147141.088619:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679078529631ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.088706:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].571, 88 off58312 00000004:00080000:1.0:1746147141.088709:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679078619861ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.088717:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].510, 88 off52936 00000004:00080000:1.0:1746147141.088720:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078630202ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.088728:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].511, 88 off53024 00000004:00080000:1.0:1746147141.088730:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078640886ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.088737:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].512, 88 off53112 00000004:00080000:1.0:1746147141.088740:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078650372ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.088746:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].572, 88 off58400 00000004:00080000:1.0:1746147141.088749:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679078659338ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.088756:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].513, 88 off53200 00000004:00080000:1.0:1746147141.088758:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078668929ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.088765:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].573, 88 off58488 00000004:00080000:1.0:1746147141.088767:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679078677628ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.089051:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].514, 88 off53288 00000004:00080000:1.0:1746147141.089064:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679078974346ns, next at 554081490131ns, rc = 0 00000040:00080000:1.0:1746147141.089238:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].574, 88 off58576 00000004:00080000:1.0:1746147141.089242:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679079152062ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.089266:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].575, 88 off58664 00000004:00080000:1.0:1746147141.089269:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679079179199ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.089276:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].576, 88 off58752 00000004:00080000:1.0:1746147141.089278:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679079189148ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.089286:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].577, 88 off58840 00000004:00080000:1.0:1746147141.089290:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679079200228ns, next at 554081470618ns, rc = 0 00000040:00080000:1.0:1746147141.089302:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].515, 88 off53376 00000004:00080000:1.0:1746147141.089305:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679079215271ns, next at 554081490131ns, rc = 0 00000001:00080000:2.0:1746147141.091538:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935932 is committed 00000004:00080000:2.0:1746147141.091549:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 510 committed 00000004:00080000:2.0:1746147141.091561:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 569 committed 00000004:00080000:2.0:1746147141.091572:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 568 committed 00000004:00080000:2.0:1746147141.091573:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 567 committed 00000004:00080000:2.0:1746147141.091575:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 566 committed 00000004:00080000:2.0:1746147141.091576:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 509 committed 00000004:00080000:2.0:1746147141.091578:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 565 committed 00000004:00080000:2.0:1746147141.091579:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 508 committed 00000004:00080000:2.0:1746147141.091581:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 564 committed 00000004:00080000:2.0:1746147141.091582:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 507 committed 00000004:00080000:2.0:1746147141.091583:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 506 committed 00000004:00080000:2.0:1746147141.091585:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 505 committed 00000004:00080000:2.0:1746147141.091586:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 563 committed 00000004:00080000:2.0:1746147141.091588:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 562 committed 00000004:00080000:2.0:1746147141.091589:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 504 committed 00000004:00080000:2.0:1746147141.091590:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 503 committed 00000004:00080000:2.0:1746147141.091592:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 561 committed 00000001:00080000:2.0:1746147141.091598:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935929 is committed 00000001:00080000:2.0:1746147141.091604:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935928 is committed 00000100:00100000:1.0:1746147141.091655:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310666112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147141.091696:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310666368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.091710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.091721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147141.091727:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310666240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147141.091738:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310666880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.091740:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310666624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147141.091753:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.091769:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666112 00000100:00100000:3.0:1746147141.091775:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666112 00000100:00100000:0.0:1746147141.091779:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310666752:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746147141.091786:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880097d74000 reply state ffff88012d3c1800 transno 8589935932 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147141.091794:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746147141.091802:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147141.091805:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666368 00000100:00100000:3.0:1746147141.091807:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666368 00010000:00010000:1.0:1746147141.091810:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147141.091813:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147141.091813:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310666496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147141.091815:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666240 00000100:00100000:1.0:1746147141.091816:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147141.091817:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666240 00000100:00100000:3.0:1746147141.091824:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666752 00000100:00100000:3.0:1746147141.091826:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666752 00000100:00100000:0.0:1746147141.091828:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.091835:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666496 00000100:00100000:3.0:1746147141.091836:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666496 00000100:00100000:1.0:1746147141.091839:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14466 00000100:00100000:0.0:1746147141.091839:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310667008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.091847:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3766:x1830967310666112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147141.091848:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14467 00000100:00100000:3.0:1746147141.091853:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3764:x1830967310666368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147141.091853:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147141.091873:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667008 00000100:00100000:0.0:1746147141.091876:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667008 00000100:00100000:0.0:1746147141.091893:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14468 00000100:00100000:0.0:1746147141.091898:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3767:x1830967310666240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.091922:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147141.091944:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666624 00000100:00100000:1.0:1746147141.091947:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666624 00000100:00100000:3.0:1746147141.091955:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3764:x1830967310666368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (233us total) trans 21474841459 rc 0/0 00000100:00100000:1.0:1746147141.091960:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14469 00000100:00100000:3.0:1746147141.091963:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14467 00000100:00100000:1.0:1746147141.091964:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310666752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147141.091980:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310666240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (226us total) trans 21474841460 rc 0/0 00000100:00100000:0.0:1746147141.091986:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14468 00000100:00100000:3.0:1746147141.091991:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14470 00000100:00100000:3.0:1746147141.091995:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310666496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147141.091997:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14471 00000100:00100000:0.0:1746147141.092001:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310667008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147141.092021:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147141.092024:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147141.092026:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:0.0:1746147141.092026:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094526a00/2, rc 0, transno 21474841460 00002000:00010000:1.0:1746147141.092027:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147141.092029:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147141.092030:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310666240:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147141.092034:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147141.092037:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147141.092039:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147141.092041:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147141.092043:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:0.0:1746147141.092043:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14472 00000100:00100000:0.0:1746147141.092048:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3766:x1830967310666624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.092051:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310666752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (256us total) trans 21474841461 rc 0/0 00000100:00100000:1.0:1746147141.092059:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14469 00000100:00100000:3.0:1746147141.092065:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310666496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (235us total) trans 21474841462 rc 0/0 00000100:00100000:3.0:1746147141.092070:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14470 00000100:00100000:3.0:1746147141.092107:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147141.092120:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310666112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 274us (410us total) trans 21474841458 rc 0/0 00000100:00100000:1.0:1746147141.092125:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14466 00000100:00100000:0.0:1746147141.092125:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310666624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (202us total) trans 21474841463 rc 0/0 00000004:00080000:3.0:1746147141.092129:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525880/2, rc 0, transno 21474841459 00000100:00100000:0.0:1746147141.092131:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14472 00000100:00100000:3.0:1746147141.092132:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310666368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.092133:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310666880 00000100:00100000:1.0:1746147141.092136:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310666880 00000004:00080000:0.0:1746147141.092152:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094527480/2, rc 0, transno 21474841462 00000100:00100000:0.0:1746147141.092155:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310666496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.092161:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14473 00000100:00100000:1.0:1746147141.092166:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967310666880:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147141.092166:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094526300/2, rc 0, transno 21474841461 00000100:00100000:0.0:1746147141.092169:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310666752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.092217:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967310666880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (109us total) trans 21474841464 rc 0/0 00000100:00100000:3.0:1746147141.092221:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310667392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147141.092222:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14473 00000100:00100000:3.0:1746147141.092242:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147141.092242:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310667520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147141.092259:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525500/2, rc 0, transno 21474841464 00000100:00100000:0.0:1746147141.092260:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.092262:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310666880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147141.092268:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310667904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147141.092272:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310668032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147141.092281:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310667008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 278us (426us total) trans 21474841465 rc 0/0 00000100:00100000:3.0:1746147141.092282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147141.092285:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14471 00000100:00100000:0.0:1746147141.092287:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147141.092294:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667392 00000100:00100000:1.0:1746147141.092297:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667392 00000100:00100000:0.0:1746147141.092300:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.092304:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667520 00000100:00100000:3.0:1746147141.092307:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667520 00000100:00100000:1.0:1746147141.092309:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667904 00000100:00100000:0.0:1746147141.092311:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147141.092312:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667904 00000100:00100000:3.0:1746147141.092319:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667264 00000100:00100000:3.0:1746147141.092321:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667264 00000100:00100000:1.0:1746147141.092322:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14474 00000100:00100000:1.0:1746147141.092326:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3764:x1830967310667392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147141.092330:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14475 00000100:00100000:0.0:1746147141.092331:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.092335:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967310667520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147141.092340:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147141.092344:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147141.092346:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667776 00000100:00100000:2.0:1746147141.092350:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667776 00000100:00100000:0.0:1746147141.092358:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147141.092362:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667136 00000100:00100000:2.0:1746147141.092364:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667136 00000100:00100000:0.0:1746147141.092364:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147141.092374:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14476 00000100:00100000:0.0:1746147141.092375:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147141.092378:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967310667904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147141.092380:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14477 00000100:00100000:2.0:1746147141.092385:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967310667264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147141.092386:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147141.092397:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967310667392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (154us total) trans 17179874191 rc 0/0 00000004:00080000:0.0:1746147141.092398:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094526680/2, rc 0, transno 21474841465 00000100:00100000:0.0:1746147141.092401:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310667008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147141.092402:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14474 00000100:00100000:1.0:1746147141.092410:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310667648 00000100:00100000:0.0:1746147141.092411:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310668032 00000100:00100000:1.0:1746147141.092412:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310667648 00000100:00100000:0.0:1746147141.092413:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310668032 00000100:00100000:1.0:1746147141.092421:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14478 00000100:00100000:1.0:1746147141.092425:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967310667776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147141.092428:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147141.092430:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00000100:00100000:2.0:1746147141.092430:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14479 00002000:00010000:3.0:1746147141.092432:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147141.092433:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14480 00002000:00010000:3.0:1746147141.092434:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000100:00100000:2.0:1746147141.092434:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967310667136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147141.092436:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147141.092436:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967310667648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147141.092454:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3764:x1830967310667904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (170us total) trans 17179874193 rc 0/0 00000100:00100000:3.0:1746147141.092459:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14476 00000100:00100000:3.0:1746147141.092468:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14481 00000100:00100000:3.0:1746147141.092472:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967310668032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147141.092473:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:0.0:1746147141.092475:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:0.0:1746147141.092477:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746147141.092478:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310667776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (145us total) trans 17179874195 rc 0/0 00002000:00010000:0.0:1746147141.092478:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147141.092480:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:1.0:1746147141.092483:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14478 00000100:00100000:0.0:1746147141.092497:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310667648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (121us total) trans 17179874197 rc 0/0 00000100:00100000:0.0:1746147141.092501:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14480 00000004:00080000:1.0:1746147141.092502:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524700/2, rc 0, transno 21474841463 00002000:00010000:3.0:1746147141.092505:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00000100:00100000:1.0:1746147141.092506:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310666624:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147141.092507:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147141.092509:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147141.092510:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147141.092512:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000004:00080000:1.0:1746147141.092513:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524000/2, rc 0, transno 21474841458 00000100:00100000:1.0:1746147141.092516:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310666112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147141.092519:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75c00/2, rc 0, transno 17179874197 00000100:00100000:0.0:1746147141.092524:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147141.092530:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ead80/2, rc 0, transno 17179874195 00000100:00100000:0.0:1746147141.092533:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147141.092537:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967310668032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (145us total) trans 17179874198 rc 0/0 00000100:00100000:3.0:1746147141.092541:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14481 00000004:00080000:0.0:1746147141.092545:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8700/2, rc 0, transno 17179874198 00000100:00100000:0.0:1746147141.092553:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310668032:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746147141.092573:0:7238:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147141.092584:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32258:x1830967307938816:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 11869us (12552us total) trans 8589935932 rc 0/0 00000100:00100000:0.0:1746147141.092586:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147141.092590:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15251 00000100:00100000:0.0:1746147141.092591:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310668160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147141.092594:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310667520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (333us total) trans 17179874192 rc 0/0 00000100:00100000:3.0:1746147141.092599:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14475 00000100:00100000:0.0:1746147141.092610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147141.092615:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8e00/2, rc 0, transno 17179874193 00000100:00100000:3.0:1746147141.092618:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310667904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147141.092629:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77800/2, rc 0, transno 17179874192 00000100:00100000:0.0:1746147141.092632:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310667520:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147141.092728:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147141.092736:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147141.092741:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147141.092746:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a31a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147141.092750:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147141.092755:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147141.092763:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147141.092766:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147141.092768:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000004:00080000:3.0:1746147141.092769:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76a00/2, rc 0, transno 17179874191 00000100:00100000:3.0:1746147141.092772:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310667392:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147141.092772:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425055e66 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147141.092782:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310668160 00000100:00100000:3.0:1746147141.092784:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310668160 00000100:00100000:3.0:1746147141.092796:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14482 00000100:00100000:3.0:1746147141.092800:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967310668160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147141.092836:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310667264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 450us (534us total) trans 17179874194 rc 0/0 00000004:00080000:0.0:1746147141.092839:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75880/2, rc 0, transno 17179874194 00000100:00100000:2.0:1746147141.092841:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14477 00000100:00100000:0.0:1746147141.092842:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147141.092849:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312e8a80/2, rc 0, transno 17179874199 00000100:00100000:3.0:1746147141.092851:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967310668160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (240us total) trans 17179874199 rc 0/0 00000100:00100000:0.0:1746147141.092852:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310668160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147141.092856:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14482 00000100:00100000:2.0:1746147141.092877:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310667136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 442us (518us total) trans 17179874196 rc 0/0 00000100:00100000:2.0:1746147141.092892:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14479 00000004:00080000:3.0:1746147141.092893:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75500/2, rc 0, transno 17179874196 00000100:00100000:3.0:1746147141.092896:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310667136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147141.094359:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147141.094573:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939456 00000100:00100000:1.0:1746147141.094578:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939456 00000100:00100000:1.0:1746147141.094618:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15252 00000100:00100000:1.0:1746147141.094624:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32258:x1830967307939456:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147141.094640:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147141.094656:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77af1 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.094699:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.094711:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147141.094725:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147141.094728:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147141.094731:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31800, rc 0) 00000100:00100000:1.0:1746147141.094770:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32258:x1830967307939456:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 146us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147141.094775:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15252 00000100:00100000:0.0:1746147141.097085:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147141.097345:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939584 00000100:00100000:3.0:1746147141.097351:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939584 00000100:00100000:3.0:1746147141.097684:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15253 00000100:00100000:3.0:1746147141.097692:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32258:x1830967307939584:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147141.097705:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147141.097718:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055e74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77af8 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.097777:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147141.097787:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147141.097795:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147141.097814:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147141.097817:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147141.097831:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147141.097850:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055e74 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.098158:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.098166:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147141.098168:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147141.098171:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04a00, rc 0) 00000100:00100000:3.0:1746147141.098242:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32258:x1830967307939584:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 551us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.098248:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15253 00000100:00100000:0.0:1746147141.101802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147141.101834:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939712 00000100:00100000:0.0:1746147141.101842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147141.101844:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939712 00000100:00100000:3.0:1746147141.101899:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939840 00000100:00100000:3.0:1746147141.101904:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939840 00000100:00100000:2.0:1746147141.101904:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14483 00000100:00100000:2.0:1746147141.101911:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307939712:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147141.101927:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14484 00010000:00010000:2.0:1746147141.101928:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147141.101933:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2003:x1830967307939840:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147141.101941:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147141.101951:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77aff expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147141.101954:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b06 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147141.101984:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141744, atime: 0x68141744, ctime: 0x68141744, blocks: 0x808 00002000:00010000:2.0:1746147141.101984:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x68141743, atime: 0x68141744, ctime: 0x68141743, blocks: 0x7c8 00010000:00010000:3.0:1746147141.102001:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.102001:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.102002:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.102002:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147141.102010:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.102010:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147141.102023:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.102023:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147141.102033:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00010000:00010000:2.0:1746147141.102034:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8ea00, rc 0) 00000100:00100000:3.0:1746147141.102365:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307939840:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 431us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.102366:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307939712:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 455us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147141.102372:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14484 00000100:00100000:2.0:1746147141.102375:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14483 00000100:00100000:0.0:1746147141.102493:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.102539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.102603:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.102619:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147141.102628:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307939968 00000100:00100000:0.0:1746147141.102631:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307939968 00000100:00100000:0.0:1746147141.102647:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940096 00000100:00100000:0.0:1746147141.102649:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940096 00000100:00100000:0.0:1746147141.102657:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940224 00000100:00100000:0.0:1746147141.102659:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940224 00000100:00100000:0.0:1746147141.102666:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940352 00000100:00100000:0.0:1746147141.102668:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940352 00000100:00100000:0.0:1746147141.102678:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14485 00000100:00100000:0.0:1746147141.102684:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307939968:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147141.102690:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147141.102698:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b0d expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147141.102709:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x68141744, atime: 0x68141744, ctime: 0x68141744, blocks: 0x808 00010000:00010000:0.0:1746147141.102716:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.102717:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.102722:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.102730:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.102736:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542a00, rc 0) 00000100:00100000:0.0:1746147141.102758:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307939968:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147141.102763:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14485 00000100:00100000:0.0:1746147141.102772:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14486 00000100:00100000:0.0:1746147141.102776:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940096:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147141.102781:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147141.102787:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b14 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147141.102796:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141744, atime: 0x68141744, ctime: 0x68141744, blocks: 0x800 00010000:00010000:0.0:1746147141.102803:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.102804:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.102807:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.102816:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147141.102822:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543a00, rc 0) 00000100:00100000:0.0:1746147141.102833:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307940096:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 57us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147141.102838:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14486 00000100:00100000:0.0:1746147141.102845:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14487 00000100:00100000:0.0:1746147141.102848:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940224:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147141.102852:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147141.102859:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b1b expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147141.102867:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141744, atime: 0x68141744, ctime: 0x68141744, blocks: 0x1590 00010000:00010000:0.0:1746147141.102872:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147141.102874:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14488 00010000:00010000:0.0:1746147141.102874:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147141.102877:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147141.102880:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307940352:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147141.102885:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.102886:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147141.102894:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b22 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147141.102896:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543c00, rc 0) 00002000:00010000:2.0:1746147141.102904:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141744, atime: 0x68141744, ctime: 0x68141744, blocks: 0x1008 00000100:00100000:0.0:1746147141.102906:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307940224:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147141.102910:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14487 00010000:00010000:2.0:1746147141.102912:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.102913:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147141.102917:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.102926:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147141.102932:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8fe00, rc 0) 00000100:00100000:2.0:1746147141.102947:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940352:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 68us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147141.102951:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14488 00010000:00010000:0.0:1746147141.625359:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147142.111006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.111314:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940480 00000100:00100000:3.0:1746147142.111324:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940480 00000100:00100000:3.0:1746147142.111392:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14489 00000100:00100000:3.0:1746147142.111402:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307940480:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147142.114370:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307940480:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 2959us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.114384:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14489 00000100:00080000:0.0:1746147142.115500:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147142.115634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.115690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.115706:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940608 00000100:00100000:2.0:1746147142.115714:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940608 00000100:00100000:2.0:1746147142.115746:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940864 00000100:00100000:2.0:1746147142.115747:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940864 00000100:00100000:2.0:1746147142.115759:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14490 00000100:00100000:2.0:1746147142.115765:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940608:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147142.115847:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940608:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.115853:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14490 00000100:00100000:2.0:1746147142.115862:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14491 00000100:00100000:2.0:1746147142.115865:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307940864:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147142.115895:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307940864:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.115899:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14491 00000100:00100000:2.0:1746147142.115939:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.115956:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941120 00000100:00100000:2.0:1746147142.115958:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941120 00000100:00100000:2.0:1746147142.115969:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14492 00000100:00100000:2.0:1746147142.115973:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307941120:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147142.115998:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307941120:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 25us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.116003:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14492 00000100:00100000:2.0:1746147142.116038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.116047:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940736 00000100:00100000:2.0:1746147142.116050:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940736 00000100:00100000:2.0:1746147142.116063:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14493 00000100:00100000:2.0:1746147142.116068:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940736:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147142.116116:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307940736:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 49us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.116125:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14493 00000100:00100000:2.0:1746147142.116186:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.116196:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307940992 00000100:00100000:2.0:1746147142.116198:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307940992 00000100:00100000:2.0:1746147142.116210:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14494 00000100:00100000:2.0:1746147142.116214:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307940992:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147142.116239:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307940992:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 25us (53us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.116243:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14494 00000100:00080000:0.0:1746147142.116710:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147142.125401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.125495:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941248 00000100:00100000:3.0:1746147142.125506:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941248 00000100:00100000:3.0:1746147142.125563:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14495 00000100:00100000:3.0:1746147142.125571:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307941248:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147142.125698:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307941248:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 127us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.125706:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14495 00000100:00100000:0.0:1746147142.127341:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.128476:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941376 00000100:00100000:1.0:1746147142.128488:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941376 00000100:00100000:0.0:1746147142.128517:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.129397:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.129419:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941504 00000100:00100000:1.0:1746147142.129423:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941504 00000100:00100000:3.0:1746147142.129549:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14496 00000100:00100000:3.0:1746147142.129561:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307941376:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147142.129680:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307941376:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 122us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.129685:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14496 00000100:00100000:3.0:1746147142.129699:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14497 00000100:00100000:3.0:1746147142.129704:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307941504:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147142.129746:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307941504:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 41us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.129751:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14497 00000100:00100000:1.0:1746147142.131018:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941632 00000100:00100000:0.0:1746147142.131021:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.131023:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941632 00000100:00100000:1.0:1746147142.131044:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941760 00000100:00100000:1.0:1746147142.131046:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941760 00000100:00100000:0.0:1746147142.131049:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.131062:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307941888 00000100:00100000:1.0:1746147142.131064:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307941888 00000100:00100000:0.0:1746147142.131072:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14498 00000100:00100000:1.0:1746147142.131076:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14499 00000100:00100000:0.0:1746147142.131079:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307941632:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147142.131080:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307941760:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147142.131114:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14500 00000100:00100000:1.0:1746147142.131119:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307941888:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147142.131151:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307941888:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.131156:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14500 00000100:00100000:0.0:1746147142.131159:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967307941632:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 81us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.131163:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14498 00000100:00100000:1.0:1746147142.131193:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307941760:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 112us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.131198:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14499 00000100:00100000:0.0:1746147142.137333:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.137524:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307942016 00000100:00100000:2.0:1746147142.137532:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307942016 00000100:00100000:2.0:1746147142.137587:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14501 00000100:00100000:2.0:1746147142.137595:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307942016:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:2.0:1746147142.137790:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147142.137793:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.137795:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.137797:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.137798:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147142.137850:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307942016:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 255us (524us total) trans 21474841466 rc 0/0 00000100:00100000:2.0:1746147142.137856:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14501 00000100:00100000:0.0:1746147142.143557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.143886:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307942144 00000100:00100000:2.0:1746147142.143896:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307942144 00000100:00100000:2.0:1746147142.144068:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14502 00000100:00100000:2.0:1746147142.144077:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307942144:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:2.0:1746147142.144343:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147142.144347:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.144349:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.144351:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.144352:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147142.144411:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307942144:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 335us (864us total) trans 17179874200 rc 0/0 00000100:00100000:2.0:1746147142.144418:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14502 00000100:00100000:0.0:1746147142.151506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.151610:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307942400 00000100:00100000:3.0:1746147142.151620:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307942400 00000100:00100000:3.0:1746147142.151691:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3446 00000100:00100000:3.0:1746147142.151701:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307942400:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147142.151739:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.151754:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.151757:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.151762:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.151777:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.157750:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.157804:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.158170:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307942656 00000100:00100000:2.0:1746147142.158181:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307942656 00000100:00100000:2.0:1746147142.158247:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307942912 00000100:00100000:2.0:1746147142.158250:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307942912 00000100:00100000:2.0:1746147142.158284:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3447 00000100:00100000:2.0:1746147142.158293:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307942656:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147142.158337:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.158350:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3448 00010000:00010000:2.0:1746147142.158358:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147142.158358:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307942912:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147142.158360:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.158366:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.158377:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.158385:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.158385:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.158386:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.158389:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.158398:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.164317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.164357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.164377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.164402:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307943168 00000100:00100000:0.0:1746147142.164410:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307943168 00000100:00100000:3.0:1746147142.164522:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307943296 00000100:00100000:3.0:1746147142.164527:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307943296 00000100:00100000:3.0:1746147142.164583:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307943808 00000100:00100000:3.0:1746147142.164586:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307943808 00000100:00100000:3.0:1746147142.164607:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3449 00000100:00100000:3.0:1746147142.164615:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307943296:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147142.164655:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.164671:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.164673:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.164679:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.164693:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.165198:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3450 00000100:00100000:2.0:1746147142.165207:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967307943808:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147142.165225:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.165232:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.165234:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.165237:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.165246:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.166126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.166150:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307943936 00000100:00100000:2.0:1746147142.166155:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307943936 00000100:00100000:2.0:1746147142.167334:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3451 00000100:00100000:2.0:1746147142.167345:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307943936:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147142.167385:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.167399:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.167400:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.167404:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.167417:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.167731:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3452 00000100:00100000:0.0:1746147142.167741:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2002:x1830967307943168:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147142.167762:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.167770:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.167772:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.167775:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.167785:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171437:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171462:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171470:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171477:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147142.171481:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171488:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171507:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.171512:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x3139939425055eac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.171837:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2003:x1830967307942400:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 20130us (20335us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746147142.171849:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3446 00010000:00010000:2.0:1746147142.178929:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.178954:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.178967:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.178973:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a20800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147142.178977:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.178983:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.179002:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.179007:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20800/0x3139939425055eba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.179299:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967307942912:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 20936us (21488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147142.179310:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3448 00010000:00010000:3.0:1746147142.187220:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.187240:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.187254:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.187261:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8ee00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147142.187265:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.187272:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.187298:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.187304:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x3139939425055eb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.187811:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307942656:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 29513us (30067us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147142.187822:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3447 00010000:00010000:2.0:1746147142.191235:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.191255:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.191263:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.191274:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c42a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147142.191277:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.191284:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.191303:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.191307:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425055ec8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.191402:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2002:x1830967307943808:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 26191us (27017us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147142.191414:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3450 00010000:00010000:3.0:1746147142.196377:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.196395:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.196402:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.196410:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147142.196414:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.196421:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.196439:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.196444:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05600/0x3139939425055ec1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.196533:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967307943296:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 31913us (32168us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147142.196543:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3449 00010000:00010000:2.0:1746147142.203160:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.203180:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.203189:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.203196:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099055a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147142.203200:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.203208:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.203231:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.203236:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425055ecf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.203382:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307943936:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 36034us (37254us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147142.203392:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3451 00010000:00010000:2.0:1746147142.205683:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.205701:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.205708:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.205716:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a21200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147142.205719:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.205726:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.205744:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.205750:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x3139939425055ed6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.205816:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307943168:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 38073us (41506us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147142.205827:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3452 00000100:00100000:0.0:1746147142.211735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.211860:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307944192 00000100:00100000:2.0:1746147142.211870:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307944192 00000100:00100000:2.0:1746147142.211982:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 804 00000100:00100000:2.0:1746147142.211992:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32258:x1830967307944192:12345-192.168.204.25@tcp:103:mirror_io.0 00010000:00010000:2.0:1746147142.212008:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.212036:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425055e27 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ae3 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.212054:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.212058:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.212120:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32258:x1830967307944192:12345-192.168.204.25@tcp:103:mirror_io.0 Request processed in 130us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.212127:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 804 00000100:00080000:1.0:1746147142.212280:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147142.215555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.215723:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307944448 00000100:00100000:3.0:1746147142.215734:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307944448 00000100:00100000:3.0:1746147142.215780:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5456 00000100:00100000:3.0:1746147142.215788:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32258:x1830967307944448:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147142.216308:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32258:x1830967307944448:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 512us (757us total) trans 8589935933 rc 0/0 00000100:00100000:3.0:1746147142.217273:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5456 00000100:00100000:0.0:1746147142.219244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.219861:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307944704 00000100:00100000:3.0:1746147142.219870:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307944704 00000100:00100000:3.0:1746147142.219910:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5457 00000100:00100000:3.0:1746147142.219916:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32258:x1830967307944704:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147142.221293:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32258:x1830967307944704:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 1372us (2049us total) trans 8589935934 rc 0/0 00000100:00100000:3.0:1746147142.221302:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5457 00000100:00100000:0.0:1746147142.243349:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.244011:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307944960 00000100:00100000:3.0:1746147142.244020:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307944960 00000100:00100000:3.0:1746147142.244118:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15254 00000100:00100000:3.0:1746147142.244127:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:32269:x1830967307944960:12345-192.168.204.25@tcp:101:multiop.0 00000100:00080000:1.0:1746147142.244127:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147142.244150:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.244167:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425055edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b29 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.244228:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244239:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244247:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244258:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244263:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244268:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244389:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244397:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244403:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147142.244411:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.244471:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244476:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244481:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244487:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.244490:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244496:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244506:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147142.244508:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.244511:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244515:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425055ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244541:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244545:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244550:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244554:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.244556:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244560:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244566:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1800) 00010000:00010000:3.0:1746147142.244568:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.244570:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244574:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425055eeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.244606:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425055edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.244615:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.244621:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.244623:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147142.244626:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56c00, rc 0) 00000100:00100000:3.0:1746147142.244669:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:32269:x1830967307944960:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 543us (1328us total) trans 8589935935 rc 0/0 00000100:00100000:3.0:1746147142.244675:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15254 00000100:00100000:0.0:1746147142.257790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.257872:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307945216 00000100:00100000:2.0:1746147142.257882:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307945216 00000100:00100000:2.0:1746147142.257965:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15255 00000100:00100000:2.0:1746147142.257974:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32272:x1830967307945216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.258003:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.258024:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425055f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b30 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.258133:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258146:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00080000:1.0:1746147142.258153:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147142.258590:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258606:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258613:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258619:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258724:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258733:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.258739:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147142.258747:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:0.0:1746147142.258765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.259045:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307945472 00000100:00100000:3.0:1746147142.259057:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307945472 00000100:00100000:3.0:1746147142.259138:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15256 00000100:00100000:3.0:1746147142.259146:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:32271:x1830967307945472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.259170:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.259187:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57600/0x3139939425055f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b37 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.259268:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x3139939425055f2a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.259280:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x3139939425055f2a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147142.259289:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x3139939425055f2a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147142.259298:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.259378:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57600/0x3139939425055f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b37 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.259415:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x3139939425055f2a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b37 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.259421:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.259424:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147142.259426:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56e00, rc 0) 00000100:00100000:3.0:1746147142.259477:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:32271:x1830967307945472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 332us (712us total) trans 8589935936 rc 0/0 00000100:00100000:3.0:1746147142.259550:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15256 00010000:00010000:2.0:1746147142.259802:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259813:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259819:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259824:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259829:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a1ec00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147142.259832:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259837:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259846:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147142.259849:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147142.259851:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259855:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1ec00/0x3139939425055f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259878:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259882:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259886:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259890:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a1fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147142.259892:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259896:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259901:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a300) 00010000:00010000:2.0:1746147142.259903:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147142.259904:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259908:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425055f0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147142.259940:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425055f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.259959:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.259963:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.259965:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147142.259967:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1f200, rc 0) 00000100:00100000:2.0:1746147142.260010:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32272:x1830967307945216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2038us (2231us total) trans 8589935937 rc 0/0 00000100:00100000:2.0:1746147142.260016:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15255 00000100:00100000:0.0:1746147142.262216:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.262263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.262335:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307945856 00000100:00100000:2.0:1746147142.262347:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307945856 00000100:00100000:3.0:1746147142.262397:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307945728 00000100:00100000:3.0:1746147142.262404:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307945728 00000100:00100000:2.0:1746147142.262405:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15257 00000100:00100000:2.0:1746147142.262413:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32266:x1830967307945856:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147142.262442:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147142.262458:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14503 00010000:00010000:2.0:1746147142.262460:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425055f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b45 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.262465:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307945728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.262480:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.262495:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b3e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.262513:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.262514:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.262521:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.262533:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.262541:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56000, rc 0) 00010000:00010000:2.0:1746147142.262560:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147142.262575:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307945728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 110us (365us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147142.262575:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.262579:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14503 00010000:00010000:2.0:1746147142.262583:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.262589:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.262595:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.262625:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.262636:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 29 pid: 7238 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.262647:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668288:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.262735:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.262743:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 10 pid: 16099 timeout: 780 lvb_type: 0 00000100:00080000:1.0:1746147142.262745:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147142.262751:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668416:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.262772:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.262779:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 9 pid: 16099 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.262785:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668544:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.262798:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.263627:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.263650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.264780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.264796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.264812:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307945984 00000100:00100000:0.0:1746147142.264816:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307945984 00000100:00100000:0.0:1746147142.264844:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946112 00000100:00100000:0.0:1746147142.264846:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946112 00000100:00100000:0.0:1746147142.264857:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946240 00000100:00100000:0.0:1746147142.264859:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946240 00000100:00100000:0.0:1746147142.264866:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946368 00000100:00100000:0.0:1746147142.264867:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946368 00000100:00100000:0.0:1746147142.264878:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14504 00000100:00100000:0.0:1746147142.264884:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967307945984:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.264895:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.264907:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b4c expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.264923:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.264925:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.264930:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 8 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.264941:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 8 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.264960:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99a00, rc 0) 00000100:00100000:0.0:1746147142.264989:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967307945984:12345-192.168.204.25@tcp:101:cat.0 Request processed in 106us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.264994:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14504 00000100:00100000:0.0:1746147142.265006:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14505 00000100:00100000:0.0:1746147142.265011:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307946112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.265018:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.265026:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b53 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.265036:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.265038:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.265042:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.265050:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.265056:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98200, rc 0) 00000100:00100000:0.0:1746147142.265071:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307946112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.265079:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14505 00000100:00100000:0.0:1746147142.265107:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14506 00000100:00100000:0.0:1746147142.265112:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967307946240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.265118:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.265123:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b5a expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.265132:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.265133:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.265137:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.265145:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.265151:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99c00, rc 0) 00000100:00100000:0.0:1746147142.265165:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307946240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.265170:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14506 00000100:00100000:0.0:1746147142.265179:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14507 00000100:00100000:0.0:1746147142.265183:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307946368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.265189:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.265195:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b61 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.265204:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.265205:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.265209:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.265217:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.265223:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98400, rc 0) 00000100:00100000:0.0:1746147142.265237:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307946368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.265241:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14507 00000100:00100000:0.0:1746147142.265274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.265293:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946496 00000100:00100000:0.0:1746147142.265296:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946496 00000100:00100000:0.0:1746147142.265310:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14508 00000100:00100000:0.0:1746147142.265315:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307946496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.265320:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1746147142.265383:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746147142.265387:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147142.265410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.265424:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946624 00000100:00100000:3.0:1746147142.265426:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946624 00000100:00100000:3.0:1746147142.265443:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14509 00000100:00100000:3.0:1746147142.265447:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307946624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.265453:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.265459:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b6f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.265469:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.265470:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.265474:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.265482:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.265488:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57400, rc 0) 00000100:00100000:3.0:1746147142.265504:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307946624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 57us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.265509:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14509 00000100:00100000:3.0:1746147142.265533:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.265546:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946752 00000100:00100000:3.0:1746147142.265548:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946752 00000100:00100000:3.0:1746147142.265563:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14510 00000100:00100000:3.0:1746147142.265567:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307946752:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.265573:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.265579:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b76 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.265592:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.265593:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.265597:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.265605:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.265612:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57200, rc 0) 00000100:00100000:3.0:1746147142.265627:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307946752:12345-192.168.204.25@tcp:101:cat.0 Request processed in 58us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.265631:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14510 00000100:00080000:3.0:1746147142.265642:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147142.265660:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.265670:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307946880 00000100:00100000:3.0:1746147142.265673:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307946880 00000100:00100000:3.0:1746147142.265684:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14511 00000100:00100000:3.0:1746147142.265688:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307946880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.265694:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.265698:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b7d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.265706:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.265707:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.265821:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.265836:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.265842:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56800, rc 0) 00000100:00100000:3.0:1746147142.266243:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307946880:12345-192.168.204.25@tcp:101:cat.0 Request processed in 552us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.266249:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14511 00000100:00100000:3.0:1746147142.266278:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.266288:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947008 00000100:00100000:3.0:1746147142.266290:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947008 00000100:00100000:3.0:1746147142.266303:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14512 00000100:00100000:3.0:1746147142.266307:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967307947008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.266313:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.266319:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b84 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.266328:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.266330:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.266333:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.266342:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.266349:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56200, rc 0) 00000100:00100000:3.0:1746147142.266363:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307947008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 56us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.266368:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14512 00000100:00100000:3.0:1746147142.266394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.266402:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947136 00000100:00100000:3.0:1746147142.266405:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947136 00000100:00100000:3.0:1746147142.266416:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14513 00000100:00100000:3.0:1746147142.266419:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967307947136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.266425:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.266742:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b68 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.266764:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.266766:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.266770:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 29 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.266779:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 29 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.266790:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99000, rc 0) 00000100:00100000:0.0:1746147142.266803:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307946496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1488us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.266808:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14508 00000100:00100000:0.0:1746147142.266872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147142.267300:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b8b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.267312:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.267313:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.267317:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.267326:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.267332:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:3.0:1746147142.267345:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307947136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 925us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.267350:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14513 00000100:00100000:0.0:1746147142.269376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.269395:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947520 00000100:00100000:0.0:1746147142.269399:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947520 00010000:00010000:0.0:1746147142.269425:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 11 pid: 16099 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.269446:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6342 00000100:00100000:0.0:1746147142.269462:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307947520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147142.269495:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668288:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.269503:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668416:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.269510:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668544:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.269530:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270535:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.270544:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 11 pid: 16099 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270554:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 11 pid: 16099 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270572:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56c00/0x3139939425055ef2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b29 expref: 11 pid: 16099 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270589:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.270592:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270603:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270608:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147142.270636:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967307947520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1174us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.270642:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6342 00000100:00100000:3.0:1746147142.270682:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947264 00000100:00100000:3.0:1746147142.270687:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947264 00000100:00100000:0.0:1746147142.270689:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.270700:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947392 00000100:00100000:0.0:1746147142.270703:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947392 00000100:00100000:3.0:1746147142.270711:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14514 00010000:00010000:0.0:1746147142.270712:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 30 pid: 7238 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.270717:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307947264:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147142.270724:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6343 00000100:00100000:0.0:1746147142.270727:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307947392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.270730:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.270733:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.270736:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 30 pid: 7238 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.270742:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b92 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.270743:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 30 pid: 7238 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270753:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x3139939425055f15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b30 expref: 30 pid: 7238 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.270757:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.270758:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.270760:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.270763:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.270764:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.270768:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270772:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147142.270776:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147142.270782:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307947392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (93us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147142.270783:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57600, rc 0) 00000100:00100000:0.0:1746147142.270786:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6343 00000100:00100000:3.0:1746147142.270802:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307947264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 85us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.270807:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14514 00000100:00100000:0.0:1746147142.270825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.270835:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947648 00000100:00100000:0.0:1746147142.270837:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947648 00010000:00010000:0.0:1746147142.270845:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 10 pid: 16099 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.270864:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6344 00000100:00100000:0.0:1746147142.270868:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307947648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.270874:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.270877:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 10 pid: 16099 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270883:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 10 pid: 16099 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270891:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04a00/0x3139939425055e7b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af8 expref: 10 pid: 16099 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.270898:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.270901:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270906:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270911:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.270924:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147142.270934:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147142.270939:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307947648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 70us (113us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147142.270940:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147142.270955:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6344 00000004:00200000:3.0:1746147142.270968:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.271075:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425055f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.271102:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.271112:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.271115:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147142.271116:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e000, rc 0) 00000100:00100000:3.0:1746147142.271136:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32266:x1830967307945856:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8724us (8873us total) trans 8589935938 rc 0/0 00000100:00100000:3.0:1746147142.271142:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15257 00000100:00100000:0.0:1746147142.271535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.271599:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307947904 00000100:00100000:3.0:1746147142.271603:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307947904 00000100:00100000:3.0:1746147142.272900:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15258 00000100:00100000:3.0:1746147142.272909:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:32269:x1830967307947904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.272926:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.272928:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147142.272953:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56e00/0x3139939425055f2a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b37 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.272963:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.272966:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147142.272973:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425055fa1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77b99 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.273004:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.273012:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.273017:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.273038:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.273047:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 8 pid: 7238 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.273056:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668672:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.276529:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.276820:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.276862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.276917:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948032 00000100:00100000:2.0:1746147142.276924:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948032 00000100:00100000:2.0:1746147142.276968:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948160 00000100:00100000:2.0:1746147142.276971:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948160 00000100:00100000:2.0:1746147142.276993:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15259 00000100:00100000:2.0:1746147142.276999:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:32271:x1830967307948032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.277017:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.277033:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ba0 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.277079:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.277085:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 12 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.277120:0:7239:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.277130:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 12 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.277139:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.277142:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147142.277144:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.277150:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90200, rc 0) 00000100:00100000:2.0:1746147142.277185:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:32271:x1830967307948032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 187us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.277190:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15259 00000100:00100000:2.0:1746147142.277204:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15260 00000100:00100000:2.0:1746147142.277208:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32272:x1830967307948160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.277218:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.277225:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ba7 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.277243:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.277250:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.277255:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.277257:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147142.277259:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.277263:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91400, rc 0) 00000100:00100000:2.0:1746147142.277280:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32272:x1830967307948160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 70us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.277284:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15260 00000100:00100000:3.0:1746147142.281343:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310668672:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.281365:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147142.281457:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.281939:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948288 00000100:00100000:2.0:1746147142.281954:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948288 00010000:00010000:2.0:1746147142.281984:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 9 pid: 7238 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.282589:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6345 00000100:00100000:2.0:1746147142.282597:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967307948288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.282609:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.282616:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 9 pid: 7238 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.282627:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 9 pid: 7238 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.282647:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31800/0x3139939425055e6d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77af1 expref: 9 pid: 7238 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.282676:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.282681:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.282689:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.282694:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.282701:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.282721:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147142.282726:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.282732:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147142.282766:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967307948288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 169us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.282772:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6345 00000040:00080000:3.0:1746147142.283161:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].578, 88 off58928 00000004:00080000:3.0:1746147142.283168:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273078329ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283503:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].516, 88 off53464 00000004:00080000:3.0:1746147142.283510:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273420298ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283528:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].517, 88 off53552 00000004:00080000:3.0:1746147142.283531:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273442036ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283540:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].579, 88 off59016 00000004:00080000:3.0:1746147142.283542:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273452806ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283548:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].580, 88 off59104 00000004:00080000:3.0:1746147142.283550:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273460903ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283558:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].518, 88 off53640 00000004:00080000:3.0:1746147142.283560:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273470386ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283567:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].519, 88 off53728 00000004:00080000:3.0:1746147142.283569:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273479629ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283575:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].520, 88 off53816 00000004:00080000:3.0:1746147142.283578:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273488428ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283585:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].581, 88 off59192 00000004:00080000:3.0:1746147142.283587:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273497621ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283594:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].521, 88 off53904 00000004:00080000:3.0:1746147142.283596:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273506946ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283602:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].582, 88 off59280 00000004:00080000:3.0:1746147142.283604:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273514811ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283611:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].522, 88 off53992 00000004:00080000:3.0:1746147142.283613:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273523246ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147142.283620:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].583, 88 off59368 00000004:00080000:3.0:1746147142.283622:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273532666ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283628:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].584, 88 off59456 00000004:00080000:3.0:1746147142.283630:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273540271ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283636:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].585, 88 off59544 00000004:00080000:3.0:1746147142.283638:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273548686ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283644:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].586, 88 off59632 00000004:00080000:3.0:1746147142.283646:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680273556471ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147142.283659:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].523, 88 off54080 00000004:00080000:3.0:1746147142.283661:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680273571953ns, next at 554081490131ns, rc = 0 00000001:00080000:2.0:1746147142.285370:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935939 is committed 00000004:00080000:2.0:1746147142.285379:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 518 committed 00000004:00080000:2.0:1746147142.285387:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 578 committed 00000004:00080000:2.0:1746147142.285516:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 577 committed 00000004:00080000:2.0:1746147142.285518:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 576 committed 00000004:00080000:2.0:1746147142.285520:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 575 committed 00000004:00080000:2.0:1746147142.285521:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 517 committed 00000004:00080000:2.0:1746147142.285523:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 574 committed 00000004:00080000:2.0:1746147142.285524:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 516 committed 00000004:00080000:2.0:1746147142.285526:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 573 committed 00000004:00080000:2.0:1746147142.285527:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 515 committed 00000004:00080000:2.0:1746147142.285528:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 514 committed 00000004:00080000:2.0:1746147142.285531:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 513 committed 00000004:00080000:2.0:1746147142.285533:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 572 committed 00000004:00080000:2.0:1746147142.285534:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 571 committed 00000100:00100000:3.0:1746147142.285535:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310668800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147142.285536:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 512 committed 00000004:00080000:2.0:1746147142.285537:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 511 committed 00000004:00080000:2.0:1746147142.285539:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 570 committed 00000001:00080000:2.0:1746147142.285544:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935938 is committed 00000001:00080000:2.0:1746147142.285551:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935934 is committed 00000100:00100000:3.0:1746147142.285585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147142.285661:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.285671:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.285674:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147142.285678:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.285687:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.285688:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310668800 00000100:00100000:0.0:1746147142.285689:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013486bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310669056:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147142.285693:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.285694:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310668800 00010000:00010000:3.0:1746147142.285700:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.285706:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.285711:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.285723:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14515 00000100:00100000:3.0:1746147142.285724:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147142.285730:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310668800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147142.285737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147142.285766:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147142.285779:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310669568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147142.285791:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147142.285799:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147142.285810:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147142.285814:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310670080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147142.285825:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147142.285829:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147142.285846:0:6215:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147142.285847:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147142.285850:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.285853:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.285854:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147140 -> 1746147140 00000100:00100000:3.0:1746147142.285857:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310670848:192.168.204.25@tcp:105: 00002000:00010000:1.0:1746147142.285857:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147142.285903:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310668928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147142.285908:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147142.286602:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310668800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 871us (1016us total) trans 21474841467 rc 0/0 00000100:00100000:1.0:1746147142.286608:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14515 00000100:00100000:1.0:1746147142.286621:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669056 00000100:00100000:1.0:1746147142.286624:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669056 00000100:00100000:1.0:1746147142.286637:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669312 00000100:00100000:1.0:1746147142.286639:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669312 00000004:00080000:3.0:1746147142.286640:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134869c00/2, rc 0, transno 21474841467 00000100:00100000:3.0:1746147142.286646:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310668800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147142.286651:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669568 00000100:00100000:3.0:1746147142.286653:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147142.286653:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669568 00000100:00100000:3.0:1746147142.286658:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013486b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147142.286661:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669824 00000100:00100000:1.0:1746147142.286662:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669824 00000100:00100000:1.0:1746147142.286668:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670080 00000100:00100000:1.0:1746147142.286669:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670080 00000100:00100000:3.0:1746147142.286675:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147142.286675:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670336 00000100:00100000:1.0:1746147142.286677:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670336 00000100:00100000:1.0:1746147142.286682:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669184 00000100:00100000:3.0:1746147142.286683:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147142.286684:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669184 00000100:00100000:1.0:1746147142.286691:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14516 00000100:00100000:3.0:1746147142.286694:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147142.286696:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967310669056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147142.286701:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147142.286710:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147142.286716:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147142.286727:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147142.286742:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669696 00002000:00010000:1.0:1746147142.286743:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746147142.286744:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669696 00002000:00010000:1.0:1746147142.286746:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.286747:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.286749:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.286750:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147142.286757:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670208 00000100:00100000:2.0:1746147142.286758:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147142.286759:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670208 00000100:00100000:3.0:1746147142.286766:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670720 00000100:00100000:3.0:1746147142.286768:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670720 00000100:00100000:1.0:1746147142.286768:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3765:x1830967310669056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1032us total) trans 21474841468 rc 0/0 00000100:00100000:3.0:1746147142.286773:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310668928 00000100:00100000:1.0:1746147142.286773:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14516 00000100:00100000:3.0:1746147142.286774:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310668928 00000100:00100000:2.0:1746147142.286774:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013486a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310669440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147142.286783:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14517 00000100:00100000:3.0:1746147142.286788:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3767:x1830967310669312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147142.286788:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147142.286796:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310669952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147142.286808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147142.286808:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310670592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.286813:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310670464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147142.286823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147142.286830:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669440 00000100:00100000:2.0:1746147142.286832:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669440 00000004:00080000:0.0:1746147142.286843:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013486bb80/2, rc 0, transno 21474841468 00002000:00010000:3.0:1746147142.286844:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147142.286846:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147140 -> 1746147140 00000100:00100000:0.0:1746147142.286846:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013486bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310669056:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147142.286849:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147140 -> 1746147140 00002000:00010000:3.0:1746147142.286850:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147140 -> 1746147140 00002000:00010000:3.0:1746147142.286852:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147142.286865:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310669952 00000100:00100000:0.0:1746147142.286867:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310669952 00000100:00100000:3.0:1746147142.286876:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310669312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1109us total) trans 17179874201 rc 0/0 00000100:00100000:1.0:1746147142.287024:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14518 00000100:00100000:1.0:1746147142.287030:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310669568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147142.287031:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670592 00000100:00100000:2.0:1746147142.287033:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670592 00000100:00100000:2.0:1746147142.287042:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14519 00000100:00100000:2.0:1746147142.287046:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967310669824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147142.287070:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147142.287072:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.287074:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.287076:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.287077:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:2.0:1746147142.287111:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310669824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1300us total) trans 21474841469 rc 0/0 00000100:00100000:1.0:1746147142.287111:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967310669568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1312us total) trans 17179874202 rc 0/0 00000100:00100000:1.0:1746147142.287116:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14518 00000100:00100000:2.0:1746147142.287118:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14519 00000100:00100000:1.0:1746147142.287125:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14520 00000100:00100000:2.0:1746147142.287127:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14521 00000100:00100000:1.0:1746147142.287129:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967310670080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.287130:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967310670336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147142.287167:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14522 00000100:00100000:1.0:1746147142.287172:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310669184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.287179:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310670336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (1272us total) trans 21474841470 rc 0/0 00000100:00100000:2.0:1746147142.287184:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14521 00000100:00100000:2.0:1746147142.287193:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14523 00000100:00100000:2.0:1746147142.287196:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310669696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147142.287247:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310669696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (551us total) trans 17179874203 rc 0/0 00000100:00100000:2.0:1746147142.287252:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14523 00000100:00100000:2.0:1746147142.287261:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14524 00000100:00100000:2.0:1746147142.287265:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310670208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147142.287309:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310670208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (596us total) trans 17179874204 rc 0/0 00000100:00100000:2.0:1746147142.287313:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14524 00000100:00100000:2.0:1746147142.287320:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14525 00000100:00100000:2.0:1746147142.287323:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310670720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147142.287351:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:2.0:1746147142.287353:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.287355:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.287356:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.287358:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:2.0:1746147142.287370:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310670720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (642us total) trans 17179874205 rc 0/0 00000100:00100000:2.0:1746147142.287374:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14525 00000100:00100000:2.0:1746147142.287381:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14526 00000100:00100000:2.0:1746147142.287385:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310668928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147142.287395:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14517 00002000:00010000:2.0:1746147142.287418:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147142.287420:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147139 -> 1746147139 00000100:00100000:0.0:1746147142.287420:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14527 00002000:00010000:2.0:1746147142.287422:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147140 -> 1746147140 00000100:00100000:3.0:1746147142.287423:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14528 00002000:00010000:2.0:1746147142.287423:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147139 -> 1746147139 00002000:00010000:2.0:1746147142.287425:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147142.287425:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310669440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147142.287429:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310670592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.287441:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310668928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (688us total) trans 17179874206 rc 0/0 00000100:00100000:2.0:1746147142.287446:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14526 00000100:00100000:2.0:1746147142.287455:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14529 00000100:00100000:2.0:1746147142.287459:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310669952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147142.287466:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147142.287468:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147142.287469:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147142.287470:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147142.287472:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00002000:00010000:2.0:1746147142.287489:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00000100:00100000:3.0:1746147142.287491:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3765:x1830967310670592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (666us total) trans 21474841473 rc 0/0 00002000:00010000:2.0:1746147142.287491:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00000100:00100000:0.0:1746147142.287491:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967310669440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (702us total) trans 21474841472 rc 0/0 00002000:00010000:2.0:1746147142.287492:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.287494:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.287495:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147142.287496:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14527 00000100:00100000:3.0:1746147142.287499:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14528 00000100:00100000:2.0:1746147142.287509:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310669952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (700us total) trans 17179874207 rc 0/0 00000100:00100000:2.0:1746147142.287512:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14529 00000004:00080000:3.0:1746147142.287522:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095237800/2, rc 0, transno 17179874203 00000100:00100000:2.0:1746147142.287524:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147142.287524:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095234700/2, rc 0, transno 17179874202 00000100:00100000:3.0:1746147142.287529:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147142.287536:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095235f80/2, rc 0, transno 17179874204 00000004:00080000:2.0:1746147142.287544:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095236300/2, rc 0, transno 17179874206 00000100:00100000:3.0:1746147142.287669:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147142.287672:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310668928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147142.287679:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524e00/2, rc 0, transno 17179874205 00000100:00100000:3.0:1746147142.287682:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147142.287685:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013486a680/2, rc 0, transno 21474841472 00000100:00100000:2.0:1746147142.287688:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013486a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310669440:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147142.287689:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095235500/2, rc 0, transno 17179874201 00000100:00100000:3.0:1746147142.287691:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147142.287695:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095236a00/2, rc 0, transno 17179874207 00000100:00100000:2.0:1746147142.287697:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310669952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147142.287698:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098859f80/2, rc 0, transno 21474841469 00000100:00100000:3.0:1746147142.287701:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669824:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147142.287701:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147142.287703:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.287705:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147140 -> 1746147140 00002000:00010000:1.0:1746147142.287706:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147140 -> 1746147140 00000004:00080000:3.0:1746147142.287707:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098859c00/2, rc 0, transno 21474841470 00002000:00010000:1.0:1746147142.287708:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147142.287709:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.287709:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670464 00000100:00100000:2.0:1746147142.287711:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670464 00000100:00100000:2.0:1746147142.287726:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14530 00000100:00100000:1.0:1746147142.287727:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310669184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 556us (1051us total) trans 21474841474 rc 0/0 00000100:00100000:2.0:1746147142.287730:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310670464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147142.287732:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14522 00000100:00100000:3.0:1746147142.287745:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670976:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147142.287760:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147142.287762:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147142.287763:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.287764:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147142.287765:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.287766:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147142.287766:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:3.0:1746147142.287767:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147142.287768:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147142.287769:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147142.287771:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147142.287785:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310670080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 656us (1954us total) trans 21474841471 rc 0/0 00000100:00100000:2.0:1746147142.287787:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967310670464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (262us total) trans 17179874208 rc 0/0 00000004:00080000:3.0:1746147142.287788:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013486b480/2, rc 0, transno 21474841474 00000100:00100000:1.0:1746147142.287789:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14520 00000100:00100000:3.0:1746147142.287791:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013486b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310669184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.287792:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14530 00000100:00100000:2.0:1746147142.287800:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310670976 00000100:00100000:2.0:1746147142.287802:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310670976 00000100:00100000:2.0:1746147142.287812:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14531 00000100:00100000:2.0:1746147142.287815:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967310670976:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147142.287823:0:6215:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.287832:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310671104:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147142.287848:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310669568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147142.287860:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009885b480/2, rc 0, transno 21474841471 00000100:00100000:3.0:1746147142.287861:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.287862:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310670080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147142.287868:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009885aa00/2, rc 0, transno 21474841473 00000100:00100000:0.0:1746147142.287871:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310670592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147142.287876:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3767:x1830967310670976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (108us total) trans 17179874209 rc 0/0 00000100:00100000:2.0:1746147142.287881:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14531 00000004:00080000:3.0:1746147142.287882:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156a00/2, rc 0, transno 17179874209 00000100:00100000:3.0:1746147142.287884:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310670976:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147142.287897:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095236d80/2, rc 0, transno 17179874208 00000100:00100000:2.0:1746147142.287900:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310670464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147142.291571:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310671104:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147142.292276:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310670848:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147142.292313:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05200/0x3139939425055fa1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 10 pid: 6215 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147142.292338:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.292475:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.292514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147142.292923:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04e00, rc 0) 00000100:00100000:3.0:1746147142.292977:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:32269:x1830967307947904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 20068us (21441us total) trans 8589935939 rc 0/0 00000100:00100000:3.0:1746147142.292984:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15258 00000100:00100000:0.0:1746147142.293206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.293277:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948416 00000100:00100000:1.0:1746147142.293284:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948416 00000100:00100000:1.0:1746147142.293311:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948544 00000100:00100000:1.0:1746147142.293313:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948544 00000100:00100000:1.0:1746147142.293325:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5458 00000100:00100000:1.0:1746147142.293331:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32272:x1830967307948416:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147142.293365:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5459 00000100:00100000:0.0:1746147142.293371:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32271:x1830967307948544:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:1.0:1746147142.293396:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32272:x1830967307948416:12345-192.168.204.25@tcp:49:cat.0 Request processed in 65us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.293402:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5458 00000100:00100000:3.0:1746147142.293594:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948672 00000100:00100000:3.0:1746147142.293598:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948672 00000100:00100000:3.0:1746147142.293624:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15261 00000100:00100000:3.0:1746147142.293629:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32266:x1830967307948672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.293638:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.293652:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425055fbd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bae expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.293681:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425055fbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bae expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.293697:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425055fbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bae expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.293708:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.293711:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147142.294901:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32271:x1830967307948544:12345-192.168.204.25@tcp:49:cat.0 Request processed in 1527us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.294908:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5459 00010000:00010000:3.0:1746147142.295006:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ba00, rc 0) 00000100:00100000:3.0:1746147142.295029:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32266:x1830967307948672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1399us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.295034:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15261 00000100:00100000:0.0:1746147142.296173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.296719:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948800 00000100:00100000:2.0:1746147142.296725:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948800 00000100:00100000:2.0:1746147142.296755:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5460 00000100:00100000:2.0:1746147142.296760:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32269:x1830967307948800:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:1.0:1746147142.297038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.297141:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.297223:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949056 00000100:00100000:3.0:1746147142.297227:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949056 00000100:00100000:2.0:1746147142.297445:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32269:x1830967307948800:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 86us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.297457:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5460 00000100:00100000:2.0:1746147142.297476:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307948928 00000100:00100000:2.0:1746147142.297479:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307948928 00000100:00100000:2.0:1746147142.297501:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 805 00000100:00100000:2.0:1746147142.297506:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307948928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.297514:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.297531:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425055fbd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bae expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.297547:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.297550:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.297589:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14532 00000100:00100000:3.0:1746147142.297595:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32266:x1830967307949056:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.297604:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.297616:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bb5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.297637:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.297649:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.297656:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 30 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.297661:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.297663:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.297666:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2764800->2945023] (req 2764800->2945023) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.297689:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 30 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.297700:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 30 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.297711:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310671232:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.298007:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307948928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 499us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.298013:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 805 00010000:00010000:3.0:1746147142.298400:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.298409:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 9 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.298418:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310671360:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.298450:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.298458:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 11 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.298466:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310671488:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.298482:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.300230:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.300273:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.300339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.300531:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949312 00000100:00100000:2.0:1746147142.300537:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949312 00010000:00010000:2.0:1746147142.300562:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 31 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.300581:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949440 00000100:00100000:2.0:1746147142.300583:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949440 00010000:00010000:2.0:1746147142.300592:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 10 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.300605:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6346 00000100:00100000:2.0:1746147142.300611:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307949312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.300622:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.300638:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 31 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.300647:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 31 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.300666:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.300695:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307949312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.300700:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6346 00000100:00100000:2.0:1746147142.300711:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6347 00000100:00100000:2.0:1746147142.300716:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307949440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.300722:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.300728:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 10 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.300737:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 10 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.300746:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.300759:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307949440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.300764:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6347 00000100:00100000:1.0:1746147142.300833:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949184 00000100:00100000:1.0:1746147142.300837:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949184 00000100:00100000:1.0:1746147142.300856:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14533 00000100:00100000:1.0:1746147142.300861:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:32269:x1830967307949184:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147142.300872:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.300883:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bbc expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.300899:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.300905:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.300911:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.300916:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.300917:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.300920:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1351680->1712127] (req 1351680->1712127) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.300941:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.300958:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 27 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.300967:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310671616:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.301019:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.301030:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 13 pid: 9584 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.301037:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310671744:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.301060:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.301067:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 10 pid: 1853 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.301074:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310671872:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.301106:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147142.301181:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x3139939425055f85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b68 expref: 30 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.301194:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310671232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.301203:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x3139939425055f8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b8b expref: 9 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.301209:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310671360:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.301216:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310671488:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.301234:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2764800->2945023] (req 2764800->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.301241:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ae00, rc 0) 00000100:00100000:3.0:1746147142.301259:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32266:x1830967307949056:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3664us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.301263:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14532 00000100:00100000:0.0:1746147142.301825:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.302457:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949568 00000100:00100000:3.0:1746147142.302462:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949568 00010000:00010000:3.0:1746147142.302479:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 12 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.302498:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6348 00000100:00100000:3.0:1746147142.302503:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967307949568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.302511:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.302521:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 12 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.302529:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 12 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.302542:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425055e9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b1b expref: 12 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.302550:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.302552:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.302556:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.302562:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.302580:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.302593:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310672000:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147142.302630:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.305979:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310671616:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.305990:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310671744:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.305997:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310671872:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.306026:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1351680->1712127] (req 1351680->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.306041:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c400, rc 0) 00000100:00100000:0.0:1746147142.307302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.307344:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.307361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.307374:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.307388:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.307448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.307468:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949824 00000100:00100000:0.0:1746147142.307474:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949824 00002000:00100000:0.0:1746147142.307511:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098820a80 x1830967307949824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.307519:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820a80 with x1830967307949824 ext(0->1048575) 00002000:00010000:0.0:1746147142.307524:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820a80 00000100:00100000:0.0:1746147142.307539:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307950336 00000100:00100000:0.0:1746147142.307541:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307950336 00002000:00100000:0.0:1746147142.307551:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2764800->2768895) req@ffff880098821880 x1830967307950336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.307557:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821880 with x1830967307950336 ext(2764800->2768895) 00002000:00010000:0.0:1746147142.307561:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821880 00000100:00100000:0.0:1746147142.307569:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307950464 00000100:00100000:0.0:1746147142.307571:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307950464 00002000:00100000:0.0:1746147142.307582:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098822d80 x1830967307950464/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.307587:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822d80 with x1830967307950464 ext(1048576->2097151) 00010000:00010000:0.0:1746147142.307593:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 28 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.307604:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 28 pid: 1398 timeout: 780 lvb_type: 1 00002000:00010000:0.0:1746147142.307610:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098822d80 00000100:00100000:0.0:1746147142.307626:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307950720 00000100:00100000:0.0:1746147142.307627:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307950720 00002000:00100000:0.0:1746147142.307636:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098822680 x1830967307950720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.307642:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822680 with x1830967307950720 ext(1048576->2097151) 00002000:00010000:0.0:1746147142.307644:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098822680 00000100:00100000:0.0:1746147142.307650:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307950976 00000100:00100000:0.0:1746147142.307651:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307950976 00002000:00100000:0.0:1746147142.307659:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880098823800 x1830967307950976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.307664:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823800 with x1830967307950976 ext(1048576->2097151) 00002000:00010000:0.0:1746147142.307666:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098823800 00000100:00100000:0.0:1746147142.307674:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1092 00000100:00100000:0.0:1746147142.307679:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307950464:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.308286:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3453 00000100:00100000:0.0:1746147142.308292:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307949824:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.309683:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.309704:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307951360 00000100:00100000:0.0:1746147142.309709:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307951360 00002000:00100000:0.0:1746147142.309733:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098822300 x1830967307951360/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.309742:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822300 with x1830967307951360 ext(0->1048575) 00002000:00010000:0.0:1746147142.309746:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822300 00000100:00100000:0.0:1746147142.309756:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3454 00000100:00100000:0.0:1746147142.309762:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307950336:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.309824:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307950336:12345-192.168.204.25@tcp:3:cat.0 Request processed in 62us (2461us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147142.309829:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3454 00002000:00100000:0.0:1746147142.309833:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (2764800->2768895) req@ffff880098821880 x1830967307950336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.309840:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821880 with x1830967307950336 ext(2764800->2768895) 00002000:00010000:0.0:1746147142.309843:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821880 00000100:00100000:0.0:1746147142.309853:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3455 00000100:00100000:0.0:1746147142.309857:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307950720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.310382:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.310392:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.310408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.311006:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307951488 00000100:00100000:1.0:1746147142.311011:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307951488 00002000:00100000:1.0:1746147142.311032:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880098821c00 x1830967307951488/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.311044:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821c00 with x1830967307951488 ext(1048576->2097151) 00002000:00010000:1.0:1746147142.311047:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821c00 00000100:00100000:1.0:1746147142.311054:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307951872 00000100:00100000:1.0:1746147142.311056:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307951872 00002000:00100000:1.0:1746147142.311066:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098821f80 x1830967307951872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.311072:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821f80 with x1830967307951872 ext(1048576->2097151) 00002000:00010000:1.0:1746147142.311074:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821f80 00000100:00100000:1.0:1746147142.311080:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307951744 00000100:00100000:1.0:1746147142.311081:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307951744 00002000:00100000:1.0:1746147142.311103:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098823480 x1830967307951744/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.311109:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823480 with x1830967307951744 ext(1048576->2097151) 00010000:00010000:1.0:1746147142.311115:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.311124:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00002000:00010000:1.0:1746147142.311130:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098823480 00000100:00100000:1.0:1746147142.311139:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1093 00000100:00100000:1.0:1746147142.311145:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307951744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147142.311644:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3456 00000100:00100000:1.0:1746147142.311650:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307950976:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.312192:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3457 00000100:00100000:3.0:1746147142.312205:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307951360:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147142.312251:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:32269:x1830967307949184:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11388us (12021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.312258:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14533 00000100:00100000:2.0:1746147142.312340:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3458 00000100:00100000:2.0:1746147142.312348:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307951488:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.312696:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3459 00000100:00100000:2.0:1746147142.312701:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307951872:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.312731:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310672000:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147142.312745:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.312759:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307949568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10256us (10934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.312766:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6348 00000100:00100000:3.0:1746147142.312781:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307949952 00000100:00100000:3.0:1746147142.312785:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307949952 00010000:00010000:3.0:1746147142.312798:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 11 pid: 1853 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.312816:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6349 00000100:00100000:3.0:1746147142.312821:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307949952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.312829:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.312840:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 11 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.312850:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 11 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.312868:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425055e89 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b06 expref: 11 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.312897:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.312909:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307949952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (5565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.312914:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6349 00000100:00100000:0.0:1746147142.316768:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307950464:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9079us (9383us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147142.316777:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1092 00002000:00100000:0.0:1746147142.316787:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098822d80 x1830967307950464/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.316800:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822d80 with x1830967307950464 ext(1048576->2097151) 00010000:00010000:0.0:1746147142.316808:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 30 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.316818:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 30 pid: 1398 timeout: 780 lvb_type: 1 00002000:00010000:0.0:1746147142.316824:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098822d80 00000100:00100000:2.0:1746147142.325333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.325406:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307952128 00000100:00100000:3.0:1746147142.325414:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307952128 00010000:00010000:3.0:1746147142.325446:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 30 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.325478:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6350 00000100:00100000:3.0:1746147142.325484:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307952128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.325496:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.325511:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 30 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.325521:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 30 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.325539:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425055f54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b53 expref: 30 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.325557:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.325610:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307952128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.325616:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6350 00000100:00100000:0.0:1746147142.325755:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307949824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17462us (18458us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147142.325764:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3453 00002000:00100000:0.0:1746147142.325771:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098820a80 x1830967307949824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.325779:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820a80 with x1830967307949824 ext(0->1048575) 00002000:00010000:0.0:1746147142.325783:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820a80 00000100:00100000:2.0:1746147142.330382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.330448:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307952384 00000100:00100000:1.0:1746147142.330455:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307952384 00002000:00100000:1.0:1746147142.330488:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2940928->2945023) req@ffff880094528000 x1830967307952384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.330497:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528000 with x1830967307952384 ext(2940928->2945023) 00002000:00010000:1.0:1746147142.330501:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094528000 00000100:00100000:1.0:1746147142.330527:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3460 00000100:00100000:1.0:1746147142.330534:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307952384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147142.330648:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307952384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 113us (272us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147142.330654:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3460 00002000:00100000:1.0:1746147142.330659:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2940928->2945023) req@ffff880094528000 x1830967307952384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.330665:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528000 with x1830967307952384 ext(2940928->2945023) 00002000:00010000:1.0:1746147142.330668:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094528000 00000100:00100000:1.0:1746147142.333650:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307950720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23784us (26253us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147142.333660:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3455 00002000:00100000:1.0:1746147142.333669:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098822680 x1830967307950720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.333683:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822680 with x1830967307950720 ext(1048576->2097151) 00002000:00010000:1.0:1746147142.333687:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098822680 00000100:00100000:0.0:1746147142.337129:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.337254:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307952512 00000100:00100000:1.0:1746147142.337265:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307952512 00000100:00100000:1.0:1746147142.337327:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14534 00000100:00100000:1.0:1746147142.337337:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32272:x1830967307952512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.337358:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.337384:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bc3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.337411:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.337419:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1351680->1712127] (req 1351680->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 16 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.337425:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147142.337429:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.337467:0:9585:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1351680->1712127] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 16 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.337482:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.337492:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd600, rc 0) 00000100:00100000:1.0:1746147142.337550:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32272:x1830967307952512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 213us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.337558:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14534 00000100:00100000:1.0:1746147142.339022:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307951744:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27873us (28609us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147142.339031:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1093 00002000:00100000:1.0:1746147142.339039:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098823480 x1830967307951744/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.339048:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823480 with x1830967307951744 ext(1048576->2097151) 00010000:00010000:1.0:1746147142.339056:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.339068:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00002000:00010000:1.0:1746147142.339074:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098823480 00000100:00100000:0.0:1746147142.350045:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.350148:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307952640 00000100:00100000:3.0:1746147142.350159:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307952640 00010000:00010000:3.0:1746147142.350201:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.350237:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6351 00000100:00100000:3.0:1746147142.350246:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307952640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.350265:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.350286:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.350570:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307950976:12345-192.168.204.25@tcp:3:cat.0 Request processed in 38918us (43119us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147142.350579:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3456 00002000:00100000:1.0:1746147142.350589:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880098823800 x1830967307950976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.350598:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823800 with x1830967307950976 ext(1048576->2097151) 00000100:00100000:2.0:1746147142.350601:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307951488:12345-192.168.204.25@tcp:3:cat.0 Request processed in 38253us (40218us total) trans 0 rc 1048576/1048576 00002000:00010000:1.0:1746147142.350603:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098823800 00000100:00100000:2.0:1746147142.350606:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3458 00002000:00100000:2.0:1746147142.350611:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880098821c00 x1830967307951488/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.350617:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821c00 with x1830967307951488 ext(1048576->2097151) 00002000:00010000:2.0:1746147142.350620:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821c00 00010000:00010000:3.0:1746147142.350684:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.350710:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425055f70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b76 expref: 15 pid: 9584 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.350784:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.350786:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.350794:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.350802:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.350840:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.350857:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.350869:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310672256:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147142.350936:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.354802:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310672256:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.354827:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.354873:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307952640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4626us (4836us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.354884:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6351 00000100:00100000:3.0:1746147142.354995:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967307951360:12345-192.168.204.25@tcp:3:cat.0 Request processed in 42794us (45312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147142.355004:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3457 00002000:00100000:3.0:1746147142.355015:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098822300 x1830967307951360/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.355025:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822300 with x1830967307951360 ext(0->1048575) 00002000:00010000:3.0:1746147142.355031:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822300 00000100:00100000:0.0:1746147142.357041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.357128:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307952896 00000100:00100000:3.0:1746147142.357137:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307952896 00002000:00100000:3.0:1746147142.357178:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1351680->1355775) req@ffff880098821180 x1830967307952896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.357188:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821180 with x1830967307952896 ext(1351680->1355775) 00010000:00010000:3.0:1746147142.357198:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.357234:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:3.0:1746147142.357241:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098821180 00000100:00100000:3.0:1746147142.357280:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1094 00000100:00100000:3.0:1746147142.357288:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307952896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.357547:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307952896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 258us (515us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147142.357554:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1094 00002000:00100000:3.0:1746147142.357560:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1351680->1355775) req@ffff880098821180 x1830967307952896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.357567:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821180 with x1830967307952896 ext(1351680->1355775) 00010000:00010000:3.0:1746147142.357572:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.357581:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 14 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:3.0:1746147142.357586:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098821180 00000100:00100000:2.0:1746147142.358901:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307951872:12345-192.168.204.25@tcp:3:cat.0 Request processed in 46192us (48499us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147142.358912:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3459 00002000:00100000:2.0:1746147142.358920:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098821f80 x1830967307951872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.358928:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821f80 with x1830967307951872 ext(1048576->2097151) 00002000:00010000:2.0:1746147142.358934:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821f80 00000100:00100000:0.0:1746147142.365599:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.366463:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307953024 00000100:00100000:3.0:1746147142.366474:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307953024 00000100:00100000:3.0:1746147142.366647:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14535 00000100:00100000:3.0:1746147142.366656:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:32271:x1830967307953024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.366678:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.366698:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bca expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.366726:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147142.366731:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.366748:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.366757:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a000, rc 0) 00000100:00100000:3.0:1746147142.367036:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:32271:x1830967307953024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 379us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.367043:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14535 00000100:00100000:0.0:1746147142.371208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.372158:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307953280 00000100:00100000:2.0:1746147142.372170:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307953280 00002000:00100000:2.0:1746147142.372221:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1708032->1712127) req@ffff880098820380 x1830967307953280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.372231:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967307953280 ext(1708032->1712127) 00010000:00010000:2.0:1746147142.372241:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.372260:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.372267:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098820380 00000100:00100000:2.0:1746147142.372301:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1095 00000100:00100000:2.0:1746147142.372309:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307953280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.372464:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307953280:12345-192.168.204.25@tcp:3:cat.0 Request processed in 154us (1265us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147142.372470:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1095 00002000:00100000:2.0:1746147142.372476:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1708032->1712127) req@ffff880098820380 x1830967307953280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.372483:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967307953280 ext(1708032->1712127) 00010000:00010000:2.0:1746147142.372487:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.372496:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.372505:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098820380 00000100:00100000:0.0:1746147142.375966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.376066:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307953664 00000100:00100000:2.0:1746147142.376076:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307953664 00000100:00100000:0.0:1746147142.376142:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.376157:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5461 00000100:00100000:0.0:1746147142.376161:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307953792 00000100:00100000:0.0:1746147142.376164:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307953792 00000100:00100000:2.0:1746147142.376165:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32269:x1830967307953664:12345-192.168.204.25@tcp:35:multiop.0 00002000:00100000:0.0:1746147142.376193:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1351680->1712127) req@ffff880098823100 x1830967307953792/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.376205:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823100 with x1830967307953792 ext(1351680->1712127) 00010000:00010000:0.0:1746147142.376214:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.376228:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746147142.376235:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098823100 00000100:00100000:0.0:1746147142.376260:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1096 00000100:00100000:0.0:1746147142.376266:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307953792:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147142.376408:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32269:x1830967307953664:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 243us (466us total) trans 8589935940 rc 0/0 00000100:00100000:2.0:1746147142.376414:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5461 00000100:00100000:2.0:1746147142.387464:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307953792:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11185us (11310us total) trans 21474841475 rc 0/0 00000100:00100000:2.0:1746147142.387477:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1096 00002000:00100000:2.0:1746147142.387490:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1351680->1712127) req@ffff880098823100 x1830967307953792/t21474841475(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/448 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.387499:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823100 with x1830967307953792 ext(1351680->1712127) 00010000:00010000:2.0:1746147142.387510:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.387526:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.387532:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098823100 00000100:00100000:0.0:1746147142.390420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.390545:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307953920 00000100:00100000:2.0:1746147142.390556:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307953920 00010000:00010000:2.0:1746147142.390592:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.391189:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6352 00000100:00100000:2.0:1746147142.391199:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307953920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.391213:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147142.391231:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147140 -> 1746147142 00002000:00010000:2.0:1746147142.391233:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147140 -> 1746147142 00010000:00010000:2.0:1746147142.391240:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.391252:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.391275:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371c400/0x3139939425055fcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1351680->1712127) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bbc expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.391301:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.391303:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.391311:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.391318:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.391326:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.391328:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.391330:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.391342:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.391378:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.391392:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310672384:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.391667:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.391676:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310672512:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.391702:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.395355:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310672384:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.395370:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310672512:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.395394:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.395526:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307953920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4326us (5113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.395537:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6352 00000100:00100000:1.0:1746147142.395890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.395989:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307954176 00000100:00100000:3.0:1746147142.395997:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307954176 00002000:00100000:3.0:1746147142.396135:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097d77b80 x1830967307954176/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.396145:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77b80 with x1830967307954176 ext(1048576->2097151) 00000100:00100000:1.0:1746147142.396146:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:3.0:1746147142.396151:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77b80 00000100:00100000:3.0:1746147142.396165:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307954432 00000100:00100000:3.0:1746147142.396168:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307954432 00000100:00100000:2.0:1746147142.396196:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3461 00000100:00100000:2.0:1746147142.396204:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307954176:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147142.396321:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097d77100 x1830967307954432/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.396327:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77100 with x1830967307954432 ext(1048576->2097151) 00002000:00010000:3.0:1746147142.396330:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77100 00000100:00100000:3.0:1746147142.396354:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3462 00000100:00100000:3.0:1746147142.396359:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307954432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.404908:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307954432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8534us (8746us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147142.404921:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3462 00002000:00100000:3.0:1746147142.404935:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097d77100 x1830967307954432/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.404956:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77100 with x1830967307954432 ext(1048576->2097151) 00002000:00010000:3.0:1746147142.404963:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77100 00000100:00100000:0.0:1746147142.411604:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307954176:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15387us (15701us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147142.411618:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3461 00002000:00100000:0.0:1746147142.411630:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097d77b80 x1830967307954176/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.411640:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77b80 with x1830967307954176 ext(1048576->2097151) 00002000:00010000:0.0:1746147142.411645:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77b80 00000100:00100000:0.0:1746147142.414656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.414776:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307954560 00000100:00100000:3.0:1746147142.414789:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307954560 00000100:00100000:3.0:1746147142.414921:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14536 00000100:00100000:3.0:1746147142.414931:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32271:x1830967307954560:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.414968:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.414992:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bd1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.415024:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.415031:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147142.415033:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147142.415037:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.415070:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.415083:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 28 pid: 9584 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.415128:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310672640:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.415672:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.419774:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310672640:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.419806:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.419824:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b800, rc 0) 00000100:00100000:3.0:1746147142.419867:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:32271:x1830967307954560:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4938us (5223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.419875:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14536 00000100:00100000:0.0:1746147142.421018:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.421064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.421140:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307954688 00000100:00100000:2.0:1746147142.421148:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307954688 00002000:00100000:2.0:1746147142.421193:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2764800->2945023) req@ffff88012ca11c00 x1830967307954688/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.421203:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11c00 with x1830967307954688 ext(2764800->2945023) 00010000:00010000:2.0:1746147142.421212:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 29 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.421225:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 29 pid: 9584 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.421230:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca11c00 00000100:00100000:2.0:1746147142.421250:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1097 00000100:00100000:2.0:1746147142.421257:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307954688:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147142.421470:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307954816 00000100:00100000:3.0:1746147142.421474:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307954816 00000100:00100000:3.0:1746147142.421718:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14537 00000100:00100000:3.0:1746147142.421725:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32272:x1830967307954816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.421733:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.421748:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bd8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.421767:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147142.421772:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.421782:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.421791:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b000, rc 0) 00000100:00100000:3.0:1746147142.421813:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32272:x1830967307954816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 89us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.421819:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14537 00000100:00100000:2.0:1746147142.424467:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307954688:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3201us (3445us total) trans 17179874210 rc 0/0 00000100:00100000:2.0:1746147142.424479:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1097 00002000:00100000:2.0:1746147142.424496:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2764800->2945023) req@ffff88012ca11c00 x1830967307954688/t17179874210(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/448 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.424505:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11c00 with x1830967307954688 ext(2764800->2945023) 00010000:00010000:2.0:1746147142.424515:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 32 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.424530:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 32 pid: 9584 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.424537:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca11c00 00000100:00100000:0.0:1746147142.425902:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.426001:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307954944 00000100:00100000:2.0:1746147142.426010:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307954944 00010000:00010000:2.0:1746147142.426045:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 32 pid: 9584 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.426081:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6353 00000100:00100000:2.0:1746147142.426119:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307954944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.426135:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147142.426152:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147140 -> 1746147142 00002000:00010000:2.0:1746147142.426154:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147140 -> 1746147142 00010000:00010000:2.0:1746147142.426159:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 32 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.426170:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 32 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.426192:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425055fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2764800->2945023) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bb5 expref: 32 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.426217:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.426219:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.426227:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.426234:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.426242:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.426243:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.426247:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.426253:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.426285:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.426296:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310672768:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.426810:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.426818:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310672896:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.426835:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.428472:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310672768:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.428484:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310672896:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.428505:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.428553:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307954944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2463us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.428564:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6353 00000100:00100000:0.0:1746147142.434768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.434828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.434864:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307955328 00000100:00100000:2.0:1746147142.434873:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307955328 00002000:00100000:2.0:1746147142.434921:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88012ca10380 x1830967307955328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147142.434924:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307955456 00000100:00100000:1.0:1746147142.434928:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307955456 00002000:00100000:2.0:1746147142.434931:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10380 with x1830967307955328 ext(2097152->4194303) 00002000:00010000:2.0:1746147142.434937:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10380 00002000:00100000:1.0:1746147142.434960:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88012ca10700 x1830967307955456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.434966:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10700 with x1830967307955456 ext(2097152->4194303) 00002000:00010000:1.0:1746147142.434969:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca10700 00000100:00100000:2.0:1746147142.434972:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3463 00000100:00100000:2.0:1746147142.434980:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307955328:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147142.434994:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3464 00000100:00100000:1.0:1746147142.434998:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307955456:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.443014:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.443351:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307955712 00000100:00100000:3.0:1746147142.443361:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307955712 00002000:00100000:3.0:1746147142.443409:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009452b100 x1830967307955712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.443421:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b100 with x1830967307955712 ext(2097152->4194303) 00002000:00010000:3.0:1746147142.443427:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009452b100 00000100:00100000:3.0:1746147142.443452:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3465 00000100:00100000:3.0:1746147142.443460:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307955712:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147142.443628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.443647:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307955968 00000100:00100000:1.0:1746147142.443650:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307955968 00002000:00100000:1.0:1746147142.443669:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880097d74700 x1830967307955968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.443677:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74700 with x1830967307955968 ext(2097152->4194303) 00002000:00010000:1.0:1746147142.443680:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d74700 00000100:00100000:1.0:1746147142.443693:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3466 00000100:00100000:1.0:1746147142.443698:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307955968:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.452636:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307955328:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17641us (17865us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147142.452650:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3463 00002000:00100000:3.0:1746147142.452664:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88012ca10380 x1830967307955328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.452673:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10380 with x1830967307955328 ext(2097152->4194303) 00002000:00010000:3.0:1746147142.452678:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10380 00000100:00100000:1.0:1746147142.455623:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307955456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20614us (20784us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147142.455633:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3464 00002000:00100000:1.0:1746147142.455643:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88012ca10700 x1830967307955456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.455650:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10700 with x1830967307955456 ext(2097152->4194303) 00002000:00010000:1.0:1746147142.455656:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca10700 00000100:00100000:1.0:1746147142.460630:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967307955968:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16912us (16983us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147142.460644:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3466 00002000:00100000:1.0:1746147142.460665:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880097d74700 x1830967307955968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.460675:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74700 with x1830967307955968 ext(2097152->4194303) 00002000:00010000:1.0:1746147142.460683:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d74700 00000100:00100000:3.0:1746147142.465155:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307955712:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21682us (22138us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147142.465169:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3465 00002000:00100000:3.0:1746147142.465182:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009452b100 x1830967307955712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.465191:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b100 with x1830967307955712 ext(2097152->4194303) 00002000:00010000:3.0:1746147142.465197:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009452b100 00000100:00100000:0.0:1746147142.471218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.471360:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307956224 00000100:00100000:3.0:1746147142.471371:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307956224 00002000:00100000:3.0:1746147142.471418:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca13b80 x1830967307956224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.471428:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13b80 with x1830967307956224 ext(4194304->4919295) 00002000:00010000:3.0:1746147142.471433:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13b80 00000100:00100000:3.0:1746147142.471455:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3467 00000100:00100000:3.0:1746147142.471463:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307956224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.472497:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.473475:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307956480 00000100:00100000:1.0:1746147142.473485:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307956480 00002000:00100000:1.0:1746147142.473533:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca11500 x1830967307956480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.473545:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11500 with x1830967307956480 ext(4194304->4919295) 00002000:00010000:1.0:1746147142.473551:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11500 00000100:00100000:1.0:1746147142.473587:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3468 00000100:00100000:1.0:1746147142.473594:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307956480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.476762:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307956224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5287us (5544us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147142.476778:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3467 00002000:00100000:3.0:1746147142.476792:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca13b80 x1830967307956224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.476803:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13b80 with x1830967307956224 ext(4194304->4919295) 00002000:00010000:3.0:1746147142.476810:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13b80 00000100:00100000:1.0:1746147142.480548:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307956480:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6940us (8040us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147142.480563:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3468 00002000:00100000:1.0:1746147142.480577:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012ca11500 x1830967307956480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.480587:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11500 with x1830967307956480 ext(4194304->4919295) 00002000:00010000:1.0:1746147142.480594:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11500 00000100:00100000:0.0:1746147142.483132:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.483612:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307956736 00000100:00100000:3.0:1746147142.483622:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307956736 00000100:00100000:3.0:1746147142.483675:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15262 00000100:00100000:3.0:1746147142.483683:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32276:x1830967307956736:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.483705:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.483725:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425055fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bdf expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.483812:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483831:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483845:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483859:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483864:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483870:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483989:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.483999:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484006:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147142.484014:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.484115:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484121:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484127:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484132:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2be00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.484137:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484144:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484155:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147142.484157:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.484161:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484165:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425055ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484192:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484196:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484200:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484204:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.484206:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484209:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484215:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1100) 00010000:00010000:3.0:1746147142.484217:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.484218:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484226:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425055ffc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.484259:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425055fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.484270:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.484275:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.484277:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147142.484279:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b600, rc 0) 00000100:00100000:3.0:1746147142.484338:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32276:x1830967307956736:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 655us (1216us total) trans 8589935941 rc 0/0 00000100:00100000:3.0:1746147142.484344:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15262 00000100:00100000:0.0:1746147142.485501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.485643:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307956992 00000100:00100000:1.0:1746147142.485650:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307956992 00000100:00100000:0.0:1746147142.486159:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.487331:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307957248 00000100:00100000:1.0:1746147142.487340:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307957248 00000100:00100000:1.0:1746147142.487386:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5462 00000100:00100000:1.0:1746147142.487394:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:32271:x1830967307956992:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147142.487600:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:32271:x1830967307956992:12345-192.168.204.25@tcp:35:cat.0 Request processed in 207us (2102us total) trans 8589935942 rc 0/0 00000100:00100000:1.0:1746147142.487605:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5462 00000100:00100000:1.0:1746147142.487619:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5463 00000100:00100000:1.0:1746147142.487623:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32272:x1830967307957248:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147142.487673:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32272:x1830967307957248:12345-192.168.204.25@tcp:35:cat.0 Request processed in 49us (1515us total) trans 8589935943 rc 0/0 00000100:00100000:1.0:1746147142.487678:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5463 00000100:00100000:0.0:1746147142.488967:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.489015:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307957504 00000100:00100000:3.0:1746147142.489022:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307957504 00000100:00100000:3.0:1746147142.489065:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5464 00000100:00100000:3.0:1746147142.489072:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32276:x1830967307957504:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147142.489220:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32276:x1830967307957504:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 147us (257us total) trans 8589935944 rc 0/0 00000100:00100000:3.0:1746147142.489226:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5464 00000100:00100000:0.0:1746147142.503196:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.503639:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307957760 00000100:00100000:3.0:1746147142.503650:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307957760 00000100:00100000:3.0:1746147142.503707:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15263 00000100:00100000:3.0:1746147142.503716:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:32279:x1830967307957760:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.503745:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.503765:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425056011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77be6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.503848:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.503862:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.503873:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.503887:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.503894:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.503899:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504012:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504021:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504027:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147142.504035:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.504130:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504141:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504146:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504151:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.504155:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504161:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504172:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147142.504175:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.504179:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504184:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504554:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504559:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504563:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504566:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.504569:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504576:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504583:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1300) 00010000:00010000:3.0:1746147142.504585:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.504587:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504591:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x313993942505601f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.504623:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425056011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.504633:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.504638:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.504640:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147142.504642:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2be00, rc 0) 00000100:00100000:3.0:1746147142.505473:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:32279:x1830967307957760:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1753us (2285us total) trans 8589935945 rc 0/0 00000100:00100000:3.0:1746147142.505480:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15263 00000100:00100000:0.0:1746147142.525299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.526082:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307957888 00000100:00100000:2.0:1746147142.526131:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307957888 00000100:00100000:2.0:1746147142.526198:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14538 00000100:00100000:2.0:1746147142.526207:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32276:x1830967307957888:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147142.526228:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.526248:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bed expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.526279:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.526288:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.526295:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.526297:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.526300:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1159168->1638399] (req 1159168->1638399) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.526329:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.526341:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 13 pid: 9586 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.526354:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673024:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.526465:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.526473:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.526481:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.526500:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.531870:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673024:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.531881:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673152:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.531913:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1159168->1638399] (req 1159168->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.531930:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81e00, rc 0) 00000100:00100000:2.0:1746147142.531989:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32276:x1830967307957888:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5783us (6708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.531998:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14538 00000100:00100000:0.0:1746147142.535002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.535156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.535197:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958016 00000100:00100000:1.0:1746147142.535206:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958016 00010000:00010000:1.0:1746147142.535244:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 14 pid: 9586 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.535251:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958144 00000100:00100000:3.0:1746147142.535255:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958144 00010000:00010000:3.0:1746147142.535271:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746147142.535283:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6354 00000100:00100000:3.0:1746147142.535289:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6355 00000100:00100000:1.0:1746147142.535291:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307958016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147142.535294:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307958144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.535304:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147142.535304:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.535323:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.535323:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 14 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.535333:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.535386:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.535405:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958272 00000100:00100000:2.0:1746147142.535409:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958272 00000100:00100000:2.0:1746147142.535437:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14539 00000100:00100000:2.0:1746147142.535442:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:32279:x1830967307958272:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147142.535457:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.535471:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bf4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.535493:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.535501:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.535507:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.535512:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.535514:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.535517:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 16 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.535544:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.535555:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 29 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.535566:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673280:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.535683:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 16 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.535700:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425055fd9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bca expref: 16 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.535717:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.535739:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307958016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 450us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.535745:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6354 00010000:00010000:3.0:1746147142.536165:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425055fd2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bc3 expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.536170:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.536178:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.536179:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.536179:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 14 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.536185:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.536189:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673408:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.536193:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.536216:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.536225:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310673536:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.536400:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.536408:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 9 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.536417:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673664:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.536439:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.536660:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.540583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.540633:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958400 00000100:00100000:1.0:1746147142.540641:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958400 00000100:00100000:3.0:1746147142.540643:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310673536:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147142.540665:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147142.540679:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 10 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.540710:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307958144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5413us (5552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.540719:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6356 00000100:00100000:0.0:1746147142.540735:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673280:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147142.540745:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673408:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147142.540752:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310673664:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147142.540777:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.540781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147142.540793:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81a00, rc 0) 00000100:00100000:0.0:1746147142.540813:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:32279:x1830967307958272:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5370us (5427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.540819:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14539 00000100:00100000:1.0:1746147142.540865:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307958400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147142.540880:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147142.540899:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 10 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.540908:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 10 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.540930:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x3139939425055ea5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b22 expref: 10 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.540952:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.540967:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307958400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 242us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.540991:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958656 00000100:00100000:2.0:1746147142.540995:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958656 00000100:00100000:0.0:1746147142.541008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147142.541027:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1159168->1163263) req@ffff88009452bb80 x1830967307958656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.541035:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452bb80 with x1830967307958656 ext(1159168->1163263) 00002000:00010000:2.0:1746147142.541040:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452bb80 00000100:00100000:2.0:1746147142.541057:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958784 00000100:00100000:2.0:1746147142.541059:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958784 00010000:00010000:2.0:1746147142.541067:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 14 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.541202:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6355 00000100:00100000:1.0:1746147142.541208:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6356 00000100:00100000:3.0:1746147142.541228:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3469 00000100:00100000:3.0:1746147142.541233:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307958656:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147142.541235:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6357 00000100:00100000:2.0:1746147142.541241:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307958784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.541251:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.541258:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 14 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.541265:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 14 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.541276:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57600/0x3139939425055f93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b92 expref: 14 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.541285:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.541299:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967307958784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.541304:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6357 00000100:00100000:3.0:1746147142.541709:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307958656:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 475us (926us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147142.541874:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3469 00002000:00100000:3.0:1746147142.541880:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1159168->1163263) req@ffff88009452bb80 x1830967307958656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.541888:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452bb80 with x1830967307958656 ext(1159168->1163263) 00002000:00010000:3.0:1746147142.541892:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452bb80 00000100:00100000:0.0:1746147142.543467:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.543549:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307958912 00000100:00100000:2.0:1746147142.543556:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307958912 00010000:00010000:2.0:1746147142.543590:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 28 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.543759:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6358 00000100:00100000:2.0:1746147142.543767:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307958912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.543779:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.543797:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 28 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.543809:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 28 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.543832:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57400/0x3139939425055f69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b6f expref: 28 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.543847:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.543849:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.543856:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.543865:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.543901:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.543913:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310673792:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.544605:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.546408:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310673792:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.546430:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.546472:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307958912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2704us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.546483:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6358 00000100:00100000:0.0:1746147142.547379:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.547788:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307959168 00000100:00100000:3.0:1746147142.547796:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307959168 00002000:00100000:3.0:1746147142.547837:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3805184->3809279) req@ffff88011e486a00 x1830967307959168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.547847:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486a00 with x1830967307959168 ext(3805184->3809279) 00002000:00010000:3.0:1746147142.547852:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e486a00 00000100:00100000:3.0:1746147142.547883:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3470 00000100:00100000:3.0:1746147142.547891:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307959168:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147142.548048:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307959168:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 157us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147142.548054:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3470 00002000:00100000:3.0:1746147142.548059:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3805184->3809279) req@ffff88011e486a00 x1830967307959168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.548067:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486a00 with x1830967307959168 ext(3805184->3809279) 00002000:00010000:3.0:1746147142.548070:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e486a00 00000100:00100000:0.0:1746147142.551208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.551560:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307959424 00000100:00100000:2.0:1746147142.551570:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307959424 00002000:00100000:2.0:1746147142.551626:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1634304->1638399) req@ffff88011e487100 x1830967307959424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.551640:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487100 with x1830967307959424 ext(1634304->1638399) 00002000:00010000:2.0:1746147142.551645:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487100 00000100:00100000:2.0:1746147142.551679:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3471 00000100:00100000:2.0:1746147142.551687:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307959424:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147142.551854:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307959424:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 167us (655us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147142.551860:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3471 00002000:00100000:2.0:1746147142.551866:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1634304->1638399) req@ffff88011e487100 x1830967307959424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.551872:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487100 with x1830967307959424 ext(1634304->1638399) 00002000:00010000:2.0:1746147142.551875:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487100 00000100:00100000:0.0:1746147142.555314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.555615:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307959552 00000100:00100000:2.0:1746147142.555624:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307959552 00000100:00100000:2.0:1746147142.555852:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14540 00000100:00100000:2.0:1746147142.555861:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32279:x1830967307959552:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147142.555882:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.555902:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77bfb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.555931:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.555950:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.555961:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.555963:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.555966:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->4231167] (req 4194304->4231167) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.555998:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.556009:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 30 pid: 9586 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.556021:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310673920:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.556630:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.556638:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.556645:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310674048:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.556665:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.561187:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310673920:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.561206:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310674048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.561239:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->4231167] (req 4194304->4231167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.561263:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80400, rc 0) 00000100:00100000:2.0:1746147142.561325:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32279:x1830967307959552:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5463us (6021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.561335:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14540 00000100:00100000:1.0:1746147142.561350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.561509:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307959680 00000100:00100000:3.0:1746147142.561517:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307959680 00010000:00010000:3.0:1746147142.561545:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.561568:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6359 00000100:00100000:3.0:1746147142.561575:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307959680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.561592:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.561612:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.561623:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.561645:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425055fe7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd8 expref: 31 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.561669:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.561697:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967307959680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 122us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.561702:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6359 00000100:00100000:0.0:1746147142.563734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.563833:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307959808 00000100:00100000:3.0:1746147142.563840:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307959808 00010000:00010000:3.0:1746147142.563874:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.563914:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6360 00000100:00100000:3.0:1746147142.563922:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307959808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.563935:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.563966:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.563978:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.563997:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425055fe0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bd1 expref: 11 pid: 9586 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.564010:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.564012:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.564019:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.564026:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.564057:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.564070:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310674176:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147142.564186:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.565446:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310674176:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147142.565463:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.565569:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967307959808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1646us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.565577:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6360 00000100:00100000:0.0:1746147142.567589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.569664:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307960064 00000100:00100000:3.0:1746147142.569678:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307960064 00002000:00100000:3.0:1746147142.569734:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4227072->4231167) req@ffff88011e485f80 x1830967307960064/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.569746:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485f80 with x1830967307960064 ext(4227072->4231167) 00002000:00010000:3.0:1746147142.569757:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485f80 00000100:00100000:3.0:1746147142.569795:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3472 00000100:00100000:3.0:1746147142.569802:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307960064:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147142.569990:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967307960064:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 187us (2408us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147142.569997:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3472 00002000:00100000:3.0:1746147142.570003:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4227072->4231167) req@ffff88011e485f80 x1830967307960064/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.570009:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485f80 with x1830967307960064 ext(4227072->4231167) 00002000:00010000:3.0:1746147142.570012:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485f80 00000100:00100000:0.0:1746147142.573585:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.573622:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307960320 00000100:00100000:0.0:1746147142.573631:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307960320 00000100:00100000:0.0:1746147142.573695:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5465 00000100:00100000:0.0:1746147142.573703:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f89c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:32279:x1830967307960320:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147142.573913:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f89c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:32279:x1830967307960320:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 210us (341us total) trans 8589935946 rc 0/0 00000100:00100000:0.0:1746147142.573919:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5465 00000100:00100000:0.0:1746147142.605234:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.605313:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307960576 00000100:00100000:3.0:1746147142.605324:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307960576 00000100:00100000:3.0:1746147142.605390:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15264 00000100:00100000:3.0:1746147142.605399:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32285:x1830967307960576:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.605436:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.605458:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425056049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c02 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.605671:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605686:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605702:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605718:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605824:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605831:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605932:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x313993942505605e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605957:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x313993942505605e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.605963:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x313993942505605e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147142.605971:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.606051:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606061:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606066:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606072:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.606076:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606082:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606117:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147142.606120:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.606124:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606129:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425056050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606770:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606776:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606781:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606785:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.606788:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606796:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606804:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1500) 00010000:00010000:3.0:1746147142.606806:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.606808:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606812:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425056057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.606863:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425056049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c02 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.606874:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x313993942505605e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c02 expref: 34 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.606880:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.606882:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147142.606884:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a000, rc 0) 00000100:00100000:3.0:1746147142.606967:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32285:x1830967307960576:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1568us (1745us total) trans 8589935947 rc 0/0 00000100:00100000:3.0:1746147142.606974:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15264 00000100:00100000:0.0:1746147142.609303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.609362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.609518:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307960704 00000100:00100000:2.0:1746147142.609528:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307960704 00000100:00100000:0.0:1746147142.609588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.609623:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307960832 00000100:00100000:0.0:1746147142.609626:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307960832 00000100:00100000:2.0:1746147142.609668:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14541 00000100:00100000:2.0:1746147142.609676:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307960704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.609694:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.609713:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942505606c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c09 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.609764:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310674304:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.609784:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14542 00000100:00100000:0.0:1746147142.609790:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307960832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.609797:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.609807:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425056073 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c10 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.609829:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310674432:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.609845:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.609846:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.609865:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307960960 00000100:00100000:0.0:1746147142.609868:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307960960 00000100:00100000:0.0:1746147142.610047:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 806 00000100:00100000:0.0:1746147142.610053:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307960960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.610063:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.610082:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x313993942505605e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c02 expref: 34 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.610124:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.610128:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147142.610151:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307960960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 98us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.610157:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 806 00002000:00010000:1.0:1746147142.611192:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147140 -> 1746147142 00002000:00010000:2.0:1746147142.611193:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147140 -> 1746147142 00002000:00010000:1.0:1746147142.611197:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147140 -> 1746147142 00002000:00010000:1.0:1746147142.611199:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147140 -> 1746147142 00000100:00100000:2.0:1746147142.611214:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310674304:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147142.611214:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310674432:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147142.611233:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942505606c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c09 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.611233:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425056073 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c10 expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.611244:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942505606c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c09 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.611244:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425056073 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c10 expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.611256:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81400, rc 0) 00000100:00100000:2.0:1746147142.611282:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307960704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1607us (1988us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147142.611288:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14541 00010000:00010000:1.0:1746147142.611381:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64a200, rc 0) 00000100:00100000:1.0:1746147142.611402:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307960832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1612us (2039us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.611407:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14542 00000100:00100000:0.0:1746147142.619659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.619758:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307961216 00000100:00100000:2.0:1746147142.619769:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307961216 00002000:00100000:2.0:1746147142.619818:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011e487800 x1830967307961216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 504/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.619826:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487800 with x1830967307961216 ext(1048576->2097151) 00002000:00010000:2.0:1746147142.619830:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487800 00000100:00100000:2.0:1746147142.619888:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3473 00000100:00100000:2.0:1746147142.619896:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307961216:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.624333:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967307961216:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4421us (4670us total) trans 0 rc 569344/569344 00000100:00100000:2.0:1746147142.624347:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3473 00002000:00100000:2.0:1746147142.624360:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011e487800 x1830967307961216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 504/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 569344/569344 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.624371:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487800 with x1830967307961216 ext(1048576->2097151) 00002000:00010000:2.0:1746147142.624377:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487800 00010000:00010000:3.0:1746147142.627495:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147142.631321:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.631379:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.631469:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307961472 00000100:00100000:1.0:1746147142.631479:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307961472 00000100:00100000:1.0:1746147142.631533:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307961344 00000100:00100000:1.0:1746147142.631535:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307961344 00000100:00100000:1.0:1746147142.631555:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14543 00000100:00100000:1.0:1746147142.631567:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307961472:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147142.631585:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14544 00010000:00010000:1.0:1746147142.631587:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147142.631591:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307961344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.631598:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.631606:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94e00/0x313993942505607a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c1e expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.631608:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425056081 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c17 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.631656:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310674688:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.631656:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310674560:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147142.631735:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.631735:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.632708:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310674688:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.632710:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310674560:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147142.632731:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425056081 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c17 expref: 31 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.632731:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94e00/0x313993942505607a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c1e expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.632741:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425056081 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c17 expref: 31 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.632741:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94e00/0x313993942505607a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c1e expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.632756:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a600, rc 0) 00010000:00010000:1.0:1746147142.632764:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94e00, rc 0) 00000100:00100000:2.0:1746147142.632783:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307961344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1192us (1404us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.632784:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967307961472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1222us (1476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147142.632790:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14544 00000100:00100000:1.0:1746147142.632799:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14543 00000100:00100000:0.0:1746147142.634692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.634806:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307961600 00000100:00100000:1.0:1746147142.634815:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307961600 00000100:00100000:1.0:1746147142.634868:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14545 00000100:00100000:1.0:1746147142.634876:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32285:x1830967307961600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.634893:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.634912:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c25 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.634952:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.634960:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147142.634962:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147142.634965:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.635001:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.635014:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 9 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746147142.635027:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310674816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.635146:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.636835:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310674816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.636865:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.636879:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94a00, rc 0) 00000100:00100000:1.0:1746147142.636920:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32285:x1830967307961600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2043us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.636928:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14545 00000100:00100000:0.0:1746147142.637200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.637250:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307961728 00000100:00100000:2.0:1746147142.637257:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307961728 00002000:00100000:2.0:1746147142.637295:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4231167) req@ffff88011e486300 x1830967307961728/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.637303:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486300 with x1830967307961728 ext(4194304->4231167) 00010000:00010000:2.0:1746147142.637310:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 10 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.637321:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 10 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.637326:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e486300 00000100:00100000:2.0:1746147142.637357:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1098 00000100:00100000:2.0:1746147142.637364:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967307961728:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147142.639959:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307961728:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 2575us (2739us total) trans 17179874211 rc 0/0 00000100:00100000:2.0:1746147142.639971:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1098 00002000:00100000:2.0:1746147142.639983:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4231167) req@ffff88011e486300 x1830967307961728/t17179874211(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/448 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.639993:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486300 with x1830967307961728 ext(4194304->4231167) 00010000:00010000:2.0:1746147142.640004:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.640026:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.640034:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e486300 00000100:00100000:0.0:1746147142.643400:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.643539:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307961856 00000100:00100000:2.0:1746147142.643548:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307961856 00010000:00010000:2.0:1746147142.643660:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.643810:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6361 00000100:00100000:2.0:1746147142.643819:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967307961856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.643835:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.644131:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.644144:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.644173:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80400/0x3139939425056042 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4231167) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bfb expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.644202:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.644204:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.644215:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.644228:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.644264:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.644277:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310674944:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.644382:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.646011:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310674944:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.646030:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.646065:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307961856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2247us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.646074:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6361 00000100:00100000:0.0:1746147142.649344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.649446:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307962112 00000100:00100000:2.0:1746147142.649456:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307962112 00002000:00100000:2.0:1746147142.649504:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009885b100 x1830967307962112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.649514:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b100 with x1830967307962112 ext(2097152->3145727) 00002000:00010000:2.0:1746147142.649520:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885b100 00000100:00100000:2.0:1746147142.649553:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3474 00000100:00100000:2.0:1746147142.649562:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307962112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.657901:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307962112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8327us (8557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147142.657919:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3474 00002000:00100000:2.0:1746147142.657933:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009885b100 x1830967307962112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.657958:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b100 with x1830967307962112 ext(2097152->3145727) 00002000:00010000:2.0:1746147142.657964:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885b100 00000100:00100000:0.0:1746147142.661529:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.661617:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307962240 00000100:00100000:1.0:1746147142.661630:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307962240 00000100:00100000:1.0:1746147142.661690:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14546 00000100:00100000:1.0:1746147142.661699:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32285:x1830967307962240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.661718:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.661806:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c2c expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.662156:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.662334:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147142.662337:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147142.662342:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.662377:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.662389:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 12 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746147142.662403:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675072:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.662499:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.664910:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.665005:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675072:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.665018:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307962368 00000100:00100000:2.0:1746147142.665027:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307962368 00010000:00010000:1.0:1746147142.665043:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.665061:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00000100:00100000:1.0:1746147142.665141:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32285:x1830967307962240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3442us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.665149:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14546 00002000:00100000:2.0:1746147142.665479:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3805184->4194303) req@ffff88009885b800 x1830967307962368/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.665546:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b800 with x1830967307962368 ext(3805184->4194303) 00010000:00010000:2.0:1746147142.665608:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.665621:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 13 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746147142.665628:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009885b800 00000100:00100000:2.0:1746147142.665672:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1099 00000100:00100000:2.0:1746147142.665680:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307962368:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147142.672420:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307962368:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6729us (7510us total) trans 21474841476 rc 0/0 00000100:00100000:0.0:1746147142.672432:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1099 00002000:00100000:0.0:1746147142.672444:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3805184->4194303) req@ffff88009885b800 x1830967307962368/t21474841476(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/448 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.672453:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b800 with x1830967307962368 ext(3805184->4194303) 00010000:00010000:0.0:1746147142.672463:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.672479:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746147142.672486:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009885b800 00000100:00100000:0.0:1746147142.675868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.675923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.675984:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307962752 00000100:00100000:0.0:1746147142.675994:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307962752 00010000:00010000:0.0:1746147142.676031:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.676080:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6362 00000100:00100000:0.0:1746147142.676115:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307962752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.676129:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.676151:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.676169:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.676192:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81a00/0x313993942505603b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bf4 expref: 15 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.676211:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.676214:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.676221:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.676230:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.676262:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.676274:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310675200:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147142.676354:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.676558:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307962624 00000100:00100000:3.0:1746147142.676562:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307962624 00000100:00100000:3.0:1746147142.676591:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15265 00000100:00100000:3.0:1746147142.676596:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32288:x1830967307962624:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.676616:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.676632:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c33 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.676700:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676712:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676721:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676732:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676736:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676741:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676833:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x31399394250560ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676842:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x31399394250560ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.676848:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x31399394250560ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147142.676855:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147142.677058:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677065:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677070:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677076:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.677079:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677086:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677114:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147142.677116:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.677120:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677124:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x313993942505609d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147142.677284:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310675200:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147142.677306:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147142.677334:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307962752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1246us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.677342:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6362 00010000:00010000:3.0:1746147142.677443:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677449:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677454:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677458:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.677460:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677465:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677475:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1900) 00010000:00010000:3.0:1746147142.677478:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.677480:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677484:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a000/0x31399394250560a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.677519:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425056096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c33 expref: 36 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.677530:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x31399394250560ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c33 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.677536:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.677538:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147142.677540:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:3.0:1746147142.678564:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32288:x1830967307962624:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1964us (2704us total) trans 8589935948 rc 0/0 00000100:00100000:3.0:1746147142.678572:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15265 00000100:00100000:0.0:1746147142.681199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.682236:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307962880 00000100:00100000:2.0:1746147142.682247:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307962880 00000100:00100000:2.0:1746147142.682311:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 807 00000100:00100000:2.0:1746147142.682324:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307962880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.682340:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.682377:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x31399394250560ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c33 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.682397:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.682401:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.683205:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967307962880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 883us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.683213:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 807 00000100:00100000:0.0:1746147142.683310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.683606:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307963136 00000100:00100000:1.0:1746147142.683612:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307963136 00000100:00100000:1.0:1746147142.683650:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5466 00000100:00100000:1.0:1746147142.683656:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32288:x1830967307963136:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147142.683864:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32288:x1830967307963136:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 207us (554us total) trans 8589935949 rc 0/0 00000100:00100000:1.0:1746147142.683870:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5466 00000100:00100000:0.0:1746147142.684880:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.684921:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.685067:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307963392 00000100:00100000:3.0:1746147142.685072:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307963392 00002000:00100000:3.0:1746147142.685128:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801305f2300 x1830967307963392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.685138:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2300 with x1830967307963392 ext(2097152->4194303) 00002000:00010000:3.0:1746147142.685143:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f2300 00000100:00100000:3.0:1746147142.685156:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307963648 00000100:00100000:3.0:1746147142.685158:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307963648 00002000:00100000:3.0:1746147142.685171:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801305f0000 x1830967307963648/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.685178:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0000 with x1830967307963648 ext(3145728->4194303) 00002000:00010000:3.0:1746147142.685192:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0000 00000100:00100000:3.0:1746147142.685212:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3475 00000100:00100000:3.0:1746147142.685219:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307963392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.685228:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3476 00000100:00100000:2.0:1746147142.685242:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307963648:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.696182:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.696207:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307963904 00000100:00100000:3.0:1746147142.696276:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307963648:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11037us (11351us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147142.696290:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3476 00002000:00100000:3.0:1746147142.696302:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801305f0000 x1830967307963648/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.696311:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0000 with x1830967307963648 ext(3145728->4194303) 00002000:00010000:3.0:1746147142.696317:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0000 00000100:00100000:2.0:1746147142.697501:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307963904 00000100:00100000:2.0:1746147142.698554:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15266 00000100:00100000:2.0:1746147142.698568:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:32290:x1830967307963904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147142.698597:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.698618:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250560b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c3a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.698704:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698717:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698728:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698741:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698749:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698753:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698859:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250560ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698867:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250560ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698872:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250560ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147142.698879:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147142.698961:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698966:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698971:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698975:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12c400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147142.698978:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698983:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.698992:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147142.698995:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147142.698999:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699003:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250560c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699035:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699039:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699043:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699046:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12d200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147142.699048:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699052:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699057:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800932c2500) 00010000:00010000:2.0:1746147142.699059:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147142.699060:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699064:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x31399394250560c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.699113:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250560b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c3a expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.699128:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250560ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c3a expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.699134:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.699136:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147142.699139:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12ca00, rc 0) 00000100:00100000:2.0:1746147142.701918:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:32290:x1830967307963904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3338us (5732us total) trans 8589935950 rc 0/0 00000100:00100000:2.0:1746147142.701930:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15266 00000100:00100000:0.0:1746147142.708360:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.708464:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307964032 00000100:00100000:2.0:1746147142.708473:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307964032 00000100:00100000:2.0:1746147142.708612:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 808 00000100:00100000:3.0:1746147142.708619:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307963392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23400us (23739us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147142.708621:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307964032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147142.708630:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3475 00010000:00010000:2.0:1746147142.708636:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746147142.708641:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801305f2300 x1830967307963392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.708649:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2300 with x1830967307963392 ext(2097152->4194303) 00002000:00010000:3.0:1746147142.708653:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f2300 00010000:00010000:2.0:1746147142.708662:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250560ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c3a expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.708677:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.708681:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.708696:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307964032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 77us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.708701:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 808 00000100:00100000:0.0:1746147142.715877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.716711:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307964160 00000100:00100000:1.0:1746147142.716721:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307964160 00000100:00100000:1.0:1746147142.717482:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14547 00000100:00100000:1.0:1746147142.717494:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:32290:x1830967307964160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147142.717516:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.717538:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c41 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.717572:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 8 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.717581:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.717588:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.717595:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.717597:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.717600:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1110016->1347583] (req 1110016->1347583) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.717635:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.717648:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 27 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.717662:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675328:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.717778:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.717787:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 15 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.717796:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675456:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.717818:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 8 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.717826:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 8 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.717835:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675584:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.717849:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.723566:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.723570:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.723715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.723728:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307964416 00000100:00100000:3.0:1746147142.723740:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307964416 00000100:00100000:2.0:1746147142.723740:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.723761:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307964544 00000100:00100000:2.0:1746147142.723764:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307964544 00010000:00010000:2.0:1746147142.723788:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 28 pid: 1398 timeout: 780 lvb_type: 1 00002000:00100000:3.0:1746147142.723803:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094529180 x1830967307964416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.723821:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529180 with x1830967307964416 ext(4194304->4919295) 00000100:00100000:2.0:1746147142.723821:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307964800 00000100:00100000:2.0:1746147142.723823:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307964800 00002000:00010000:3.0:1746147142.723826:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094529180 00010000:00010000:2.0:1746147142.723833:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 16 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.723847:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6363 00000100:00100000:2.0:1746147142.723855:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307964544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147142.723858:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6364 00000100:00100000:3.0:1746147142.723867:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307964800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.723867:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.723877:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.723886:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 28 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.723889:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 16 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.723902:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 16 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746147142.724036:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3477 00000100:00100000:0.0:1746147142.724047:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307964416:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:2.0:1746147142.724294:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 28 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.724322:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147142.724383:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.724459:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307964544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 603us (743us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147142.724461:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425055f5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b5a expref: 28 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.724465:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6363 00000100:00100000:1.0:1746147142.724493:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.724509:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.724522:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307964672 00000100:00100000:2.0:1746147142.724525:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307964672 00010000:00010000:2.0:1746147142.724536:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 9 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.724553:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6365 00000100:00100000:2.0:1746147142.724558:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307964672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.724565:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.724571:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 9 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.724580:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 9 pid: 10340 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.724592:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.724593:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.724600:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.724608:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.724643:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.724654:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310675712:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147142.724699:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.724755:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307964800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 887us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.724763:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6364 00010000:00010000:1.0:1746147142.724904:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56800/0x3139939425055f77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b7d expref: 15 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.724914:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675456:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.724927:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542a00/0x3139939425055e90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b0d expref: 9 pid: 10340 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.724945:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310675584:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.724973:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.724981:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94800, rc 0) 00000100:00100000:1.0:1746147142.725025:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:32290:x1830967307964160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7532us (9160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.725033:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14547 00000100:00100000:0.0:1746147142.726174:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307965056 00000100:00100000:0.0:1746147142.726184:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307965056 00000100:00100000:0.0:1746147142.726238:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15267 00000100:00100000:0.0:1746147142.726247:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:32293:x1830967307965056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.726267:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.726287:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x31399394250560e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c48 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.726367:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726382:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726403:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726418:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726425:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726431:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726541:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250560f8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726554:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250560f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726561:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250560f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147142.726571:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147142.726666:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726674:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726679:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726685:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fcc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147142.726689:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726695:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726707:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147142.726710:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147142.726714:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726723:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x31399394250560ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726750:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726755:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726759:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726764:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147142.726766:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726770:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726776:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a570d400) 00010000:00010000:0.0:1746147142.726778:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147142.726780:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726784:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc200/0x31399394250560f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.726818:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc000/0x31399394250560e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c48 expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.726829:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250560f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c48 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.726838:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.726840:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147142.726842:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fc800, rc 0) 00000100:00100000:0.0:1746147142.726865:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:32293:x1830967307965056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 621us (3311us total) trans 8589935951 rc 0/0 00000100:00100000:0.0:1746147142.726870:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15267 00000100:00100000:2.0:1746147142.728226:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310675712:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.728245:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.730329:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2002:x1830967307964672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5758us (5807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.730342:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6365 00000100:00100000:0.0:1746147142.731265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.731568:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307965312 00000100:00100000:3.0:1746147142.731576:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307965312 00002000:00100000:3.0:1746147142.731617:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1343488->1347583) req@ffff8801305f1500 x1830967307965312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.731626:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1500 with x1830967307965312 ext(1343488->1347583) 00002000:00010000:3.0:1746147142.731632:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f1500 00000100:00100000:3.0:1746147142.731650:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3478 00000100:00100000:3.0:1746147142.731657:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307965312:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147142.731802:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307965312:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 144us (663us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147142.731808:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3478 00002000:00100000:3.0:1746147142.731814:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1343488->1347583) req@ffff8801305f1500 x1830967307965312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.731821:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1500 with x1830967307965312 ext(1343488->1347583) 00002000:00010000:3.0:1746147142.731824:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f1500 00000100:00100000:1.0:1746147142.732064:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307964416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8019us (8510us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147142.732071:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3477 00002000:00100000:1.0:1746147142.732076:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094529180 x1830967307964416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.732083:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529180 with x1830967307964416 ext(4194304->4919295) 00002000:00010000:1.0:1746147142.732106:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094529180 00000100:00100000:1.0:1746147142.732474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.732577:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307965440 00000100:00100000:2.0:1746147142.732581:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307965440 00000100:00100000:2.0:1746147142.732956:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 809 00000100:00100000:2.0:1746147142.732964:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307965440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.732976:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.733001:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250560f8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c48 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.733030:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.733035:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.733066:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307965440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.733072:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 809 00000100:00100000:0.0:1746147142.733777:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.733914:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.734133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.734491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.734597:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307965568 00000100:00100000:2.0:1746147142.734604:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307965568 00000100:00100000:1.0:1746147142.734619:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307965696 00000100:00100000:1.0:1746147142.734630:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307965696 00000100:00100000:2.0:1746147142.734636:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307965824 00000100:00100000:2.0:1746147142.734639:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307965824 00000100:00100000:2.0:1746147142.734653:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14548 00000100:00100000:2.0:1746147142.734661:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307965568:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147142.734675:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966080 00010000:00010000:2.0:1746147142.734677:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147142.734678:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966080 00010000:00010000:2.0:1746147142.734696:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425056106 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c4f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.734723:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5467 00000100:00100000:1.0:1746147142.734730:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:32290:x1830967307966080:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147142.734746:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310675840:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.734808:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.734830:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14549 00000100:00100000:2.0:1746147142.734835:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307965824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.734841:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.734848:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c5d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.734860:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.734862:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.734869:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.734884:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147142.734891:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:32290:x1830967307966080:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 161us (400us total) trans 8589935952 rc 0/0 00010000:00010000:2.0:1746147142.734894:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeee00, rc 0) 00000100:00100000:2.0:1746147142.734913:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967307965824:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.734918:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14549 00000100:00100000:1.0:1746147142.734953:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5467 00000100:00100000:1.0:1746147142.734990:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14550 00000100:00100000:1.0:1746147142.734995:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307965696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.735005:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.735019:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c56 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.735035:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.735037:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.735043:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.735057:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.735066:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95000, rc 0) 00000100:00100000:1.0:1746147142.735112:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307965696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 116us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.735118:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14550 00000100:00100000:0.0:1746147142.737911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:2.0:1746147142.738173:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147140 -> 1746147142 00000100:00100000:2.0:1746147142.738199:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310675840:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147142.738235:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425056106 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c4f expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.738250:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425056106 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c4f expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.738265:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeea00, rc 0) 00000100:00100000:2.0:1746147142.738311:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307965568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3652us (4536us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147142.738319:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14548 00000100:00100000:2.0:1746147142.738345:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966208 00000100:00100000:2.0:1746147142.738350:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966208 00000100:00100000:2.0:1746147142.738377:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14551 00000100:00100000:2.0:1746147142.738383:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307966208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.738399:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.738411:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x313993942505611b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c64 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.738454:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310675968:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.738516:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00002000:00010000:3.0:1746147142.743065:0:17600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147140 -> 1746147142 00002000:00010000:3.0:1746147142.743074:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147140 -> 1746147142 00002000:00010000:3.0:1746147142.743076:0:17600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147140 -> 1746147142 00000100:00100000:3.0:1746147142.743122:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310675968:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147142.743158:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x313993942505611b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c64 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.743173:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x313993942505611b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c64 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.743188:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbef400, rc 0) 00000100:00100000:3.0:1746147142.743245:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967307966208:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4859us (5342us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147142.743253:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14551 00000100:00100000:2.0:1746147142.743449:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.745389:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966336 00000100:00100000:3.0:1746147142.745400:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966336 00000100:00100000:3.0:1746147142.745460:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14552 00000100:00100000:3.0:1746147142.745468:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:32293:x1830967307966336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.745487:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.745507:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c6b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.745535:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.745543:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147142.745545:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147142.745548:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.745577:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.745589:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 26 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.745601:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310676096:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.745689:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.749159:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310676096:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.749200:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.749219:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:3.0:1746147142.749280:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:32293:x1830967307966336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3812us (5831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.749289:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14552 00000100:00100000:0.0:1746147142.749364:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.749414:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.749461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.749490:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966592 00000100:00100000:0.0:1746147142.749497:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966592 00000100:00100000:0.0:1746147142.749528:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966720 00000100:00100000:0.0:1746147142.749530:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966720 00000100:00100000:0.0:1746147142.749556:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14553 00000100:00100000:0.0:1746147142.749562:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967307966592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.749578:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.749593:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425056129 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c72 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.749640:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310676224:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.749673:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14554 00000100:00100000:2.0:1746147142.749682:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307966720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.749689:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.749698:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbefa00/0x3139939425056130 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c79 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.749700:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.749724:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310676352:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.749748:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.750007:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966464 00000100:00100000:1.0:1746147142.750012:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966464 00002000:00100000:1.0:1746147142.750040:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1159168->1638399) req@ffff8801349a2680 x1830967307966464/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.750048:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2680 with x1830967307966464 ext(1159168->1638399) 00010000:00010000:1.0:1746147142.750054:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 31 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.750066:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 31 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:1.0:1746147142.750073:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a2680 00000100:00100000:2.0:1746147142.750274:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1100 00000100:00100000:2.0:1746147142.750281:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307966464:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147142.758422:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310676224:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147142.758461:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425056129 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c72 expref: 32 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.758477:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425056129 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c72 expref: 32 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.758493:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd600, rc 0) 00000100:00100000:1.0:1746147142.758536:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307966592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8974us (10276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.758545:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14553 00000100:00100000:3.0:1746147142.758712:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310676352:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147142.758729:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbefa00/0x3139939425056130 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c79 expref: 30 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.758738:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbefa00/0x3139939425056130 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c79 expref: 30 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.758750:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbefa00, rc 0) 00000100:00100000:3.0:1746147142.758767:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307966720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9088us (9307us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147142.758773:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14554 00000100:00100000:0.0:1746147142.762674:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307966464:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12381us (13248us total) trans 21474841477 rc 0/0 00000100:00100000:0.0:1746147142.762688:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1100 00002000:00100000:0.0:1746147142.762700:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1159168->1638399) req@ffff8801349a2680 x1830967307966464/t21474841477(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/448 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.762710:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2680 with x1830967307966464 ext(1159168->1638399) 00010000:00010000:0.0:1746147142.762721:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.762737:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746147142.762744:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a2680 00000100:00100000:0.0:1746147142.765903:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.766175:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307966848 00000100:00100000:3.0:1746147142.766185:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307966848 00000100:00100000:3.0:1746147142.766245:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14555 00000100:00100000:3.0:1746147142.766254:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32288:x1830967307966848:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.766273:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.766292:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c80 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.766324:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.766332:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.766339:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.766350:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.766352:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.766355:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1024000->1048575] (req 1024000->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.766388:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.766398:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.766410:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310676480:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.767553:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.767567:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 11 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.767579:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310676608:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.767619:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.767626:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 10 pid: 12225 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.767639:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310676736:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.767656:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.767729:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.767775:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307967104 00000100:00100000:2.0:1746147142.767782:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307967104 00000100:00100000:2.0:1746147142.767817:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5468 00000100:00100000:2.0:1746147142.767824:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32285:x1830967307967104:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147142.767832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.767878:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307967232 00000100:00100000:2.0:1746147142.768007:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32285:x1830967307967104:12345-192.168.204.25@tcp:35:cat.0 Request processed in 182us (277us total) trans 8589935953 rc 0/0 00000100:00100000:0.0:1746147142.768009:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307967232 00000100:00100000:2.0:1746147142.768013:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5468 00010000:00010000:0.0:1746147142.768030:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.768050:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6366 00000100:00100000:0.0:1746147142.768056:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307967232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.768066:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.768200:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.768216:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.768235:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425056034 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1638399) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bed expref: 29 pid: 9585 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.768250:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.768252:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.768258:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 15 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.768265:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 15 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.769139:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 15 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.769154:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310676864:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147142.769215:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.770737:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310676480:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.770749:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310676608:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.770758:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310676736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.770789:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1024000->1048575] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.770805:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:3.0:1746147142.770856:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32288:x1830967307966848:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4601us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.770865:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14555 00000100:00100000:0.0:1746147142.773315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.773358:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.773570:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.773806:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307967360 00000100:00100000:2.0:1746147142.773815:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307967360 00010000:00010000:2.0:1746147142.773852:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 11 pid: 12225 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.773929:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307967616 00000100:00100000:3.0:1746147142.773941:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307967616 00010000:00010000:3.0:1746147142.773958:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 12 pid: 1398 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.773979:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307967488 00000100:00100000:3.0:1746147142.773981:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307967488 00010000:00010000:3.0:1746147142.773990:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.774013:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6367 00000100:00100000:3.0:1746147142.774020:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307967360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.774035:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.774056:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 11 pid: 12225 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774067:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 11 pid: 12225 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774121:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425055e82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77aff expref: 11 pid: 12225 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774144:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.774187:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307967360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 167us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.774194:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6367 00000100:00100000:3.0:1746147142.774210:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6368 00000100:00100000:3.0:1746147142.774215:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967307967616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.774221:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.774228:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 12 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774235:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 12 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774252:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425055f4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b4c expref: 12 pid: 1398 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774259:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.774287:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307967616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.774291:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6368 00000100:00100000:3.0:1746147142.774304:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6369 00000100:00100000:3.0:1746147142.774308:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307967488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.774314:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.774320:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774328:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774339:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56000/0x3139939425055f3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b3e expref: 32 pid: 9585 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.774347:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.774349:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.774357:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.774365:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.774395:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.774407:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310676992:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147142.774459:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.775055:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310676864:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147142.775071:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.775115:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967307967232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7058us (7282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.775122:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6366 00000100:00100000:0.0:1746147142.778009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.778108:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307967872 00000100:00100000:1.0:1746147142.778117:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307967872 00002000:00100000:1.0:1746147142.778160:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (1024000->1028095) req@ffff8801349a0e00 x1830967307967872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.778170:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0e00 with x1830967307967872 ext(1024000->1028095) 00002000:00010000:1.0:1746147142.778176:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0e00 00000100:00100000:1.0:1746147142.778197:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3479 00000100:00100000:1.0:1746147142.778204:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307967872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147142.778513:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310676992:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147142.778533:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.778769:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307967872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 564us (769us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147142.778776:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3479 00002000:00100000:1.0:1746147142.778781:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (1024000->1028095) req@ffff8801349a0e00 x1830967307967872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.778788:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0e00 with x1830967307967872 ext(1024000->1028095) 00002000:00010000:1.0:1746147142.778791:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0e00 00000100:00100000:3.0:1746147142.778840:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307967488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4530us (5269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.778849:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6369 00000100:00100000:0.0:1746147142.782387:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.782455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.782558:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307968128 00000100:00100000:1.0:1746147142.782568:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307968128 00002000:00100000:1.0:1746147142.782616:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801349a1500 x1830967307968128/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.782626:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1500 with x1830967307968128 ext(1048576->2097151) 00002000:00010000:1.0:1746147142.782633:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a1500 00000100:00100000:1.0:1746147142.782659:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307968384 00000100:00100000:1.0:1746147142.782661:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307968384 00002000:00100000:1.0:1746147142.782671:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801349a2a00 x1830967307968384/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 504/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.782677:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2a00 with x1830967307968384 ext(1048576->2097151) 00002000:00010000:1.0:1746147142.782680:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2a00 00000100:00100000:1.0:1746147142.782699:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3480 00000100:00100000:1.0:1746147142.782706:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307968128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.782836:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3481 00000100:00100000:2.0:1746147142.782844:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307968384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.783295:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.783460:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307968512 00000100:00100000:3.0:1746147142.783465:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307968512 00000100:00100000:3.0:1746147142.783498:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14556 00000100:00100000:3.0:1746147142.783503:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32288:x1830967307968512:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147142.783514:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.783533:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c87 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.783558:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.783567:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.783569:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147142.783572:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->1634303] (req 1048576->1634303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.783609:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.783621:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 18 pid: 17600 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.783633:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310677120:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.783690:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.793123:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967307968384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10240us (10627us total) trans 0 rc 811008/811008 00000100:00100000:2.0:1746147142.793137:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3481 00002000:00100000:2.0:1746147142.793149:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801349a2a00 x1830967307968384/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 504/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.793158:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2a00 with x1830967307968384 ext(1048576->2097151) 00002000:00010000:2.0:1746147142.793164:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2a00 00000100:00100000:3.0:1746147142.793797:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310677120:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.793827:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->1634303] (req 1048576->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.793845:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05a00, rc 0) 00000100:00100000:3.0:1746147142.793868:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32288:x1830967307968512:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10365us (10574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.793875:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14556 00000100:00100000:1.0:1746147142.794915:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967307968128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12204us (12537us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147142.794924:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3480 00002000:00100000:1.0:1746147142.794941:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801349a1500 x1830967307968128/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.794950:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1500 with x1830967307968128 ext(1048576->2097151) 00010000:00010000:1.0:1746147142.794958:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.794971:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 780 lvb_type: 0 00002000:00010000:1.0:1746147142.794977:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a1500 00000100:00100000:3.0:1746147142.803895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.803983:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307968640 00000100:00100000:0.0:1746147142.803992:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307968640 00010000:00010000:0.0:1746147142.804030:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.804068:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6370 00000100:00100000:0.0:1746147142.804076:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967307968640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.804108:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.804129:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.804140:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.804162:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425056122 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c6b expref: 16 pid: 17600 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.804192:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.804194:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.804201:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.804209:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.804301:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.804319:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310677248:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147142.804423:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.806683:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310677248:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147142.806705:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.806768:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307968640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2692us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.806781:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6370 00000100:00100000:0.0:1746147142.807862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.807900:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.807929:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307968896 00000100:00100000:1.0:1746147142.807943:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307968896 00000100:00100000:2.0:1746147142.807987:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307969152 00000100:00100000:2.0:1746147142.807991:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307969152 00002000:00100000:1.0:1746147142.807991:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801349a3480 x1830967307968896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.808000:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3480 with x1830967307968896 ext(2097152->4194303) 00002000:00010000:1.0:1746147142.808005:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3480 00002000:00100000:2.0:1746147142.808010:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a2300 x1830967307969152/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.808019:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967307969152 ext(2097152->4194303) 00000100:00100000:1.0:1746147142.808019:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3482 00002000:00010000:2.0:1746147142.808023:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2300 00000100:00100000:1.0:1746147142.808024:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307968896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.808037:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3483 00000100:00100000:2.0:1746147142.808042:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307969152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.813572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.813611:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307969408 00000100:00100000:0.0:1746147142.813621:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307969408 00002000:00100000:0.0:1746147142.813670:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1630208->1634303) req@ffff880093145c00 x1830967307969408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.813680:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145c00 with x1830967307969408 ext(1630208->1634303) 00002000:00010000:0.0:1746147142.813685:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093145c00 00000100:00100000:0.0:1746147142.813705:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3484 00000100:00100000:0.0:1746147142.813714:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307969408:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147142.813837:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307969408:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 123us (277us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147142.813844:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3484 00002000:00100000:0.0:1746147142.813849:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1630208->1634303) req@ffff880093145c00 x1830967307969408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.813856:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145c00 with x1830967307969408 ext(1630208->1634303) 00002000:00010000:0.0:1746147142.813858:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093145c00 00000100:00100000:1.0:1746147142.826898:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307968896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18859us (19027us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147142.826913:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3482 00002000:00100000:1.0:1746147142.826925:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801349a3480 x1830967307968896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.826943:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3480 with x1830967307968896 ext(2097152->4194303) 00002000:00010000:1.0:1746147142.826949:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3480 00000100:00100000:2.0:1746147142.837572:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307969152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29517us (29659us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147142.837586:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3483 00002000:00100000:2.0:1746147142.837598:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a2300 x1830967307969152/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.837607:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967307969152 ext(2097152->4194303) 00002000:00010000:2.0:1746147142.837614:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2300 00000100:00100000:0.0:1746147142.847388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.848694:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307969536 00000100:00100000:2.0:1746147142.848706:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307969536 00000100:00100000:2.0:1746147142.848763:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15268 00000100:00100000:2.0:1746147142.848771:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:32297:x1830967307969536:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147142.849187:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.849208:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x3139939425056145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c8e expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.849270:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849283:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849293:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849306:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849311:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849316:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849382:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849390:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.849398:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.849427:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.849439:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 35 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.849450:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310677376:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.850691:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.851615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.851867:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.853074:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307969664 00000100:00100000:3.0:1746147142.853084:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307969664 00000100:00100000:3.0:1746147142.853135:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307969792 00000100:00100000:3.0:1746147142.853137:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307969792 00000100:00100000:3.0:1746147142.853164:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14557 00000100:00100000:3.0:1746147142.853171:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307969664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.853193:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.853212:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094008200/0x3139939425056161 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c95 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.853264:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310677504:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.853280:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14558 00000100:00100000:0.0:1746147142.853287:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307969792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147142.853295:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.853307:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056168 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77c9c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.853332:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310677632:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147142.853342:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.853353:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.856723:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310677376:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.856750:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147142.856864:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310677632:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147142.856890:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056168 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c9c expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.856904:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056168 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c9c expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.856924:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:1.0:1746147142.856992:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307969792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3704us (5123us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.857000:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14558 00002000:00010000:3.0:1746147142.857182:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147139 -> 1746147142 00002000:00010000:3.0:1746147142.857186:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147140 -> 1746147142 00002000:00010000:3.0:1746147142.857188:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147139 -> 1746147142 00000100:00100000:3.0:1746147142.857200:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310677504:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147142.857219:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094008200/0x3139939425056161 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c95 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.857228:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094008200/0x3139939425056161 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c95 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.857239:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008200, rc 0) 00000100:00100000:3.0:1746147142.857270:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307969664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4100us (5659us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147142.857276:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14557 00000100:00100000:2.0:1746147142.857727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.857755:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307970048 00000100:00100000:0.0:1746147142.857763:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307970048 00000100:00100000:0.0:1746147142.857809:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5469 00000100:00100000:0.0:1746147142.857816:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:30601:x1830967307970048:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147142.859040:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:30601:x1830967307970048:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 1220us (1309us total) trans 8589935954 rc 0/0 00000100:00100000:0.0:1746147142.859049:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5469 00000100:00100000:0.0:1746147142.861195:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.861258:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307970304 00000100:00100000:2.0:1746147142.861269:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307970304 00002000:00100000:2.0:1746147142.861424:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8801349a3b80 x1830967307970304/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.861435:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3b80 with x1830967307970304 ext(4194304->4919295) 00002000:00010000:2.0:1746147142.861443:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3b80 00000100:00100000:2.0:1746147142.861476:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3485 00000100:00100000:2.0:1746147142.861484:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307970304:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.864282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.864960:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307970432 00000100:00100000:2.0:1746147142.864974:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307970432 00010000:00010000:2.0:1746147142.865012:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 37 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.865047:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6371 00000100:00100000:2.0:1746147142.865055:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307970432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.865069:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.865074:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 37 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.865086:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 37 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.865140:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425055f46 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b45 expref: 37 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.865161:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.865165:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.865175:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.865182:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.865201:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147142.865212:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865219:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147142.865235:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967307970432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 180us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.865240:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6371 00000004:00200000:3.0:1746147142.865271:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147142.865276:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147142.865293:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865302:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865311:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865317:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865323:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865329:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbee600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.865333:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865339:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865347:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147142.865350:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.865353:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865358:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505614c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865371:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865376:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865382:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865385:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeec00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147142.865387:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865391:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865397:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800932c2800) 00010000:00010000:3.0:1746147142.865398:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147142.865400:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865405:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeec00/0x3139939425056153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.865435:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x3139939425056145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.865447:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.865452:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.865454:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147142.865456:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee800, rc 0) 00000100:00100000:3.0:1746147142.865484:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32297:x1830967307969536:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 16713us (18106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.865490:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15268 00000100:00100000:0.0:1746147142.869733:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307970304:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8237us (8533us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147142.869745:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3485 00002000:00100000:0.0:1746147142.869757:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8801349a3b80 x1830967307970304/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.869767:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3b80 with x1830967307970304 ext(4194304->4919295) 00002000:00010000:0.0:1746147142.869773:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3b80 00000100:00100000:2.0:1746147142.869916:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.870227:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307970688 00000100:00100000:0.0:1746147142.870234:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307970688 00000100:00100000:0.0:1746147142.870284:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15269 00000100:00100000:0.0:1746147142.870292:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:32299:x1830967307970688:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147142.870312:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.870331:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942505616f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ca3 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.870407:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870419:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870430:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870440:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870445:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870451:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870552:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870562:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870568:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147142.870575:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147142.870651:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870659:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870663:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870668:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147142.870672:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870678:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870688:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147142.870691:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147142.870694:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870699:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425056176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870721:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870726:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870731:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870735:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147142.870737:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870746:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870751:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800958e2900) 00010000:00010000:0.0:1746147142.870753:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147142.870755:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870760:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505617d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.870792:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942505616f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 20 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.870802:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.870809:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.870810:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147142.870812:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:0.0:1746147142.871816:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:32299:x1830967307970688:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1517us (1893us total) trans 8589935955 rc 0/0 00000100:00100000:0.0:1746147142.871826:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15269 00000100:00100000:3.0:1746147142.871842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.871863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.871865:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307970816 00000100:00100000:2.0:1746147142.871870:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307970816 00000100:00100000:3.0:1746147142.871875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.871890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.871906:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307970944 00000100:00100000:2.0:1746147142.871907:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971200 00000100:00100000:0.0:1746147142.871907:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971072 00000100:00100000:2.0:1746147142.871910:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971200 00000100:00100000:1.0:1746147142.871910:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307970944 00000100:00100000:0.0:1746147142.871911:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971072 00000100:00100000:3.0:1746147142.871917:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14559 00000100:00100000:3.0:1746147142.871924:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307970816:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147142.871929:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14560 00000100:00100000:2.0:1746147142.871942:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307971200:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147142.871943:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.871948:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147142.871951:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14561 00010000:00010000:3.0:1746147142.871956:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094009c00/0x3139939425056192 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77caa expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.871956:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cbf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.871957:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14562 00000100:00100000:0.0:1746147142.871958:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307971072:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147142.871962:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307970944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147142.871968:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.871969:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.871975:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.871977:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.871981:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x31399394250561a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cb1 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.871983:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250561a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cb8 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.871986:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.872001:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147142.872004:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310677760:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147142.872009:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212200, rc 0) 00000100:00100000:1.0:1746147142.872009:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310677888:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.872016:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310678016:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.872035:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307971200:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 101us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.872040:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14560 00000100:00100000:3.0:1746147142.872055:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.872055:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.872060:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.872703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.872761:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971328 00000100:00100000:1.0:1746147142.872766:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971328 00000100:00100000:1.0:1746147142.873085:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14563 00000100:00100000:1.0:1746147142.873116:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307971328:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147142.873126:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.873141:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cc6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.873158:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.873160:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.873167:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.873184:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.873194:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1a00, rc 0) 00000100:00100000:1.0:1746147142.873226:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967307971328:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 111us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.873232:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14563 00000100:00100000:2.0:1746147142.875255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.875718:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971456 00000100:00100000:1.0:1746147142.875727:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971456 00000100:00100000:1.0:1746147142.875778:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14564 00000100:00100000:1.0:1746147142.875786:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307971456:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.875804:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.875823:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x31399394250561b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ccd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.875877:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310678144:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147142.875968:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147142.876179:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.876306:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971584 00000100:00100000:2.0:1746147142.876310:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971584 00000100:00100000:2.0:1746147142.876332:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14565 00000100:00100000:2.0:1746147142.876337:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307971584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.876345:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.876355:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f213800/0x31399394250561bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cd4 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.876383:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310678272:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.876412:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.881975:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310677760:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147142.882018:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094009c00/0x3139939425056192 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77caa expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.882033:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094009c00/0x3139939425056192 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77caa expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.882043:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009c00, rc 0) 00000100:00100000:0.0:1746147142.882113:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307970816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10188us (10269us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147142.882122:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14559 00000100:00100000:1.0:1746147142.882291:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310677888:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147142.882313:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x31399394250561a0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cb1 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147142.882319:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310678272:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147142.882322:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x31399394250561a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cb1 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.882337:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f213800/0x31399394250561bc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cd4 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.882345:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f213800/0x31399394250561bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cd4 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.882350:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0800, rc 0) 00010000:00010000:2.0:1746147142.882358:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f213800, rc 0) 00000100:00100000:2.0:1746147142.882373:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967307971584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6036us (6195us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.882373:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307970944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10411us (10508us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.882379:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14562 00000100:00100000:2.0:1746147142.882382:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14565 00000100:00100000:1.0:1746147142.882411:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310678144:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147142.882426:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x31399394250561b5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ccd expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.882434:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0000/0x31399394250561b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ccd expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147142.882441:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0000, rc 0) 00000100:00100000:0.0:1746147142.882456:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310678016:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147142.882457:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+11:2002:x1830967307971456:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6672us (7214us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.882462:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14564 00010000:00010000:0.0:1746147142.882472:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250561a7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cb8 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.882480:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250561a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cb8 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.882486:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32200, rc 0) 00000100:00100000:0.0:1746147142.882501:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307971072:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10544us (10624us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147142.882509:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14561 00000100:00100000:0.0:1746147142.885997:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.886086:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971712 00000100:00100000:2.0:1746147142.886118:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971712 00000100:00100000:2.0:1746147142.886182:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14566 00000100:00100000:2.0:1746147142.886190:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32299:x1830967307971712:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147142.886209:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.886233:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cdb expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.886270:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.886279:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.886286:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.886292:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.886293:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.886297:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2945024->3145727] (req 2945024->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.886331:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.886344:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.886358:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310678400:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.886469:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.886477:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 10 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746147142.886486:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310678528:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.886513:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.886522:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 30 pid: 9584 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.886530:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310678656:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.886549:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.890200:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.890248:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971840 00000100:00100000:0.0:1746147142.890254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.890258:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971840 00000100:00100000:2.0:1746147142.890303:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307971968 00000100:00100000:2.0:1746147142.890306:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307971968 00000100:00100000:2.0:1746147142.890354:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14567 00000100:00100000:2.0:1746147142.890363:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307971968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.890382:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.890405:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6000/0x31399394250561ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ce9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.890460:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310678784:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.890541:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147142.890597:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14568 00000100:00100000:1.0:1746147142.890602:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307971840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.890609:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.890618:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e1800/0x31399394250561d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ce2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.890644:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310678912:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147142.891228:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.894615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.894698:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.894744:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.894788:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310678784:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.894803:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307972352 00000100:00100000:0.0:1746147142.894810:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307972352 00010000:00010000:2.0:1746147142.894829:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6000/0x31399394250561ca lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ce9 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.894841:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 11 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746147142.894843:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6000/0x31399394250561ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ce9 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.894859:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6000, rc 0) 00000100:00100000:0.0:1746147142.894869:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6372 00000100:00100000:0.0:1746147142.894876:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967307972352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.894889:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.894902:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 11 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.894911:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 11 pid: 9586 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.894943:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.894944:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307972224 00000100:00100000:1.0:1746147142.894949:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307972224 00000100:00100000:3.0:1746147142.895021:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310678400:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.895032:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x3139939425056199 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cbf expref: 11 pid: 9586 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746147142.895049:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310678528:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147142.895065:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310678656:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147142.895105:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2945024->3145727] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.895113:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212600, rc 0) 00000100:00100000:2.0:1746147142.895696:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307971968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5332us (5439us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147142.895700:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307972352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 818us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.895703:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14567 00000100:00100000:0.0:1746147142.895706:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6372 00000100:00100000:0.0:1746147142.895830:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307972608 00000100:00100000:0.0:1746147142.895834:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307972608 00000100:00100000:1.0:1746147142.895846:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15270 00000100:00100000:1.0:1746147142.895854:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32297:x1830967307972224:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147142.895861:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15271 00000100:00100000:0.0:1746147142.895867:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32302:x1830967307972608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147142.895871:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.895878:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.895886:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0200/0x31399394250561d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cf0 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.895886:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250561df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cf7 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.895988:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.896004:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.896011:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.896017:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.896037:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147142.896047:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.896047:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896056:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147142.896057:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 18 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.896067:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147142.896068:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310679040:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147142.896072:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896077:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147142.896139:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.896147:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 8 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746147142.896155:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310679168:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147142.896169:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250561fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147142.896172:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc240 going to sleep for 11 seconds 00010000:00010000:0.0:1746147142.896176:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250561fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896181:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250561fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147142.896189:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:2.0:1746147142.896245:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.896263:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307972736 00000100:00100000:2.0:1746147142.896266:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307972736 00010000:00010000:0.0:1746147142.896266:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896272:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896277:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147142.896279:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.896283:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896287:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147142.896290:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147142.896294:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6373 00010000:00010000:0.0:1746147142.896297:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147142.896300:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307972736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.896306:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147142.896309:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.896309:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147142.896312:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896316:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250561ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147142.896320:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.896324:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147142.896328:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.896340:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x3139939425056088 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c25 expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.896348:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.896361:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307972736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.896366:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6373 00000100:00100000:3.0:1746147142.896469:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:32299:x1830967307971712:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10279us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.896478:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14566 00010000:00010000:0.0:1746147142.896549:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896554:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896562:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147142.896565:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896570:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896577:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800958e2d00) 00010000:00010000:0.0:1746147142.896579:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147142.896582:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896586:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x31399394250561f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147142.896619:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33000/0x31399394250561df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf7 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.896628:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250561fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf7 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.896633:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.896635:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147142.896637:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:0.0:1746147142.896672:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32302:x1830967307972608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 805us (1927us total) trans 8589935956 rc 0/0 00000100:00100000:0.0:1746147142.896677:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15271 00000100:00100000:0.0:1746147142.896769:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310678912:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147142.896792:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1800/0x31399394250561d1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ce2 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.896801:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1800/0x31399394250561d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ce2 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.896809:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1800, rc 0) 00000100:00100000:0.0:1746147142.896827:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307971840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6225us (6641us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147142.896832:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14568 00000100:00100000:0.0:1746147142.899986:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.900069:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.900210:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310679040:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.900222:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310679168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.900249:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147142.900309:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307972864 00000100:00100000:2.0:1746147142.900317:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307972864 00000100:00100000:0.0:1746147142.900333:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.900370:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307973120 00000100:00100000:0.0:1746147142.900374:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307973120 00010000:00010000:0.0:1746147142.900394:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 9 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.900420:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307972992 00000100:00100000:0.0:1746147142.900422:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307972992 00010000:00010000:0.0:1746147142.900437:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 19 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.900452:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6374 00000100:00100000:2.0:1746147142.900465:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307973120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.900482:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.900488:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 9 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.900498:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 9 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746147142.900504:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6375 00000100:00100000:0.0:1746147142.900512:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967307972992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147142.900513:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 810 00000100:00100000:3.0:1746147142.900521:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967307972864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.900521:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.900522:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505615a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c8e expref: 9 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.900525:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 19 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.900528:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.900538:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250561fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf7 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.900539:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.900544:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.900552:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.900557:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147142.900559:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 19 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.900565:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147142.900568:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.900574:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147142.900578:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147142.900584:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425056184 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ca3 expref: 19 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.900591:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147142.900594:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147142.900598:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967307972864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.900599:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967307973120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 139us (528us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147142.900600:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147142.900605:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6374 00010000:00010000:0.0:1746147142.900607:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147142.900633:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147142.900648:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307972992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 138us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.900654:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6375 00010000:00010000:1.0:1746147142.900778:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.900785:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147142.900805:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147142.900974:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0200/0x31399394250561d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.900994:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.901000:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147142.901003:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147142.901006:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0a00, rc 0) 00000100:00100000:1.0:1746147142.901039:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32297:x1830967307972224:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5186us (6435us total) trans 8589935957 rc 0/0 00000100:00100000:1.0:1746147142.901047:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15270 00000100:00100000:3.0:1746147142.901338:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 810 00000100:00100000:0.0:1746147142.902486:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.902522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.903333:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.903358:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307973632 00000100:00100000:0.0:1746147142.903366:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307973632 00000100:00100000:2.0:1746147142.903453:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307973248 00000100:00100000:2.0:1746147142.903457:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307973248 00000100:00100000:2.0:1746147142.903482:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307973376 00000100:00100000:2.0:1746147142.903484:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307973376 00000100:00100000:3.0:1746147142.903493:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14569 00000100:00100000:3.0:1746147142.903507:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307973248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147142.903528:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147142.903537:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14570 00000100:00100000:2.0:1746147142.903543:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307973376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.903551:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147142.903555:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425056210 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77cfe expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.903559:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425056217 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d05 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.903577:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.903586:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425056217 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d05 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.903595:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6200/0x3139939425056217 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d05 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147142.903606:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310679296:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147142.903610:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6200, rc 0) 00000100:00100000:2.0:1746147142.903646:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307973376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 102us (1122us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147142.903652:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14570 00000100:00100000:0.0:1746147142.903975:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5470 00000100:00100000:0.0:1746147142.903984:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:32293:x1830967307973632:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147142.904340:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.904512:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:32293:x1830967307973632:12345-192.168.204.25@tcp:35:cat.0 Request processed in 529us (1179us total) trans 8589935958 rc 0/0 00000100:00100000:0.0:1746147142.904518:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5470 00000100:00100000:0.0:1746147142.907146:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.907218:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307973760 00000100:00100000:1.0:1746147142.907227:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307973760 00000100:00100000:1.0:1746147142.907274:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15272 00000100:00100000:1.0:1746147142.907281:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32297:x1830967307973760:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147142.907309:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.907330:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x313993942505621e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d0c expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.907430:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.907446:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.907453:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.907485:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.907498:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 9 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746147142.907510:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310679424:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.908178:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.909894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.910005:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310679296:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147142.910040:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425056210 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cfe expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.910056:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425056210 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cfe expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147142.910081:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008e00, rc 0) 00000100:00100000:3.0:1746147142.910150:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307973248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6644us (7667us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147142.910158:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14569 00000100:00100000:0.0:1746147142.910234:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307973888 00000100:00100000:0.0:1746147142.910240:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307973888 00010000:00010000:0.0:1746147142.910267:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746147142.910290:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6376 00000100:00100000:0.0:1746147142.910296:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967307973888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147142.910309:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147142.910323:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.910332:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.910349:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95000/0x3139939425056114 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c56 expref: 12 pid: 1136 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746147142.910360:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.910362:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.910369:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.910376:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.910408:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.910418:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310679552:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147142.910464:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.913146:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310679552:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147142.913172:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147142.913230:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967307973888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2932us (3343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.913241:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6376 00000100:00100000:1.0:1746147142.913314:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310679424:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147142.913334:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147142.915976:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.916047:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307974016 00000100:00100000:2.0:1746147142.916056:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307974016 00010000:00010000:2.0:1746147142.916112:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 10 pid: 6215 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.916147:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6377 00000100:00100000:2.0:1746147142.916155:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307974016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.916171:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.916177:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 10 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.916190:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 10 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.916213:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0a00/0x31399394250561e6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cf0 expref: 10 pid: 6215 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.916227:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147142.916232:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.916242:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.916249:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147142.916892:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147142.916911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.916943:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307974272 00000100:00100000:0.0:1746147142.916947:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307974272 00002000:00100000:0.0:1746147142.916984:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2945024->2949119) req@ffff88009c309880 x1830967307974272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.916994:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309880 with x1830967307974272 ext(2945024->2949119) 00002000:00010000:0.0:1746147142.916999:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c309880 00000100:00100000:2.0:1746147142.917007:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967307974016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 853us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.917018:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6377 00010000:00010000:1.0:1746147142.917200:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.917208:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147142.917258:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147142.917263:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147142.917280:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.917311:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x313993942505621e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.917340:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.917346:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147142.917349:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147142.917351:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0c00, rc 0) 00000100:00100000:1.0:1746147142.917377:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32297:x1830967307973760:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10097us (10242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.917383:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15272 00000100:00100000:0.0:1746147142.917524:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3486 00000100:00100000:0.0:1746147142.917531:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307974272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.917635:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967307974272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 104us (725us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147142.917640:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3486 00002000:00100000:0.0:1746147142.917645:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2945024->2949119) req@ffff88009c309880 x1830967307974272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.917652:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309880 with x1830967307974272 ext(2945024->2949119) 00002000:00010000:0.0:1746147142.917655:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c309880 00000100:00100000:0.0:1746147142.922612:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.922641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.922680:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.922781:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.923111:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307974912 00000100:00100000:2.0:1746147142.923121:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307974912 00000100:00100000:2.0:1746147142.923161:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975040 00000100:00100000:2.0:1746147142.923162:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975040 00000100:00100000:2.0:1746147142.923179:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14571 00000100:00100000:2.0:1746147142.923187:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307974912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147142.923209:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.923231:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7000/0x313993942505622c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d13 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.923289:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310679680:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.923365:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.923390:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14572 00000100:00100000:2.0:1746147142.923396:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307975040:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147142.923404:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.923415:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x3139939425056233 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d1a expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147142.923444:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310679808:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147142.923463:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.923480:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307974784 00000100:00100000:2.0:1746147142.923482:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307974784 00002000:00100000:2.0:1746147142.923508:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1023999) req@ffff88009c30b480 x1830967307974784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.923518:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b480 with x1830967307974784 ext(0->1023999) 00002000:00010000:2.0:1746147142.923522:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30b480 00000100:00100000:2.0:1746147142.923541:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307974656 00000100:00100000:2.0:1746147142.923544:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307974656 00002000:00100000:2.0:1746147142.923557:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1634304->2097151) req@ffff88009c309f80 x1830967307974656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.923564:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309f80 with x1830967307974656 ext(1634304->2097151) 00002000:00010000:2.0:1746147142.923567:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c309f80 00000100:00100000:2.0:1746147142.923578:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3487 00000100:00100000:2.0:1746147142.923583:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307974784:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147142.923781:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3488 00000100:00100000:1.0:1746147142.923789:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307974656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147142.926356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.927469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.927484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.927507:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975168 00000100:00100000:0.0:1746147142.927514:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975168 00000100:00100000:0.0:1746147142.927545:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975296 00000100:00100000:0.0:1746147142.927546:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975296 00000100:00100000:0.0:1746147142.927558:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975424 00000100:00100000:0.0:1746147142.927559:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975424 00000100:00100000:0.0:1746147142.927573:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14573 00000100:00100000:0.0:1746147142.927580:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307975168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147142.927595:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.927611:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x313993942505623a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d21 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.927655:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310679936:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.927715:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.927826:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14574 00000100:00100000:0.0:1746147142.927831:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307975296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147142.927839:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.927848:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425056241 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d28 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147142.927869:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310680064:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147142.927893:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.927907:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14575 00000100:00100000:0.0:1746147142.927911:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:32299:x1830967307975424:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147142.927917:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147142.927925:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d2f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.927954:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.927961:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.927967:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.927973:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.927975:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147142.927977:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->2162687] (req 2097152->2162687) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147142.927991:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.928002:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 16 pid: 9585 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746147142.928013:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680192:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.928199:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310679680:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147142.928233:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7000/0x313993942505622c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d13 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.928246:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7000/0x313993942505622c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d13 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147142.928258:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7000, rc 0) 00000100:00100000:2.0:1746147142.928285:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967307974912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5098us (5604us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147142.928293:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14571 00010000:00010000:0.0:1746147142.928307:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.928315:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 12 pid: 1853 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746147142.928323:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680320:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.928339:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310679808:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147142.928357:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.928359:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x3139939425056233 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d1a expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.928365:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 30 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.928369:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x3139939425056233 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d1a expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147142.928373:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.928377:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7800, rc 0) 00000100:00100000:0.0:1746147142.928387:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.928398:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307975040:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5002us (5616us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147142.928404:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14572 00000100:00100000:0.0:1746147142.934654:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310679936:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147142.934691:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x313993942505623a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d21 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.934706:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x313993942505623a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d21 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.934778:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212800, rc 0) 00000100:00100000:0.0:1746147142.934821:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307975168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7241us (8471us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147142.934831:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14573 00000100:00100000:0.0:1746147142.934900:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310680064:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147142.934913:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425056241 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d28 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.934922:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425056241 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d28 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147142.934940:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212a00, rc 0) 00000100:00100000:0.0:1746147142.934954:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307975296:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7124us (7487us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147142.934959:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14574 00000100:00100000:0.0:1746147142.935010:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680192:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147142.935223:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147142.935231:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680448:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147142.935239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147142.935248:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->2162687] (req 2097152->2162687) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.935271:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.935289:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975552 00000100:00100000:1.0:1746147142.935295:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.935296:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975552 00000100:00100000:1.0:1746147142.935311:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975808 00000100:00100000:1.0:1746147142.935313:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975808 00010000:00010000:3.0:1746147142.935321:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 9 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.935325:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 17 pid: 9585 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746147142.935339:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307975680 00000100:00100000:1.0:1746147142.935341:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307975680 00010000:00010000:1.0:1746147142.935349:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746147142.935351:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6378 00000100:00100000:3.0:1746147142.935357:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967307975552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147142.935361:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6379 00000100:00100000:1.0:1746147142.935365:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967307975808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147142.935369:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147142.935370:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147142.935379:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 9 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.935379:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 17 pid: 9585 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.935388:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 17 pid: 9585 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.935398:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 9 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746147142.935416:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x313993942505610d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c5d expref: 17 pid: 9585 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.935421:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x31399394250561ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cc6 expref: 9 pid: 1853 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746147142.935437:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147142.935437:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147142.935456:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307975808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 90us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.935457:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2002:x1830967307975552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147142.935461:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6379 00000100:00100000:3.0:1746147142.935464:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6378 00000100:00100000:1.0:1746147142.935472:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6380 00000100:00100000:1.0:1746147142.935476:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307975680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147142.935482:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147142.935488:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.935497:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.935508:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x313993942505608f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c2c expref: 31 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746147142.935515:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.935517:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147142.935523:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.935530:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.935554:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147142.935565:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310680576:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147142.935569:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7c00, rc 0) 00000100:00100000:0.0:1746147142.935584:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:32299:x1830967307975424:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7673us (8099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.935590:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14575 00000100:00100000:1.0:1746147142.935619:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147142.936854:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307974656:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13061us (14206us total) trans 0 rc 462848/462848 00000100:00100000:2.0:1746147142.936864:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3488 00002000:00100000:2.0:1746147142.936874:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1634304->2097151) req@ffff88009c309f80 x1830967307974656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 462848/462848 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147142.936883:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309f80 with x1830967307974656 ext(1634304->2097151) 00002000:00010000:2.0:1746147142.936888:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c309f80 00000100:00100000:2.0:1746147142.945285:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.945352:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307976320 00000100:00100000:1.0:1746147142.945361:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307976320 00000100:00100000:1.0:1746147142.945414:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15273 00000100:00100000:1.0:1746147142.945422:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32297:x1830967307976320:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147142.945442:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147142.945462:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x313993942505624f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d36 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.945561:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945575:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945585:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945595:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945601:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945606:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945610:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147142.945614:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945619:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945629:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147142.945631:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147142.945635:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945643:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056256 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147142.945666:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x313993942505624f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d36 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.945672:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x313993942505624f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d36 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147142.945679:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:1.0:1746147142.945719:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32297:x1830967307976320:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 298us (443us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147142.945724:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15273 00000100:00100000:1.0:1746147142.946350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.946370:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307976064 00000100:00100000:2.0:1746147142.946375:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307976064 00002000:00100000:2.0:1746147142.946402:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2158592->2162687) req@ffff8801312e9c00 x1830967307976064/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147142.946403:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307974784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22817us (23804us total) trans 0 rc 1024000/1024000 00000100:00100000:3.0:1746147142.946411:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3487 00002000:00100000:2.0:1746147142.946412:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9c00 with x1830967307976064 ext(2158592->2162687) 00002000:00010000:2.0:1746147142.946416:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e9c00 00002000:00100000:3.0:1746147142.946417:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1023999) req@ffff88009c30b480 x1830967307974784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1024000/1024000 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.946424:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b480 with x1830967307974784 ext(0->1023999) 00002000:00010000:3.0:1746147142.946428:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30b480 00000100:00100000:2.0:1746147142.946429:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3489 00000100:00100000:2.0:1746147142.946434:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307976064:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147142.946538:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307976064:12345-192.168.204.25@tcp:3:cat.0 Request processed in 103us (187us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147142.946543:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3489 00002000:00100000:2.0:1746147142.946547:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2158592->2162687) req@ffff8801312e9c00 x1830967307976064/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/4536 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147142.946550:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310680576:192.168.204.25@tcp:105: 00002000:00100000:2.0:1746147142.946555:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9c00 with x1830967307976064 ext(2158592->2162687) 00002000:00010000:2.0:1746147142.946557:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e9c00 00010000:00010000:0.0:1746147142.946570:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147142.946592:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967307975680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11115us (11295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147142.946600:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6380 00000100:00100000:0.0:1746147142.951556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147142.951637:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147142.951852:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307976576 00000100:00100000:1.0:1746147142.951862:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307976576 00000100:00100000:2.0:1746147142.951864:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307976832 00000100:00100000:2.0:1746147142.951868:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307976832 00000100:00100000:1.0:1746147142.951919:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5471 00000100:00100000:2.0:1746147142.951926:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5472 00000100:00100000:1.0:1746147142.951927:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f89850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32297:x1830967307976576:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147142.951942:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:32299:x1830967307976832:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147142.952627:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:32299:x1830967307976832:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 693us (988us total) trans 8589935960 rc 0/0 00000100:00100000:1.0:1746147142.952628:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f89850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32297:x1830967307976576:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 699us (1081us total) trans 8589935959 rc 0/0 00000100:00100000:1.0:1746147142.952635:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5471 00000100:00100000:2.0:1746147142.952639:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5472 00000100:00100000:0.0:1746147142.960222:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.960816:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307976960 00000100:00100000:2.0:1746147142.960828:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307976960 00000100:00100000:2.0:1746147142.960893:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14576 00000100:00100000:2.0:1746147142.960903:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32302:x1830967307976960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147142.960939:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147142.960962:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d3d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.961004:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.961013:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147142.961016:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147142.961019:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.961059:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.961073:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 14 pid: 9584 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.961110:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680704:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147142.961234:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.964175:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.964279:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977088 00000100:00100000:3.0:1746147142.964289:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977088 00000100:00100000:2.0:1746147142.964302:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680704:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147142.964342:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.964370:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6200, rc 0) 00000100:00100000:2.0:1746147142.964423:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32302:x1830967307976960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3521us (4211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147142.964433:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14576 00002000:00100000:3.0:1746147142.964513:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1110016->1347583) req@ffff88009cd46680 x1830967307977088/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.964523:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46680 with x1830967307977088 ext(1110016->1347583) 00010000:00010000:3.0:1746147142.964530:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 15 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746147142.964543:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 15 pid: 9584 timeout: 780 lvb_type: 0 00002000:00010000:3.0:1746147142.964551:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd46680 00000100:00100000:3.0:1746147142.964569:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1101 00000100:00100000:3.0:1746147142.964577:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307977088:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147142.970295:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307977088:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5703us (6120us total) trans 21474841478 rc 0/0 00000100:00100000:0.0:1746147142.970310:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1101 00002000:00100000:0.0:1746147142.970327:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1110016->1347583) req@ffff88009cd46680 x1830967307977088/t21474841478(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:518/0 lens 488/448 e 0 to 0 dl 1746147153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147142.970338:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46680 with x1830967307977088 ext(1110016->1347583) 00010000:00010000:0.0:1746147142.970351:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 17 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746147142.970371:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 17 pid: 9584 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746147142.970379:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd46680 00000100:00100000:0.0:1746147142.976266:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147142.976861:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977216 00000100:00100000:2.0:1746147142.976872:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977216 00010000:00010000:2.0:1746147142.976915:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 17 pid: 9584 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746147142.976969:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6381 00000100:00100000:2.0:1746147142.976979:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967307977216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147142.977005:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147142.977027:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 17 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.977040:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 17 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.977063:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x31399394250560dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1347583) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c41 expref: 17 pid: 9584 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746147142.977121:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.977123:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147142.977130:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147142.977142:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147142.978965:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147142.978988:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310680832:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147142.979129:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147142.983801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147142.984232:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310680832:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147142.984255:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147142.984300:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967307977216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7322us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147142.984310:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6381 00000100:00100000:1.0:1746147142.984997:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977472 00000100:00100000:1.0:1746147142.985004:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977472 00002000:00100000:1.0:1746147142.985044:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009cd45c00 x1830967307977472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/0 e 0 to 0 dl 1746147153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147142.985052:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45c00 with x1830967307977472 ext(1048576->2097151) 00002000:00010000:1.0:1746147142.985057:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd45c00 00000100:00100000:2.0:1746147142.985895:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3490 00000100:00100000:2.0:1746147142.985910:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307977472:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147142.999331:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307977472:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13410us (15524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147142.999345:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3490 00002000:00100000:3.0:1746147142.999358:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009cd45c00 x1830967307977472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:518/0 lens 488/440 e 0 to 0 dl 1746147153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147142.999514:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45c00 with x1830967307977472 ext(1048576->2097151) 00002000:00010000:3.0:1746147142.999522:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd45c00 00000100:00100000:0.0:1746147143.008987:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.009040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.009136:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977728 00000100:00100000:1.0:1746147143.009138:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977600 00000100:00100000:2.0:1746147143.009147:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977728 00000100:00100000:1.0:1746147143.009150:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977600 00000100:00100000:1.0:1746147143.009222:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14577 00000100:00100000:1.0:1746147143.009231:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307977600:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147143.009232:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14578 00000100:00100000:2.0:1746147143.009238:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307977728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.009247:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.009253:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.009264:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425056264 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d44 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.009269:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505626b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d4b expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.009326:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680960:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.009420:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.010327:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310681088:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147143.010412:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.013639:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310681088:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147143.013674:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425056264 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d44 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.013687:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425056264 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d44 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.013703:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:1.0:1746147143.013745:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967307977600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4515us (4703us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147143.013753:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14577 00000100:00100000:2.0:1746147143.013958:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310680960:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147143.013979:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505626b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d4b expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.013988:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505626b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d4b expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.014001:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:2.0:1746147143.014022:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307977728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4784us (5048us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147143.014028:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14578 00000100:00100000:0.0:1746147143.021655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.022150:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977856 00000100:00100000:2.0:1746147143.022159:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977856 00000100:00100000:2.0:1746147143.022210:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14579 00000100:00100000:2.0:1746147143.022217:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32302:x1830967307977856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.022233:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.022247:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d52 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.022274:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.022282:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.022283:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.022286:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.022310:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.022320:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 10 pid: 9584 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.022330:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310681216:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.022819:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.025644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.025990:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310681216:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.026015:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.026023:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307977984 00000100:00100000:3.0:1746147143.026029:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307977984 00010000:00010000:2.0:1746147143.026035:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6600, rc 0) 00002000:00100000:3.0:1746147143.026060:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2945024->3145727) req@ffff88009cd44000 x1830967307977984/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.026068:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44000 with x1830967307977984 ext(2945024->3145727) 00010000:00010000:3.0:1746147143.026074:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 11 pid: 9584 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.026083:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32302:x1830967307977856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3866us (4435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.026109:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14579 00010000:00010000:3.0:1746147143.027832:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 11 pid: 9584 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.027844:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd44000 00000100:00100000:3.0:1746147143.027881:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1102 00000100:00100000:3.0:1746147143.027891:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967307977984:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147143.032599:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307977984:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4698us (6949us total) trans 17179874212 rc 0/0 00000100:00100000:3.0:1746147143.032612:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1102 00002000:00100000:3.0:1746147143.032625:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2945024->3145727) req@ffff88009cd44000 x1830967307977984/t17179874212(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.032634:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44000 with x1830967307977984 ext(2945024->3145727) 00010000:00010000:3.0:1746147143.032646:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 13 pid: 9584 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.032661:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 13 pid: 9584 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.032668:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd44000 00000100:00100000:0.0:1746147143.035798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.036000:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307978112 00000100:00100000:3.0:1746147143.036011:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307978112 00010000:00010000:3.0:1746147143.036054:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 13 pid: 9584 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.036134:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6382 00000100:00100000:3.0:1746147143.036142:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967307978112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.037458:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.037495:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 13 pid: 9584 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.037511:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 13 pid: 9584 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.037538:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250561c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77cdb expref: 13 pid: 9584 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.037571:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.037573:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.037582:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.037591:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.037635:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.037650:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310681344:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.037764:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.043037:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310681344:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.043067:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.043158:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967307978112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7015us (7369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.043169:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6382 00000100:00100000:0.0:1746147143.045919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.046159:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307978368 00000100:00100000:3.0:1746147143.046167:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307978368 00002000:00100000:3.0:1746147143.046218:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009cd47b80 x1830967307978368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.046229:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47b80 with x1830967307978368 ext(2097152->3145727) 00002000:00010000:3.0:1746147143.046235:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47b80 00000100:00100000:3.0:1746147143.046321:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3491 00000100:00100000:3.0:1746147143.046329:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307978368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.057209:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307978368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10866us (11286us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147143.057222:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3491 00002000:00100000:3.0:1746147143.057235:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009cd47b80 x1830967307978368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.057246:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47b80 with x1830967307978368 ext(2097152->3145727) 00002000:00010000:3.0:1746147143.057253:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47b80 00000100:00100000:0.0:1746147143.062451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.062565:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307978496 00000100:00100000:2.0:1746147143.062574:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307978496 00000100:00100000:2.0:1746147143.063049:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14580 00000100:00100000:2.0:1746147143.063057:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32302:x1830967307978496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.063074:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.063112:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d59 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.063140:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.063147:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.063149:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.063152:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.063176:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.063187:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 15 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.063204:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310681472:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.063703:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.070799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.070909:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310681472:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.070951:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.070969:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6a00, rc 0) 00000100:00100000:2.0:1746147143.071019:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32302:x1830967307978496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7962us (8576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.071027:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14580 00000100:00100000:3.0:1746147143.071115:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307978624 00000100:00100000:3.0:1746147143.071121:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307978624 00002000:00100000:3.0:1746147143.071155:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2162687) req@ffff8801312eb480 x1830967307978624/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.071163:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb480 with x1830967307978624 ext(2097152->2162687) 00010000:00010000:3.0:1746147143.071169:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 16 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.071180:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 16 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.071185:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312eb480 00000100:00100000:3.0:1746147143.071207:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1103 00000100:00100000:3.0:1746147143.071213:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967307978624:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147143.075670:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967307978624:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4448us (4871us total) trans 21474841479 rc 0/0 00000100:00100000:0.0:1746147143.075681:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1103 00002000:00100000:0.0:1746147143.075692:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2162687) req@ffff8801312eb480 x1830967307978624/t21474841479(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.075700:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eb480 with x1830967307978624 ext(2097152->2162687) 00010000:00010000:0.0:1746147143.075710:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746147143.075725:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746147143.075732:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312eb480 00000100:00100000:0.0:1746147143.080506:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.081316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.081400:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307979008 00000100:00100000:3.0:1746147143.081409:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307979008 00010000:00010000:3.0:1746147143.081441:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.081468:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6383 00000100:00100000:3.0:1746147143.081476:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307979008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.081488:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.081505:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.081517:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.081538:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425056248 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2162687) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d2f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.081566:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.081568:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.081574:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.081581:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.081609:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.081620:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310681600:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.081692:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.082240:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307978880 00000100:00100000:1.0:1746147143.082245:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307978880 00000100:00100000:1.0:1746147143.082273:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15274 00000100:00100000:1.0:1746147143.082278:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32308:x1830967307978880:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147143.082295:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.082308:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425056280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d60 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.082366:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082376:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082386:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082397:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082402:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082407:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082492:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082500:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082506:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147143.082514:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.082569:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082578:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082583:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082589:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082594:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.082597:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082603:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082611:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147143.082613:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.082616:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082621:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082634:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082639:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082643:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082647:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.082650:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082655:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082660:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006000) 00010000:00010000:1.0:1746147143.082662:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.082664:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082668:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505628e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.082698:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425056280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 40 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.082707:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.082713:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.082715:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147143.082717:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33c00, rc 0) 00000100:00100000:1.0:1746147143.082757:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32308:x1830967307978880:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 478us (2260us total) trans 8589935961 rc 0/0 00000100:00100000:1.0:1746147143.082764:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15274 00000100:00100000:1.0:1746147143.083788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.083908:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307979264 00000100:00100000:0.0:1746147143.083913:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307979264 00000100:00100000:0.0:1746147143.083947:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15275 00000100:00100000:0.0:1746147143.083993:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:32310:x1830967307979264:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147143.084006:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.084016:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250562a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d67 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.084044:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310681600:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147143.084054:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147143.084058:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147143.084062:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147143.084068:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147143.084076:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147143.084081:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147143.084113:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967307979008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2638us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.084120:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6383 00010000:00010000:0.0:1746147143.084634:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084779:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084788:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084794:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147143.084801:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.084849:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084854:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084859:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084863:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.084866:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084870:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084878:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147143.084880:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.084882:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084886:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250562aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084893:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084897:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084904:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084908:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.084909:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084913:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084917:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a570d300) 00010000:00010000:1.0:1746147143.084919:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.084920:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084924:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250562b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.084965:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250562a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 23 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.084975:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 22 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.084980:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.084982:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147143.085148:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:1.0:1746147143.085181:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:32310:x1830967307979264:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1227us (1394us total) trans 8589935962 rc 0/0 00000100:00100000:1.0:1746147143.085186:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15275 00000100:00100000:0.0:1746147143.102544:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.102590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.103234:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307979520 00000100:00100000:2.0:1746147143.103243:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307979520 00002000:00100000:2.0:1746147143.103281:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd47100 x1830967307979520/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.103291:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47100 with x1830967307979520 ext(2097152->4194303) 00002000:00010000:2.0:1746147143.103296:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd47100 00000100:00100000:2.0:1746147143.103325:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307979776 00000100:00100000:2.0:1746147143.103328:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307979776 00002000:00100000:2.0:1746147143.103342:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88009cd45880 x1830967307979776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.103349:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45880 with x1830967307979776 ext(3145728->4194303) 00002000:00010000:2.0:1746147143.103352:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd45880 00000100:00100000:2.0:1746147143.103373:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3492 00000100:00100000:2.0:1746147143.103381:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307979520:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.106052:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3493 00000100:00100000:0.0:1746147143.106065:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307979776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.108243:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.108405:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307979904 00000100:00100000:2.0:1746147143.108414:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307979904 00000100:00100000:2.0:1746147143.108452:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14581 00000100:00100000:2.0:1746147143.108460:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:32310:x1830967307979904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147143.108476:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.108490:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d6e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.108515:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.108523:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.108524:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.108527:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1101824->1380351] (req 1101824->1380351) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.108606:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.108617:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 31 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.108626:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310681728:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.108708:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.113893:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310681728:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.113924:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1101824->1380351] (req 1101824->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.113948:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:2.0:1746147143.113987:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:32310:x1830967307979904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5528us (5751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.113994:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14581 00000100:00100000:0.0:1746147143.121539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.122145:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307980032 00000100:00100000:3.0:1746147143.122156:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307980032 00010000:00010000:3.0:1746147143.122195:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 32 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.122233:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6384 00000100:00100000:3.0:1746147143.122242:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967307980032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.122258:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.122283:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 32 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.122643:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 32 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.122668:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6200/0x313993942505625d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d3d expref: 32 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.122690:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.122692:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.122699:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.122707:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.122741:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.122755:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310681856:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.122858:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.123422:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967307979520:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20040us (20885us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147143.123431:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3492 00002000:00100000:2.0:1746147143.123438:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd47100 x1830967307979520/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.123445:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47100 with x1830967307979520 ext(2097152->4194303) 00002000:00010000:2.0:1746147143.123449:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd47100 00000100:00100000:0.0:1746147143.127427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.127461:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307980288 00000100:00100000:0.0:1746147143.127468:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307980288 00002000:00100000:0.0:1746147143.127503:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1101824->1105919) req@ffff88009c308a80 x1830967307980288/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.127519:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308a80 with x1830967307980288 ext(1101824->1105919) 00002000:00010000:0.0:1746147143.127524:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308a80 00000100:00100000:0.0:1746147143.127552:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3494 00000100:00100000:0.0:1746147143.127559:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307980288:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147143.127584:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310681856:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.127600:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.127632:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967307980032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5392us (6105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.127640:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6384 00000100:00100000:0.0:1746147143.127645:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307980288:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 87us (225us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147143.127650:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3494 00002000:00100000:0.0:1746147143.127653:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1101824->1105919) req@ffff88009c308a80 x1830967307980288/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.127660:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308a80 with x1830967307980288 ext(1101824->1105919) 00002000:00010000:0.0:1746147143.127662:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308a80 00000100:00100000:2.0:1746147143.127803:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307979776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21742us (25213us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147143.127810:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3493 00002000:00100000:2.0:1746147143.127814:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88009cd45880 x1830967307979776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.127821:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45880 with x1830967307979776 ext(3145728->4194303) 00002000:00010000:2.0:1746147143.127824:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd45880 00000100:00100000:0.0:1746147143.132829:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.132910:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307980544 00000100:00100000:1.0:1746147143.132919:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307980544 00002000:00100000:1.0:1746147143.132965:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1376256->1380351) req@ffff88009c308380 x1830967307980544/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.132974:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308380 with x1830967307980544 ext(1376256->1380351) 00002000:00010000:1.0:1746147143.132978:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308380 00000100:00100000:1.0:1746147143.133005:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3495 00000100:00100000:1.0:1746147143.133012:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307980544:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.133164:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967307980544:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 152us (341us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147143.133170:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3495 00002000:00100000:1.0:1746147143.133174:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1376256->1380351) req@ffff88009c308380 x1830967307980544/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.133180:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308380 with x1830967307980544 ext(1376256->1380351) 00002000:00010000:1.0:1746147143.133182:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308380 00000100:00100000:0.0:1746147143.133658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.133828:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307980800 00000100:00100000:1.0:1746147143.133831:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307980800 00000100:00100000:1.0:1746147143.133866:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15276 00000100:00100000:1.0:1746147143.133871:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:32313:x1830967307980800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.133884:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.133899:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250562cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d75 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.133983:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.133996:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147143.134004:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147143.134012:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.134083:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x31399394250562cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 25 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.134117:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 24 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.134124:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.134126:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147143.134129:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:1.0:1746147143.134150:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:32313:x1830967307980800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 279us (494us total) trans 8589935963 rc 0/0 00000100:00100000:1.0:1746147143.134156:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15276 00000100:00100000:0.0:1746147143.135988:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.136194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.136258:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307981184 00000100:00100000:1.0:1746147143.136263:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307981184 00000100:00100000:1.0:1746147143.136302:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5473 00000100:00100000:1.0:1746147143.136309:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:32310:x1830967307981184:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147143.136821:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307980928 00000100:00100000:2.0:1746147143.136825:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307980928 00000100:00100000:2.0:1746147143.136855:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14582 00000100:00100000:2.0:1746147143.136860:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307980928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.136870:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.136883:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x31399394250562e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d7c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.136921:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310681984:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.137013:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.137651:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+25:32310:x1830967307981184:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1341us (1455us total) trans 8589935964 rc 0/0 00000100:00100000:1.0:1746147143.137657:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5473 00000100:00100000:1.0:1746147143.139712:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.139732:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.139742:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.140103:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.140365:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307981312 00000100:00100000:0.0:1746147143.140372:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307981312 00000100:00100000:2.0:1746147143.140418:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307981440 00000100:00100000:2.0:1746147143.140421:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307981440 00000100:00100000:2.0:1746147143.140443:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307981568 00000100:00100000:2.0:1746147143.140444:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307981568 00000100:00100000:2.0:1746147143.140454:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307981696 00000100:00100000:2.0:1746147143.140455:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307981696 00000100:00100000:2.0:1746147143.140468:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14583 00000100:00100000:2.0:1746147143.140474:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967307981440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.140487:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.140502:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x31399394250562e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d8a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.140541:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310682112:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.140589:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00002000:00010000:2.0:1746147143.140621:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147142 -> 1746147143 00002000:00010000:2.0:1746147143.140623:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147142 -> 1746147143 00000100:00100000:2.0:1746147143.140636:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310681984:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147143.140657:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x31399394250562e2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d7c expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.140666:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x31399394250562e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d7c expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.140678:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef200, rc 0) 00000100:00100000:2.0:1746147143.140696:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967307980928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3835us (4713us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147143.140701:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14582 00000100:00100000:2.0:1746147143.140715:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14584 00000100:00100000:2.0:1746147143.140719:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307981568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.140726:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.140735:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d91 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.140745:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.140746:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.140752:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.140762:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 14 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.140769:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd2600, rc 0) 00000100:00100000:2.0:1746147143.140782:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307981568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 63us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.140787:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14584 00000100:00100000:2.0:1746147143.140795:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14585 00000100:00100000:2.0:1746147143.140799:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307981696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.140805:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.140811:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d98 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.140820:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.140821:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.140825:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.140833:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.140838:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:2.0:1746147143.140850:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967307981696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 51us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.140855:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14585 00000100:00100000:0.0:1746147143.141947:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14586 00000100:00100000:0.0:1746147143.141955:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307981312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.141963:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.141970:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x31399394250562fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d83 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147143.141995:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310682240:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147143.142028:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2180 going to sleep for 11 seconds 00002000:00010000:3.0:1746147143.144017:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147142 -> 1746147143 00000100:00100000:3.0:1746147143.144037:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310682112:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.144058:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x31399394250562e9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d8a expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.144068:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x31399394250562e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d8a expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147143.144326:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147143.144517:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ee000, rc 0) 00000100:00100000:2.0:1746147143.144723:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307981952 00000100:00100000:2.0:1746147143.144729:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307981952 00002000:00100000:2.0:1746147143.144758:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095063b80 x1830967307981952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.144768:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063b80 with x1830967307981952 ext(4194304->4919295) 00002000:00010000:2.0:1746147143.144772:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063b80 00000100:00100000:3.0:1746147143.144858:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967307981440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4384us (5124us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.144865:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14583 00000100:00100000:2.0:1746147143.145110:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3496 00000100:00100000:2.0:1746147143.145117:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307981952:12345-192.168.204.25@tcp:3:cat.0 00002000:00010000:0.0:1746147143.147448:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147142 -> 1746147143 00002000:00010000:0.0:1746147143.147453:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147142 -> 1746147143 00002000:00010000:0.0:1746147143.147455:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147142 -> 1746147143 00000100:00100000:0.0:1746147143.147472:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310682240:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147143.147495:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x31399394250562fe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d83 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.147506:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x31399394250562fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d83 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.147528:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7200, rc 0) 00000100:00100000:0.0:1746147143.147557:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967307981312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5603us (7848us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147143.147563:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14586 00000100:00100000:0.0:1746147143.150779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.150853:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982080 00000100:00100000:2.0:1746147143.150860:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982080 00000100:00100000:2.0:1746147143.151421:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14587 00000100:00100000:2.0:1746147143.151429:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+13:32313:x1830967307982080:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.151445:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.151460:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77d9f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.151483:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.151489:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.151490:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.151494:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.151517:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.151529:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 32 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.151540:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310682368:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.151607:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.153043:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967307981952:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7923us (8714us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147143.153052:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3496 00002000:00100000:2.0:1746147143.153061:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095063b80 x1830967307981952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.153076:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063b80 with x1830967307981952 ext(4194304->4919295) 00002000:00010000:2.0:1746147143.153080:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063b80 00000100:00100000:0.0:1746147143.153771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.153978:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310682368:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.154001:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.154015:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ee800, rc 0) 00000100:00100000:3.0:1746147143.154039:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:32313:x1830967307982080:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2611us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.154045:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14587 00000100:00100000:2.0:1746147143.154386:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982208 00000100:00100000:2.0:1746147143.154391:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982208 00002000:00100000:2.0:1746147143.154416:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (1024000->1048575) req@ffff880095060e00 x1830967307982208/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.154423:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060e00 with x1830967307982208 ext(1024000->1048575) 00010000:00010000:2.0:1746147143.154429:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.154440:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.154446:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095060e00 00000100:00100000:2.0:1746147143.154460:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1104 00000100:00100000:2.0:1746147143.154465:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967307982208:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147143.158938:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.159289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.159362:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982336 00000100:00100000:0.0:1746147143.159370:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982336 00000100:00100000:0.0:1746147143.159408:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982464 00000100:00100000:0.0:1746147143.159410:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982464 00000100:00100000:0.0:1746147143.159566:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14588 00000100:00100000:0.0:1746147143.159573:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307982336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.159586:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.159599:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6400/0x313993942505630c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77da6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147143.159643:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310682496:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147143.159691:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.159839:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14589 00000100:00100000:2.0:1746147143.159846:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307982464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.159854:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.159866:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425056313 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dad expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.159894:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310682624:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.159916:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.160275:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967307982208:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5808us (6504us total) trans 17179874213 rc 0/0 00000100:00100000:3.0:1746147143.160284:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1104 00002000:00100000:3.0:1746147143.160292:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (1024000->1048575) req@ffff880095060e00 x1830967307982208/t17179874213(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.160300:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060e00 with x1830967307982208 ext(1024000->1048575) 00010000:00010000:3.0:1746147143.160305:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.160318:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.160323:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095060e00 00000100:00100000:2.0:1746147143.163541:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310682496:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147143.163570:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6400/0x313993942505630c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77da6 expref: 34 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.163584:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6400/0x313993942505630c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77da6 expref: 34 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.163612:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6400, rc 0) 00000100:00100000:2.0:1746147143.163660:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307982336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4086us (4738us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147143.163667:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14588 00002000:00010000:3.0:1746147143.164132:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147142 -> 1746147143 00000100:00100000:3.0:1746147143.164144:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310682624:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.164160:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425056313 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dad expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.164169:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ee000/0x3139939425056313 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dad expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.164188:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ee000, rc 0) 00000100:00100000:3.0:1746147143.164224:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307982464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4379us (4935us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.164229:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14589 00000100:00100000:2.0:1746147143.167962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.169150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.169173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.169198:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982720 00000100:00100000:2.0:1746147143.169206:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982720 00000100:00100000:2.0:1746147143.169259:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982848 00000100:00100000:2.0:1746147143.169261:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982848 00000100:00100000:2.0:1746147143.169278:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14590 00000100:00100000:2.0:1746147143.169286:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32308:x1830967307982720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147143.169305:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.169323:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77db4 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.169358:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 9 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.169367:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.169373:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 35 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.169378:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.169380:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.169383:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1400832->2015231] (req 1400832->2015231) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.169411:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 35 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.169422:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 35 pid: 1398 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.169432:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310682752:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.169510:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.169517:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 13 pid: 9584 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.169524:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310682880:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.169544:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 9 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.169551:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 9 pid: 10340 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.169557:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310683008:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.169571:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.169688:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.169710:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982976 00000100:00100000:2.0:1746147143.169713:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982976 00000100:00100000:2.0:1746147143.169733:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14591 00000100:00100000:2.0:1746147143.169738:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307982848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.169745:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.169753:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbec600/0x3139939425056321 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dbb expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.169781:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310683136:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.169800:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.169820:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14592 00000100:00100000:2.0:1746147143.169825:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307982976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.169833:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.169844:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x3139939425056328 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dc2 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.169865:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310683264:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.169884:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.170064:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307982592 00000100:00100000:3.0:1746147143.170069:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307982592 00010000:00010000:3.0:1746147143.170098:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 37 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.170121:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6385 00000100:00100000:3.0:1746147143.170126:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967307982592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.170133:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.170150:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 37 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.170158:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 37 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.170174:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.170176:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.170181:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.170188:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.170206:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.170212:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310683392:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.170235:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.173983:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147143.174008:0:9586:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88009cd44700 x1830967310683136) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 37 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.174021:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147143.174057:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425056137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c80 expref: 37 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.174085:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310683136:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.174160:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbec600/0x3139939425056321 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dbb expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.174173:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbec600/0x3139939425056321 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dbb expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.174182:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbec600, rc 0) 00000100:00100000:3.0:1746147143.174236:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307982848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4496us (5060us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147143.174237:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307983104 00000100:00100000:1.0:1746147143.174245:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307983104 00000100:00100000:3.0:1746147143.174246:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14591 00010000:00010000:1.0:1746147143.174271:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 10 pid: 10340 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.174278:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307983232 00000100:00100000:3.0:1746147143.174281:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307983232 00010000:00010000:3.0:1746147143.174295:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 35 pid: 1398 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746147143.174295:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6386 00000100:00100000:1.0:1746147143.174302:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307983104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147143.174313:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6387 00010000:00010000:1.0:1746147143.174314:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147143.174319:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307983232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.174325:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 10 pid: 10340 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.174326:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.174334:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 10 pid: 10340 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.174347:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 35 pid: 1398 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.174361:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 35 pid: 1398 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.174378:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.174401:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307983232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.174407:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6387 00010000:00010000:1.0:1746147143.174407:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.174427:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967307983104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.174433:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6386 00000100:00100000:3.0:1746147143.174438:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310683392:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.174448:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.174464:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967307982592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4338us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.174471:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6385 00000100:00100000:3.0:1746147143.174516:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310683264:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.174534:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x3139939425056328 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc2 expref: 30 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.174543:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x3139939425056328 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc2 expref: 30 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.174552:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6c00, rc 0) 00000100:00100000:3.0:1746147143.174570:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967307982976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4744us (4882us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.174576:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14592 00010000:00010000:2.0:1746147143.174666:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d98400/0x3139939425055f62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b61 expref: 33 pid: 1398 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.174693:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310682752:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.174705:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009452aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310682880:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.174714:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425055e97 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b14 expref: 9 pid: 10340 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.174722:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310683008:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.174743:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1400832->2015231] (req 1400832->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.174752:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef200, rc 0) 00000100:00100000:2.0:1746147143.174771:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32308:x1830967307982720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5486us (5627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.174776:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14590 00000100:00100000:0.0:1746147143.176085:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.176207:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307983360 00000100:00100000:3.0:1746147143.176213:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307983360 00010000:00010000:3.0:1746147143.176239:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 14 pid: 9584 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.176276:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6388 00000100:00100000:3.0:1746147143.176283:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307983360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.176293:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.176309:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 14 pid: 9584 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.176321:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 14 pid: 9584 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.176337:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56200/0x3139939425055f7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b84 expref: 14 pid: 9584 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.176350:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.176351:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.176358:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.176367:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.176397:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.176409:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310683520:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.176483:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.179319:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.179424:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307983744 00000100:00100000:1.0:1746147143.179434:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307983744 00000100:00100000:1.0:1746147143.179491:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5474 00000100:00100000:1.0:1746147143.179499:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32302:x1830967307983744:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147143.179729:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32302:x1830967307983744:12345-192.168.204.25@tcp:35:cat.0 Request processed in 230us (467us total) trans 8589935965 rc 0/0 00000100:00100000:1.0:1746147143.179739:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5474 00000100:00100000:0.0:1746147143.179897:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.179963:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307983872 00000100:00100000:2.0:1746147143.179968:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307983872 00002000:00100000:2.0:1746147143.180008:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880095062680 x1830967307983872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.180029:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062680 with x1830967307983872 ext(0->1048575) 00002000:00010000:2.0:1746147143.180035:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062680 00000100:00100000:2.0:1746147143.180121:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3497 00000100:00100000:2.0:1746147143.180127:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307983872:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.180290:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310683520:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.180308:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.180331:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307983360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4049us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.180339:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6388 00000100:00100000:0.0:1746147143.181586:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.181846:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307984128 00000100:00100000:1.0:1746147143.181852:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307984128 00002000:00100000:1.0:1746147143.181887:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1400832->1404927) req@ffff880095062a00 x1830967307984128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.181896:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062a00 with x1830967307984128 ext(1400832->1404927) 00002000:00010000:1.0:1746147143.181902:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062a00 00000100:00100000:1.0:1746147143.181935:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3498 00000100:00100000:1.0:1746147143.181941:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307984128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147143.182032:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307984128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 91us (452us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147143.182037:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3498 00002000:00100000:1.0:1746147143.182042:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1400832->1404927) req@ffff880095062a00 x1830967307984128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.182049:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062a00 with x1830967307984128 ext(1400832->1404927) 00002000:00010000:1.0:1746147143.182051:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062a00 00000100:00100000:2.0:1746147143.190464:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967307983872:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10325us (10555us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147143.190477:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3497 00002000:00100000:2.0:1746147143.190489:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880095062680 x1830967307983872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.190498:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062680 with x1830967307983872 ext(0->1048575) 00002000:00010000:2.0:1746147143.190504:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062680 00000100:00100000:0.0:1746147143.196629:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.197459:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307984384 00000100:00100000:2.0:1746147143.197471:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307984384 00002000:00100000:2.0:1746147143.197521:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (2011136->2015231) req@ffff880095060000 x1830967307984384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.197532:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060000 with x1830967307984384 ext(2011136->2015231) 00002000:00010000:2.0:1746147143.197539:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060000 00000100:00100000:2.0:1746147143.197576:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3499 00000100:00100000:2.0:1746147143.197585:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307984384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147143.197750:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307984384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 164us (1130us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147143.197756:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3499 00002000:00100000:2.0:1746147143.197762:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (2011136->2015231) req@ffff880095060000 x1830967307984384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.197771:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060000 with x1830967307984384 ext(2011136->2015231) 00002000:00010000:2.0:1746147143.197774:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060000 00000100:00100000:0.0:1746147143.201760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.201854:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307984512 00000100:00100000:2.0:1746147143.201864:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307984512 00000100:00100000:0.0:1746147143.201874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.201917:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14593 00000100:00100000:2.0:1746147143.201935:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+19:32313:x1830967307984512:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147143.201941:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307984768 00000100:00100000:3.0:1746147143.201946:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307984768 00010000:00010000:2.0:1746147143.201957:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.201978:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dc9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.201987:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5475 00000100:00100000:3.0:1746147143.201993:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32308:x1830967307984768:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:2.0:1746147143.202010:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.202018:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.202019:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.202023:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.202056:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.202068:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 28 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.202081:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310683648:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.202197:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.202210:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32308:x1830967307984768:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 216us (336us total) trans 8589935966 rc 0/0 00000100:00100000:3.0:1746147143.202217:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5475 00000100:00100000:2.0:1746147143.204544:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310683648:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.204578:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.204594:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7600, rc 0) 00000100:00100000:2.0:1746147143.204645:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:32313:x1830967307984512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2719us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.204655:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14593 00000100:00100000:0.0:1746147143.204677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.204703:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307984896 00000100:00100000:2.0:1746147143.204708:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307984896 00002000:00100000:2.0:1746147143.204737:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1634303) req@ffff88011e502a00 x1830967307984896/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.204746:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502a00 with x1830967307984896 ext(1048576->1634303) 00010000:00010000:2.0:1746147143.204752:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 29 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.204765:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 29 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.204771:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e502a00 00000100:00100000:2.0:1746147143.204802:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1105 00000100:00100000:2.0:1746147143.204809:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967307984896:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147143.214766:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307984896:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9948us (10081us total) trans 21474841480 rc 0/0 00000100:00100000:2.0:1746147143.214778:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1105 00002000:00100000:2.0:1746147143.214790:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1634303) req@ffff88011e502a00 x1830967307984896/t21474841480(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.214799:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502a00 with x1830967307984896 ext(1048576->1634303) 00010000:00010000:2.0:1746147143.214808:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.214824:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.214832:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e502a00 00000100:00100000:0.0:1746147143.225283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.225396:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307985024 00000100:00100000:3.0:1746147143.225407:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307985024 00010000:00010000:3.0:1746147143.225447:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.225489:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6389 00000100:00100000:3.0:1746147143.225498:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307985024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.225513:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147143.225531:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147142 -> 1746147143 00010000:00010000:3.0:1746147143.225537:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.225555:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.225580:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05a00/0x313993942505613e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1634303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77c87 expref: 31 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.225612:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.225614:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.225622:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.225630:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.225665:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.225678:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310683776:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.225758:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.229548:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310683776:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147143.229572:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147143.229633:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967307985024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4134us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147143.229644:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6389 00000100:00100000:0.0:1746147143.238056:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.238154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.238539:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307985408 00000100:00100000:3.0:1746147143.238549:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307985408 00002000:00100000:3.0:1746147143.238599:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011e502d80 x1830967307985408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 504/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.238610:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502d80 with x1830967307985408 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.238616:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e502d80 00000100:00100000:3.0:1746147143.238643:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307985280 00000100:00100000:3.0:1746147143.238646:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307985280 00002000:00100000:3.0:1746147143.238657:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011e501f80 x1830967307985280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.238664:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501f80 with x1830967307985280 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.238667:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e501f80 00000100:00100000:3.0:1746147143.238689:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3500 00000100:00100000:3.0:1746147143.238697:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967307985408:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147143.238764:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3501 00000100:00100000:2.0:1746147143.238773:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967307985280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.251216:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307985280:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12432us (13049us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147143.251229:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3501 00002000:00100000:0.0:1746147143.251240:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011e501f80 x1830967307985280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.251254:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501f80 with x1830967307985280 ext(1048576->2097151) 00002000:00010000:0.0:1746147143.251260:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e501f80 00000100:00100000:3.0:1746147143.254226:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307985408:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15513us (16166us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746147143.254240:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3500 00002000:00100000:3.0:1746147143.254251:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88011e502d80 x1830967307985408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 504/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.254259:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502d80 with x1830967307985408 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.254266:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e502d80 00000100:00100000:0.0:1746147143.267678:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.267759:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307985920 00000100:00100000:3.0:1746147143.267768:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307985920 00000100:00100000:0.0:1746147143.267788:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.267819:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14594 00000100:00100000:3.0:1746147143.267827:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+13:32313:x1830967307985920:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147143.267827:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307985792 00000100:00100000:0.0:1746147143.267831:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307985792 00010000:00010000:3.0:1746147143.267849:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.267868:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dd0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147143.267873:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15277 00000100:00100000:0.0:1746147143.267879:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+25:32318:x1830967307985792:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147143.267896:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.267898:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.267909:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x313993942505633d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dd7 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.267910:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.267912:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.267915:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.267957:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.267970:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 31 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.267983:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310683904:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147143.268016:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.268029:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.268037:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 40 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.268043:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 26 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.268050:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.268067:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 26 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.268069:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598780 going to sleep for 11 seconds 00010000:00010000:0.0:1746147143.268074:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 26 pid: 6215 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.268082:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310684032:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147143.268151:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 40 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.268159:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 40 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.268167:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310684160:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147143.268198:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.268205:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 8 pid: 6215 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.268212:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310684288:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147143.268229:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.270130:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310683904:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.270167:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.270182:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009000, rc 0) 00000100:00100000:3.0:1746147143.270229:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+14:32313:x1830967307985920:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2402us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.270237:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14594 00000100:00100000:0.0:1746147143.273142:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.273304:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310684032:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.273315:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310684160:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.273323:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310684288:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.273352:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147143.273571:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.273594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.273620:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.273637:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307986432 00000100:00100000:3.0:1746147143.273645:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307986432 00000100:00100000:0.0:1746147143.273651:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307986048 00000100:00100000:0.0:1746147143.273655:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307986048 00010000:00010000:0.0:1746147143.273679:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 27 pid: 6215 timeout: 781 lvb_type: 0 00002000:00100000:3.0:1746147143.273690:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1400832->2015231) req@ffff8800a4394a80 x1830967307986432/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.273704:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394a80 with x1830967307986432 ext(1400832->2015231) 00000100:00100000:0.0:1746147143.273705:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307986304 00000100:00100000:0.0:1746147143.273707:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307986304 00010000:00010000:3.0:1746147143.273713:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 32 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746147143.273715:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 9 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.273724:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 32 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.273726:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307986176 00000100:00100000:0.0:1746147143.273727:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307986176 00002000:00010000:3.0:1746147143.273730:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4394a80 00010000:00010000:0.0:1746147143.273735:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 41 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.273747:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1106 00000100:00100000:0.0:1746147143.273747:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6390 00000100:00100000:0.0:1746147143.273753:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967307986048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147143.273754:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307986432:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147143.273988:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6391 00000100:00100000:1.0:1746147143.273997:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307986304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.274009:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.274015:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 9 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.274026:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 9 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.274048:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425056225 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d0c expref: 9 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.274068:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.274072:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.274080:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.274085:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.274359:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307986304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 362us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.274366:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6391 00000100:00100000:2.0:1746147143.274377:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6392 00000100:00100000:2.0:1746147143.274387:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967307986176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.274395:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147143.274400:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 41 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.274408:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 41 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.274419:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056295 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d60 expref: 41 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.274431:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147143.274434:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147143.274440:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147143.274445:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.274462:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967307986176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.274467:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6392 00010000:00010000:1.0:1746147143.275076:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.275083:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 27 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.275119:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 27 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.275131:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250562b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d67 expref: 27 pid: 6215 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.275141:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.275144:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.275152:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.275158:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.275186:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.275214:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967307986048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1461us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.275220:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6390 00010000:00010000:2.0:1746147143.275223:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147143.275230:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147143.275248:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147143.275369:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x313993942505633d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.275382:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 26 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.275387:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147143.275390:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147143.275392:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984efc00, rc 0) 00000100:00100000:2.0:1746147143.275455:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:32318:x1830967307985792:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7576us (7666us total) trans 8589935967 rc 0/0 00000100:00100000:2.0:1746147143.275462:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15277 00000100:00100000:3.0:1746147143.284602:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967307986432:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10840us (11022us total) trans 17179874214 rc 0/0 00000100:00100000:3.0:1746147143.284614:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1106 00002000:00100000:3.0:1746147143.284625:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1400832->2015231) req@ffff8800a4394a80 x1830967307986432/t17179874214(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.284635:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394a80 with x1830967307986432 ext(1400832->2015231) 00010000:00010000:3.0:1746147143.284644:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 34 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.284661:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 34 pid: 1854 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.284667:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4394a80 00000100:00100000:0.0:1746147143.291258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.291443:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307986560 00000100:00100000:1.0:1746147143.291452:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307986560 00010000:00010000:1.0:1746147143.291482:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 34 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.291516:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6393 00000100:00100000:1.0:1746147143.291523:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307986560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.291535:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147143.291548:0:7225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147140 -> 1746147143 00002000:00010000:1.0:1746147143.291551:0:7225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147140 -> 1746147143 00010000:00010000:1.0:1746147143.291555:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 34 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.291570:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 34 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.291588:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef200/0x313993942505631a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2015231) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77db4 expref: 34 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.291603:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.291605:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.291611:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.291617:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.291644:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147143.291654:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310684416:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147143.291732:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.293702:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310684416:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147143.293720:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.293763:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967307986560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2239us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.293773:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6393 00000100:00100000:0.0:1746147143.300810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.300883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.300918:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307987072 00000100:00100000:0.0:1746147143.300934:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307987072 00000100:00100000:0.0:1746147143.300980:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15278 00000100:00100000:0.0:1746147143.300988:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32321:x1830967307987072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.301011:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.301027:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425056352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dde expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.301109:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301120:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301131:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301140:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301145:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301149:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301222:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425056367 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301230:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425056367 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301235:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425056367 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147143.301242:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147143.301293:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301299:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301304:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301309:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301313:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147143.301317:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301322:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301331:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147143.301333:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147143.301336:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301340:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425056359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301352:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301357:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301361:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301364:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147143.301366:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301369:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301373:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d4c7700) 00010000:00010000:0.0:1746147143.301375:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147143.301376:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301384:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fee00/0x3139939425056360 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.301410:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425056352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dde expref: 43 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.301419:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425056367 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dde expref: 42 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.301425:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147143.301426:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147143.301428:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe800, rc 0) 00000100:00100000:0.0:1746147143.301462:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32321:x1830967307987072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 475us (578us total) trans 8589935968 rc 0/0 00000100:00100000:0.0:1746147143.301467:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15278 00000100:00100000:3.0:1746147143.301686:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307986816 00000100:00100000:3.0:1746147143.301690:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307986816 00002000:00100000:3.0:1746147143.301719:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a4395c00 x1830967307986816/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.301726:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395c00 with x1830967307986816 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.301730:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4395c00 00000100:00100000:3.0:1746147143.301752:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3502 00000100:00100000:3.0:1746147143.301757:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307986816:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.305751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.305787:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.305808:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.305831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.305872:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307987200 00000100:00100000:0.0:1746147143.305880:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307987200 00000100:00100000:0.0:1746147143.305910:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307987328 00000100:00100000:0.0:1746147143.305912:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307987328 00000100:00100000:0.0:1746147143.305921:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307987456 00000100:00100000:0.0:1746147143.305931:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307987456 00000100:00100000:0.0:1746147143.305940:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307987584 00000100:00100000:0.0:1746147143.305942:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307987584 00000100:00100000:0.0:1746147143.305954:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14595 00000100:00100000:0.0:1746147143.305961:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307987200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.305977:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.305992:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77de5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.306012:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.306014:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.306021:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.306035:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.306044:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7200, rc 0) 00000100:00100000:0.0:1746147143.306078:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307987200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147143.306084:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14595 00000100:00100000:0.0:1746147143.306114:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14596 00000100:00100000:0.0:1746147143.306119:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307987328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.306125:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.306133:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dec expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.306143:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.306145:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.306148:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 32 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.306157:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 32 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.306164:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7800, rc 0) 00000100:00100000:0.0:1746147143.306175:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307987328:12345-192.168.204.25@tcp:101:cat.0 Request processed in 57us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147143.306180:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14596 00000100:00100000:0.0:1746147143.306187:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14597 00000100:00100000:0.0:1746147143.306190:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307987456:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.306195:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.306199:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425056383 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77df3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147143.306229:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310684544:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147143.306273:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.306289:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14598 00000100:00100000:0.0:1746147143.306294:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967307987584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147143.306299:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.306304:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77dfa expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.306312:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.306313:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.306317:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 35 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.306324:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 35 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.306331:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6200, rc 0) 00000100:00100000:0.0:1746147143.306342:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307987584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 48us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147143.306346:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14598 00000100:00100000:0.0:1746147143.310005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.310220:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310684544:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147143.310254:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425056383 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77df3 expref: 32 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.310268:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425056383 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77df3 expref: 32 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.310283:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7a00, rc 0) 00000100:00100000:0.0:1746147143.310325:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967307987456:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4133us (4516us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147143.310335:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14597 00000100:00100000:1.0:1746147143.312933:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307987712 00000100:00100000:1.0:1746147143.312944:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307987712 00000100:00100000:1.0:1746147143.312996:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 811 00000100:00100000:1.0:1746147143.313003:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967307987712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.313015:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.313036:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x3139939425056367 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dde expref: 42 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.313061:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.313065:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.313138:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967307987712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 135us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.313144:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 811 00000100:00100000:3.0:1746147143.313275:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307986816:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11517us (12471us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147143.313282:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3502 00002000:00100000:3.0:1746147143.313288:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800a4395c00 x1830967307986816/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.313296:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395c00 with x1830967307986816 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.313299:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4395c00 00000100:00100000:0.0:1746147143.321508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.322785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.322829:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307988096 00000100:00100000:1.0:1746147143.322841:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307988096 00002000:00100000:1.0:1746147143.322886:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4396300 x1830967307988096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.322896:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396300 with x1830967307988096 ext(0->1048575) 00002000:00010000:1.0:1746147143.322901:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396300 00000100:00100000:1.0:1746147143.322921:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307988224 00000100:00100000:1.0:1746147143.322934:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307988224 00002000:00100000:1.0:1746147143.322947:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4395500 x1830967307988224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.322954:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967307988224 ext(1048576->2097151) 00002000:00010000:1.0:1746147143.322957:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395500 00000100:00100000:1.0:1746147143.322971:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3503 00000100:00100000:1.0:1746147143.322978:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307988096:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.322986:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3504 00000100:00100000:3.0:1746147143.322997:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307988224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.334135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.334230:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307988480 00000100:00100000:2.0:1746147143.334242:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307988480 00002000:00100000:2.0:1746147143.334285:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8800a4396680 x1830967307988480/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.334295:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396680 with x1830967307988480 ext(2097152->4194303) 00002000:00010000:2.0:1746147143.334301:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396680 00000100:00100000:2.0:1746147143.334337:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3505 00000100:00100000:2.0:1746147143.334343:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307988480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147143.335725:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.336118:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307988736 00000100:00100000:3.0:1746147143.336128:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307988736 00002000:00100000:3.0:1746147143.336173:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801312eaa00 x1830967307988736/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.336183:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eaa00 with x1830967307988736 ext(2097152->4194303) 00002000:00010000:3.0:1746147143.336189:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312eaa00 00000100:00100000:3.0:1746147143.336220:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3506 00000100:00100000:3.0:1746147143.336228:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307988736:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.337687:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307988096:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14700us (16181us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147143.337698:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3503 00002000:00100000:0.0:1746147143.337707:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4396300 x1830967307988096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.337721:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396300 with x1830967307988096 ext(0->1048575) 00002000:00010000:0.0:1746147143.337726:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396300 00000100:00100000:3.0:1746147143.342240:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967307988224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19235us (19448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147143.342253:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3504 00002000:00100000:3.0:1746147143.342265:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4395500 x1830967307988224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.342275:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967307988224 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.342280:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395500 00000100:00100000:0.0:1746147143.351055:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.353273:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307988992 00000100:00100000:2.0:1746147143.353289:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307988992 00000100:00100000:2.0:1746147143.353358:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15279 00000100:00100000:2.0:1746147143.353367:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32323:x1830967307988992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147143.353393:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.353414:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425056391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e01 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.353496:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353510:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353520:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353533:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353538:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353542:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353644:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250563a6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353654:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250563a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353660:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250563a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147143.353667:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147143.353744:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353751:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353757:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353762:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09e800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147143.353765:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353771:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353781:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147143.353784:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147143.353788:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353793:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425056398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353828:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353833:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353838:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353842:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147143.353844:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353848:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353854:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800932c2600) 00010000:00010000:2.0:1746147143.353856:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147143.353858:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353863:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x313993942505639f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147143.353900:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425056391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e01 expref: 44 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.353911:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250563a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e01 expref: 43 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.353918:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147143.353920:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147143.353933:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09fc00, rc 0) 00000100:00100000:2.0:1746147143.353991:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32323:x1830967307988992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 625us (2947us total) trans 8589935969 rc 0/0 00000100:00100000:2.0:1746147143.353997:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15279 00000100:00100000:2.0:1746147143.361897:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307988480:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27537us (27806us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147143.361912:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3505 00002000:00100000:2.0:1746147143.361941:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8800a4396680 x1830967307988480/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.361951:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396680 with x1830967307988480 ext(2097152->4194303) 00002000:00010000:2.0:1746147143.361958:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396680 00000100:00100000:0.0:1746147143.367745:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.370997:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989120 00000100:00100000:2.0:1746147143.371012:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989120 00000100:00100000:2.0:1746147143.371086:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14599 00000100:00100000:2.0:1746147143.371115:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32321:x1830967307989120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.371138:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.371161:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e08 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.371192:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.371200:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.371202:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147143.371205:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.371243:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.371255:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 21 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.371268:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310684672:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.371365:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.371607:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967307988736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 35378us (35887us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147143.371617:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3506 00002000:00100000:3.0:1746147143.371626:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801312eaa00 x1830967307988736/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.371636:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eaa00 with x1830967307988736 ext(2097152->4194303) 00002000:00010000:3.0:1746147143.371640:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312eaa00 00000100:00100000:0.0:1746147143.377559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.377613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.377651:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989376 00000100:00100000:2.0:1746147143.377663:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989376 00000100:00100000:3.0:1746147143.377681:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989248 00000100:00100000:3.0:1746147143.377687:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989248 00000100:00100000:3.0:1746147143.377737:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 812 00000100:00100000:3.0:1746147143.377745:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967307989248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.377761:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.377789:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x31399394250563a6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e01 expref: 43 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.377813:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:2.0:1746147143.377819:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14600 00010000:00010000:3.0:1746147143.377822:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.377829:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32323:x1830967307989376:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147143.377846:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.377865:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e0f expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.377883:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967307989248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 138us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.377889:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 812 00010000:00010000:2.0:1746147143.378128:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.378137:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.378144:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.378146:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.378150:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->2535423] (req 2367488->2535423) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.378182:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.378194:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 13 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.378207:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310684800:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.380368:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.380383:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.380395:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310684928:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.380440:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.382651:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310684672:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.382690:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.382708:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09f400, rc 0) 00000100:00100000:2.0:1746147143.382760:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32321:x1830967307989120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11645us (15024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.382769:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14599 00000100:00100000:0.0:1746147143.383534:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.383749:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989504 00000100:00100000:3.0:1746147143.383757:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989504 00002000:00100000:3.0:1746147143.383798:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1101824->1380351) req@ffff88012f3cd180 x1830967307989504/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.383809:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cd180 with x1830967307989504 ext(1101824->1380351) 00010000:00010000:3.0:1746147143.383817:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 20 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.383829:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 20 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.383835:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3cd180 00000100:00100000:3.0:1746147143.383853:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1107 00000100:00100000:3.0:1746147143.383860:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967307989504:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147143.387174:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.387224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.388181:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310684800:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147143.388193:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310684928:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147143.388215:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->2535423] (req 2367488->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.388232:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b42ea800, rc 0) 00000100:00100000:2.0:1746147143.388273:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32323:x1830967307989376:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10445us (10721us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.388281:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14600 00000100:00100000:2.0:1746147143.388304:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989632 00000100:00100000:2.0:1746147143.388308:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989632 00000100:00100000:2.0:1746147143.388342:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14601 00000100:00100000:2.0:1746147143.388348:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+14:32313:x1830967307989632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.388360:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.388372:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e16 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.388389:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.388391:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.388396:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.388407:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.388414:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80c00, rc 0) 00000100:00100000:2.0:1746147143.388430:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+15:32313:x1830967307989632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 82us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.388436:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14601 00000100:00100000:2.0:1746147143.388463:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989760 00000100:00100000:2.0:1746147143.388466:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989760 00010000:00010000:2.0:1746147143.388479:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.388495:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6394 00000100:00100000:2.0:1746147143.388500:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967307989760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.388508:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147143.388524:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.388534:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.388547:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cd2600/0x31399394250562f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d91 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.388562:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.388576:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307989760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.388581:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6394 00000100:00100000:1.0:1746147143.392673:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.393191:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307989888 00000100:00100000:0.0:1746147143.393199:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307989888 00000100:00100000:0.0:1746147143.393248:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15280 00000100:00100000:0.0:1746147143.393257:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32324:x1830967307989888:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147143.393280:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.393294:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x31399394250563c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e1d expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.393344:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393355:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393364:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393373:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393382:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393386:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393436:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393445:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 25 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.393451:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147143.393476:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 25 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.393485:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 25 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.393494:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310685056:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147143.393565:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.393648:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.393723:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307990016 00000100:00100000:2.0:1746147143.393726:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307990016 00010000:00010000:2.0:1746147143.393742:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.393762:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6395 00000100:00100000:2.0:1746147143.393767:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307990016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.393774:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147143.393787:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.393795:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.393809:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6600/0x3139939425056272 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d52 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.393822:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.393823:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.393828:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.393833:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.393849:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.393855:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310685184:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147143.393876:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.394060:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307989504:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10200us (10533us total) trans 21474841481 rc 0/0 00000100:00100000:2.0:1746147143.394067:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1107 00002000:00100000:2.0:1746147143.394074:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1101824->1380351) req@ffff88012f3cd180 x1830967307989504/t21474841481(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.394082:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cd180 with x1830967307989504 ext(1101824->1380351) 00010000:00010000:2.0:1746147143.394106:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 22 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.394114:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 22 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.394119:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3cd180 00000100:00100000:0.0:1746147143.396836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.397046:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307990272 00000100:00100000:2.0:1746147143.397053:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307990272 00002000:00100000:2.0:1746147143.397127:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011da9f480 x1830967307990272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.397137:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9f480 with x1830967307990272 ext(3145728->4194303) 00002000:00010000:2.0:1746147143.397142:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9f480 00000100:00100000:2.0:1746147143.397161:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3507 00000100:00100000:2.0:1746147143.397167:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307990272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.397437:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310685184:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.397458:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.397513:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967307990016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3744us (3864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.397523:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6395 00000100:00100000:1.0:1746147143.398835:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310685056:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.398856:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147143.404410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.406004:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.406058:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307990656 00000100:00100000:1.0:1746147143.406068:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307990656 00002000:00100000:1.0:1746147143.406132:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2367488->2371583) req@ffff880091c3df80 x1830967307990656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.406142:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3df80 with x1830967307990656 ext(2367488->2371583) 00002000:00010000:1.0:1746147143.406147:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3df80 00000100:00100000:1.0:1746147143.406182:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3508 00000100:00100000:1.0:1746147143.406190:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307990656:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.406342:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307990656:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 151us (345us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147143.406349:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3508 00002000:00100000:1.0:1746147143.406355:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2367488->2371583) req@ffff880091c3df80 x1830967307990656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.406362:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3df80 with x1830967307990656 ext(2367488->2371583) 00002000:00010000:1.0:1746147143.406364:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3df80 00000100:00100000:3.0:1746147143.406414:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307990400 00000100:00100000:3.0:1746147143.406420:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307990400 00010000:00010000:3.0:1746147143.406449:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 26 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.406477:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6396 00000100:00100000:3.0:1746147143.406483:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967307990400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.406494:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.406499:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 26 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.406508:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 26 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.406529:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x3139939425056344 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd7 expref: 26 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.406555:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147143.406560:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.406570:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.406577:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.406605:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.406627:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967307990400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 145us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.406633:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6396 00010000:00010000:1.0:1746147143.406667:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406678:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147143.406733:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147143.406737:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147143.406752:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406761:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406771:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406776:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406781:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406786:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406792:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c10200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.406796:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406801:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406808:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147143.406811:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.406813:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406818:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10200/0x31399394250563d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406836:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406840:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406844:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406848:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c10e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.406849:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406853:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406857:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d4c7200) 00010000:00010000:1.0:1746147143.406859:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.406860:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406864:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250563d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.406892:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x31399394250563c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.406902:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.406912:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.406914:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147143.406916:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c10a00, rc 0) 00000100:00100000:1.0:1746147143.406950:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32324:x1830967307989888:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 13695us (14284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.406957:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15280 00000100:00100000:3.0:1746147143.407261:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307990272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10092us (10433us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147143.407271:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3507 00002000:00100000:3.0:1746147143.407276:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011da9f480 x1830967307990272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.407284:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9f480 with x1830967307990272 ext(3145728->4194303) 00002000:00010000:3.0:1746147143.407287:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9f480 00000100:00100000:0.0:1746147143.407786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.407819:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307990784 00000100:00100000:3.0:1746147143.407824:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307990784 00010000:00010000:3.0:1746147143.407842:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 22 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.407873:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6397 00000100:00100000:3.0:1746147143.407878:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307990784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.407886:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.407900:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 22 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.407909:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 22 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.407935:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x31399394250562c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1380351) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d6e expref: 22 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.407947:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.407950:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.407956:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.407966:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.407994:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.408006:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310685312:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.408079:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.412500:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.412545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.412588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.412697:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991168 00000100:00100000:2.0:1746147143.412707:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991168 00000100:00100000:2.0:1746147143.412748:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991296 00000100:00100000:2.0:1746147143.412750:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991296 00000100:00100000:2.0:1746147143.412771:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14602 00000100:00100000:2.0:1746147143.412779:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307991168:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147143.412799:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.412819:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e24 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.412842:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.412843:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.412852:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.412868:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.412878:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80e00, rc 0) 00000100:00100000:2.0:1746147143.412933:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307991168:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.412940:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14602 00000100:00100000:2.0:1746147143.412954:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14603 00000100:00100000:2.0:1746147143.412959:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967307991296:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147143.412966:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.412976:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e2b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.412988:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.412989:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.412993:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.413005:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.413012:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81c00, rc 0) 00000100:00100000:2.0:1746147143.413028:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307991296:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 68us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.413032:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14603 00000100:00100000:3.0:1746147143.413298:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991040 00000100:00100000:3.0:1746147143.413303:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991040 00002000:00100000:3.0:1746147143.413333:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2531328->2535423) req@ffff880091c3ca80 x1830967307991040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.413343:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ca80 with x1830967307991040 ext(2531328->2535423) 00002000:00010000:3.0:1746147143.413348:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3ca80 00000100:00100000:3.0:1746147143.413361:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3509 00000100:00100000:3.0:1746147143.413365:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307991040:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147143.413477:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967307991040:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 110us (987us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147143.413482:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3509 00002000:00100000:3.0:1746147143.413486:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2531328->2535423) req@ffff880091c3ca80 x1830967307991040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.413492:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ca80 with x1830967307991040 ext(2531328->2535423) 00002000:00010000:3.0:1746147143.413495:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3ca80 00000100:00100000:0.0:1746147143.414165:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.414523:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.415176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.415363:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310685312:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147143.415384:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.415419:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307990784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7540us (7634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.415429:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6397 00000100:00100000:0.0:1746147143.415994:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.416026:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991424 00000100:00100000:1.0:1746147143.416033:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991424 00000100:00100000:1.0:1746147143.416061:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991552 00000100:00100000:1.0:1746147143.416064:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991552 00000100:00100000:1.0:1746147143.416081:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991680 00000100:00100000:1.0:1746147143.416084:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991680 00000100:00100000:1.0:1746147143.416111:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14604 00000100:00100000:1.0:1746147143.416117:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967307991424:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147143.416133:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.416150:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e32 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.416171:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.416174:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.416181:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.416195:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.416204:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c600, rc 0) 00000100:00100000:1.0:1746147143.416229:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307991424:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 112us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.416234:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14604 00000100:00100000:1.0:1746147143.416246:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14605 00000100:00100000:1.0:1746147143.416250:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307991552:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147143.416257:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.416267:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e39 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.416278:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.416280:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.416284:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.416294:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.416301:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:1.0:1746147143.416317:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967307991552:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 66us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.416322:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14605 00000100:00100000:1.0:1746147143.416331:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14606 00000100:00100000:1.0:1746147143.416336:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307991680:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147143.416341:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.416348:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425056401 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e40 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.416369:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425056401 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e40 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.416377:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425056401 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e40 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.416386:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:1.0:1746147143.416401:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307991680:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 65us (1227us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147143.416406:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14606 00000100:00100000:0.0:1746147143.416977:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991808 00000100:00100000:0.0:1746147143.416981:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991808 00000100:00100000:0.0:1746147143.417001:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14607 00000100:00100000:0.0:1746147143.417005:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967307991808:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147143.417012:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.417020:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e47 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.417031:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.417032:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147143.417036:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.417045:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.417052:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:0.0:1746147143.417065:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967307991808:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 60us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147143.417070:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14607 00000100:00100000:0.0:1746147143.417126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.417144:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.417162:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.417215:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.417244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.417258:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307992576 00000100:00100000:0.0:1746147143.417260:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307992576 00002000:00100000:0.0:1746147143.417284:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009f087b80 x1830967307992576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.417293:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087b80 with x1830967307992576 ext(1048576->2097151) 00002000:00010000:0.0:1746147143.417297:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087b80 00000100:00100000:0.0:1746147143.417308:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307992832 00000100:00100000:0.0:1746147143.417310:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307992832 00002000:00100000:0.0:1746147143.417321:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009f087480 x1830967307992832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.417327:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967307992832 ext(1048576->2097151) 00002000:00010000:0.0:1746147143.417330:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:0.0:1746147143.417344:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3510 00000100:00100000:0.0:1746147143.417348:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307992576:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147143.418081:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3511 00000100:00100000:0.0:1746147143.418086:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307992832:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.418152:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307991936 00000100:00100000:1.0:1746147143.418156:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307991936 00000100:00100000:1.0:1746147143.418175:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307992064 00000100:00100000:1.0:1746147143.418177:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307992064 00000100:00100000:1.0:1746147143.418198:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14608 00000100:00100000:1.0:1746147143.418203:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967307991936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.418212:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.418222:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e4e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.418236:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.418237:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.418242:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147143.418243:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14609 00000100:00100000:2.0:1746147143.418250:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307992064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.418253:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.418257:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.418263:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c000, rc 0) 00010000:00010000:2.0:1746147143.418265:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x3139939425056416 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e55 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.418282:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x3139939425056416 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e55 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147143.418282:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967307991936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 78us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.418287:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14608 00010000:00010000:2.0:1746147143.418290:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x3139939425056416 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e55 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.418307:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80200, rc 0) 00000100:00100000:2.0:1746147143.418323:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307992064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 75us (1178us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147143.418328:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14609 00000100:00100000:3.0:1746147143.419178:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307992320 00000100:00100000:3.0:1746147143.419185:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307992320 00000100:00100000:3.0:1746147143.419214:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5476 00000100:00100000:3.0:1746147143.419219:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32323:x1830967307992320:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147143.419386:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32323:x1830967307992320:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 165us (2221us total) trans 8589935970 rc 0/0 00000100:00100000:3.0:1746147143.419392:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5476 00000100:00100000:3.0:1746147143.427849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.427937:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307993088 00000100:00100000:1.0:1746147143.427947:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307993088 00000100:00100000:1.0:1746147143.428045:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15281 00000100:00100000:1.0:1746147143.428054:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32324:x1830967307993088:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147143.428073:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.428113:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505641d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e5c expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.428324:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.428340:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.428348:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.428378:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.428390:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 10 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.428406:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310685440:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.428710:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.433248:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967307992576:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15885us (16018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147143.433263:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3510 00002000:00100000:2.0:1746147143.433275:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009f087b80 x1830967307992576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.433284:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087b80 with x1830967307992576 ext(1048576->2097151) 00002000:00010000:2.0:1746147143.433290:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087b80 00000100:00100000:0.0:1746147143.439582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.439995:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967307992832:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21905us (22746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147143.440008:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3511 00002000:00100000:2.0:1746147143.440022:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009f087480 x1830967307992832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.440031:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967307992832 ext(1048576->2097151) 00002000:00010000:2.0:1746147143.440038:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:0.0:1746147143.440139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.440242:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307993216 00000100:00100000:3.0:1746147143.440250:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307993216 00010000:00010000:3.0:1746147143.440278:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 11 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.440303:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6398 00000100:00100000:3.0:1746147143.440309:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307993216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.440322:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.440328:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 11 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.440335:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307993472 00010000:00010000:3.0:1746147143.440339:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 11 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.440339:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307993472 00010000:00010000:3.0:1746147143.440361:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00002000:00100000:2.0:1746147143.440366:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f086680 x1830967307993472/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147143.440367:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00002000:00100000:2.0:1746147143.440373:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086680 with x1830967307993472 ext(4194304->4919295) 00010000:00010000:3.0:1746147143.440376:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 9138 initiator: MDT0 00002000:00010000:2.0:1746147143.440377:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f086680 00010000:00010000:3.0:1746147143.440385:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147143.440395:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3512 00000100:00100000:2.0:1746147143.440401:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307993472:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147143.440402:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.440419:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307993216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.440425:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6398 00010000:00010000:1.0:1746147143.440539:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10a00/0x31399394250563de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e1d expref: 10 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.440562:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310685440:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.440579:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.440587:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.440593:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147143.440609:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.440728:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505641d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e5c expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.440741:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e5c expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.440747:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.440749:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147143.440752:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d000, rc 0) 00000100:00100000:1.0:1746147143.440774:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32324:x1830967307993088:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 12722us (12937us total) trans 8589935971 rc 0/0 00000100:00100000:1.0:1746147143.440784:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15281 00000100:00100000:3.0:1746147143.447120:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.447163:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307993600 00000100:00100000:1.0:1746147143.447172:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307993600 00000100:00100000:1.0:1746147143.447220:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14610 00000100:00100000:1.0:1746147143.447227:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32321:x1830967307993600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.447245:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.447263:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e63 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.447292:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.447300:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147143.447301:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147143.447304:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.447334:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.447346:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.447357:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310685568:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.447437:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.447664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.447694:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307993856 00000100:00100000:0.0:1746147143.447698:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307993856 00000100:00100000:0.0:1746147143.447725:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15282 00000100:00100000:0.0:1746147143.447730:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32324:x1830967307993856:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147143.447745:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147143.447748:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1746147143.447760:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307993472:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7357us (7619us total) trans 0 rc 724992/724992 00010000:00010000:0.0:1746147143.447767:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425056424 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e5c expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.447768:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3512 00002000:00100000:3.0:1746147143.447776:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f086680 x1830967307993472/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147143.447784:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00002000:00100000:3.0:1746147143.447785:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086680 with x1830967307993472 ext(4194304->4919295) 00010000:00010000:0.0:1746147143.447788:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746147143.447789:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f086680 00010000:00010000:0.0:1746147143.447810:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x3139939425056439 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e6a expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.447916:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447941:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447950:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447961:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447967:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447976:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447982:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49c4600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147143.447985:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447991:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.447997:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147143.447999:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147143.448001:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.448006:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x3139939425056440 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.448030:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x3139939425056439 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e6a expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.448037:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x3139939425056439 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e6a expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.448043:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0da00, rc 0) 00000100:00100000:3.0:1746147143.448069:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32324:x1830967307993856:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 339us (981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.448074:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15282 00000100:00100000:1.0:1746147143.454197:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310685568:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.454235:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.454255:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c11c00, rc 0) 00000100:00100000:1.0:1746147143.454317:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32321:x1830967307993600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7089us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.454327:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14610 00000100:00100000:0.0:1746147143.455360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.455427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.456028:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307994240 00000100:00100000:3.0:1746147143.456036:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307994240 00002000:00100000:3.0:1746147143.456080:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2367488->2535423) req@ffff88009f086300 x1830967307994240/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147143.456195:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307994112 00000100:00100000:1.0:1746147143.456199:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307994112 00000100:00100000:1.0:1746147143.456245:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5477 00000100:00100000:1.0:1746147143.456252:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f89450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32324:x1830967307994112:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147143.456443:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f89450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32324:x1830967307994112:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 189us (1084us total) trans 8589935972 rc 0/0 00000100:00100000:1.0:1746147143.456449:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5477 00002000:00100000:3.0:1746147143.456578:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086300 with x1830967307994240 ext(2367488->2535423) 00010000:00010000:3.0:1746147143.456588:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.456602:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 36 pid: 1854 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.456609:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f086300 00000100:00100000:3.0:1746147143.456624:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1108 00000100:00100000:3.0:1746147143.456634:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307994240:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147143.461472:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.461519:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307994368 00000100:00100000:0.0:1746147143.461632:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307994368 00000100:00100000:3.0:1746147143.462257:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14611 00000100:00100000:3.0:1746147143.462266:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307994368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.462283:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.462298:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4000/0x3139939425056447 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e71 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.462327:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4000/0x3139939425056447 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e71 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.462338:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4000/0x3139939425056447 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e71 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.462936:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4000, rc 0) 00000100:00100000:3.0:1746147143.463013:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967307994368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 747us (1566us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.463021:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14611 00000100:00100000:0.0:1746147143.469219:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.469276:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307994496 00000100:00100000:3.0:1746147143.469287:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307994496 00000100:00100000:3.0:1746147143.469339:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14612 00000100:00100000:3.0:1746147143.469347:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307994496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.469362:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.469377:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505644e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e78 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.469405:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505644e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e78 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.469414:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505644e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e78 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.469546:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4600, rc 0) 00000100:00100000:3.0:1746147143.469757:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967307994496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 410us (550us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.469764:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14612 00000100:00100000:3.0:1746147143.470166:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967307994240:12345-192.168.204.25@tcp:4:cat.0 Request processed in 13535us (14737us total) trans 17179874215 rc 0/0 00000100:00100000:3.0:1746147143.470176:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1108 00002000:00100000:3.0:1746147143.470184:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2367488->2535423) req@ffff88009f086300 x1830967307994240/t17179874215(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.470193:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086300 with x1830967307994240 ext(2367488->2535423) 00010000:00010000:3.0:1746147143.470201:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 38 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.470213:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 38 pid: 1854 timeout: 781 lvb_type: 0 00002000:00010000:3.0:1746147143.470219:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f086300 00000100:00100000:2.0:1746147143.474986:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.475122:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307994624 00000100:00100000:3.0:1746147143.475130:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307994624 00010000:00010000:3.0:1746147143.475162:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 38 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.475745:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6399 00000100:00100000:3.0:1746147143.475754:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967307994624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.475766:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147143.475781:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147142 -> 1746147143 00002000:00010000:3.0:1746147143.475784:0:7227:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147142 -> 1746147143 00010000:00010000:3.0:1746147143.475789:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 38 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.475800:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 38 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.475820:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b42ea800/0x31399394250563bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2367488->3145727] (req 2367488->2535423) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e0f expref: 38 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.475832:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.475835:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.475840:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.475847:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.475874:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.475884:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310685696:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.475973:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.481675:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310685696:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.481696:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.481735:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307994624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5981us (6758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.481745:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6399 00000100:00100000:0.0:1746147143.490263:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.491390:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307994880 00000100:00100000:3.0:1746147143.491399:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307994880 00002000:00100000:3.0:1746147143.491437:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009f084700 x1830967307994880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.491446:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967307994880 ext(2097152->4194303) 00002000:00010000:3.0:1746147143.491451:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:3.0:1746147143.492008:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3513 00000100:00100000:3.0:1746147143.492017:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307994880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.506845:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967307994880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14822us (16582us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147143.506856:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3513 00002000:00100000:3.0:1746147143.506865:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009f084700 x1830967307994880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.506874:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967307994880 ext(2097152->4194303) 00002000:00010000:3.0:1746147143.506879:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:0.0:1746147143.522603:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.522829:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307995008 00000100:00100000:3.0:1746147143.522837:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307995008 00000100:00100000:3.0:1746147143.522894:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14613 00000100:00100000:3.0:1746147143.522901:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:32318:x1830967307995008:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147143.522917:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.522943:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e7f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.522968:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.522976:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.522983:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.522989:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.522990:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.522993:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [90112->1048575] (req 90112->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.523025:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.523036:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 36 pid: 9586 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.523046:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310685824:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.523160:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.523168:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 10 pid: 9586 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.523175:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310685952:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.523199:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.523205:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.523212:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310686080:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.523738:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.524652:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.524726:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307995264 00000100:00100000:3.0:1746147143.524731:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307995264 00002000:00100000:3.0:1746147143.524764:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f085c00 x1830967307995264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.524774:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085c00 with x1830967307995264 ext(4194304->4919295) 00002000:00010000:3.0:1746147143.524780:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085c00 00000100:00100000:3.0:1746147143.524848:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3514 00000100:00100000:3.0:1746147143.524855:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967307995264:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.530293:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310685824:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.530304:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310685952:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.531050:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310686080:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.531110:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [90112->1048575] (req 90112->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.531129:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffd800, rc 0) 00000100:00100000:3.0:1746147143.531174:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:32318:x1830967307995008:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8273us (8579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.531182:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14613 00000100:00100000:0.0:1746147143.532840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.532896:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.533066:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307995392 00000100:00100000:2.0:1746147143.533077:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307995392 00010000:00010000:2.0:1746147143.533148:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 39 pid: 9586 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.533220:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307995520 00000100:00100000:2.0:1746147143.533224:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307995520 00010000:00010000:2.0:1746147143.533238:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 11 pid: 9586 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.533255:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6400 00000100:00100000:2.0:1746147143.533262:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967307995392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.533279:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147143.533298:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 39 pid: 9586 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.533307:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 39 pid: 9586 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.533325:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x3139939425056375 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77de5 expref: 39 pid: 9586 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.533344:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.533379:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6401 00000100:00100000:3.0:1746147143.533396:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967307995520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.533410:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.533428:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 11 pid: 9586 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.533441:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 11 pid: 9586 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.533458:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x31399394250563e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e24 expref: 11 pid: 9586 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.534345:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967307995392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1079us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.534354:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6400 00000100:00100000:0.0:1746147143.534842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.535075:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967307995264:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10220us (10424us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147143.535086:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3514 00002000:00100000:0.0:1746147143.535124:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f085c00 x1830967307995264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.535137:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085c00 with x1830967307995264 ext(4194304->4919295) 00002000:00010000:0.0:1746147143.535142:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085c00 00000100:00100000:2.0:1746147143.535208:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307995648 00000100:00100000:2.0:1746147143.535213:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307995648 00010000:00010000:2.0:1746147143.535234:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.535252:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6402 00000100:00100000:2.0:1746147143.535257:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307995648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.535266:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147143.535281:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.535291:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.535308:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425056305 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d9f expref: 15 pid: 9585 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.535319:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.535321:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147143.535327:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.535334:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.535366:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.535377:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310686208:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147143.535440:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147143.535620:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.537265:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967307995520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3865us (4362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.537274:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6401 00000100:00100000:0.0:1746147143.540556:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.541315:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307995776 00000100:00100000:3.0:1746147143.541328:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307995776 00000100:00100000:3.0:1746147143.541390:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14614 00000100:00100000:3.0:1746147143.541398:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307995776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.541415:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.541435:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x313993942505645c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e86 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.541490:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310686336:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147143.541568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.541578:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.541634:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307996032 00000100:00100000:3.0:1746147143.541637:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307996032 00002000:00100000:3.0:1746147143.541663:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (90112->94207) req@ffff880096cf8a80 x1830967307996032/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.541671:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8a80 with x1830967307996032 ext(90112->94207) 00002000:00010000:3.0:1746147143.541675:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf8a80 00000100:00100000:3.0:1746147143.541696:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3515 00000100:00100000:3.0:1746147143.541701:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307996032:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147143.541811:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307996032:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 109us (243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147143.541819:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3515 00002000:00100000:3.0:1746147143.541824:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (90112->94207) req@ffff880096cf8a80 x1830967307996032/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.541830:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8a80 with x1830967307996032 ext(90112->94207) 00002000:00010000:3.0:1746147143.541833:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf8a80 00000100:00100000:2.0:1746147143.542025:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310686208:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147143.542040:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.542062:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307995648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6805us (7224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.542069:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6402 00000100:00100000:0.0:1746147143.546056:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310686336:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147143.546135:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x313993942505645c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e86 expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.546150:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x313993942505645c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e86 expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147143.546792:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348c00, rc 0) 00000100:00100000:1.0:1746147143.546957:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307995776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5552us (6403us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147143.546966:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14614 00000100:00100000:0.0:1746147143.552901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.553723:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307996160 00000100:00100000:1.0:1746147143.553732:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307996160 00000100:00100000:1.0:1746147143.553779:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14615 00000100:00100000:1.0:1746147143.553788:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307996160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.553805:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.553821:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c11e00/0x3139939425056463 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e8d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147143.553867:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310686464:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147143.553952:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.556743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.557593:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307996416 00000100:00100000:3.0:1746147143.557602:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307996416 00002000:00100000:3.0:1746147143.557637:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (1044480->1048575) req@ffff880096cf9f80 x1830967307996416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.557646:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9f80 with x1830967307996416 ext(1044480->1048575) 00002000:00010000:3.0:1746147143.557651:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9f80 00000100:00100000:3.0:1746147143.557669:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3516 00000100:00100000:3.0:1746147143.557676:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307996416:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.558155:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310686464:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147143.558182:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c11e00/0x3139939425056463 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e8d expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.558192:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c11e00/0x3139939425056463 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e8d expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.558215:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c11e00, rc 0) 00000100:00100000:1.0:1746147143.558265:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967307996160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4478us (5372us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147143.558271:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14615 00000100:00100000:3.0:1746147143.558728:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967307996416:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 718us (1658us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147143.558736:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3516 00002000:00100000:3.0:1746147143.558742:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (1044480->1048575) req@ffff880096cf9f80 x1830967307996416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.558749:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9f80 with x1830967307996416 ext(1044480->1048575) 00002000:00010000:3.0:1746147143.558752:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9f80 00000100:00100000:0.0:1746147143.564327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.564409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.564410:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307996672 00000100:00100000:2.0:1746147143.564422:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307996672 00000100:00100000:0.0:1746147143.565258:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307996928 00000100:00100000:0.0:1746147143.565266:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307996928 00000100:00100000:2.0:1746147143.565290:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5478 00000100:00100000:2.0:1746147143.565305:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:32318:x1830967307996672:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147143.565620:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:32318:x1830967307996672:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 314us (1299us total) trans 8589935973 rc 0/0 00000100:00100000:2.0:1746147143.566261:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5478 00000100:00100000:2.0:1746147143.566280:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5479 00000100:00100000:2.0:1746147143.566287:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32321:x1830967307996928:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147143.566373:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32321:x1830967307996928:12345-192.168.204.25@tcp:35:cat.0 Request processed in 87us (1963us total) trans 8589935974 rc 0/0 00000100:00100000:2.0:1746147143.566379:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5479 00000100:00100000:0.0:1746147143.599479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.600374:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307997056 00000100:00100000:1.0:1746147143.600384:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307997056 00000100:00100000:1.0:1746147143.600439:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14616 00000100:00100000:1.0:1746147143.600447:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967307997056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.600462:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.600477:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e94 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.600498:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.600499:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.600507:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.600520:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.600533:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c10200, rc 0) 00000100:00100000:1.0:1746147143.600611:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967307997056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 165us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.600617:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14616 00000100:00100000:0.0:1746147143.605539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.605587:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.605649:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307997568 00000100:00100000:2.0:1746147143.605658:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307997568 00002000:00100000:2.0:1746147143.605699:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->90111) req@ffff8800984d6a00 x1830967307997568/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.605708:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6a00 with x1830967307997568 ext(0->90111) 00002000:00010000:2.0:1746147143.605713:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6a00 00000100:00100000:2.0:1746147143.605728:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307997440 00000100:00100000:2.0:1746147143.605730:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307997440 00002000:00100000:2.0:1746147143.605741:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800984d5880 x1830967307997440/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.605748:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5880 with x1830967307997440 ext(1048576->2097151) 00002000:00010000:2.0:1746147143.605751:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5880 00000100:00100000:2.0:1746147143.605777:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3517 00000100:00100000:2.0:1746147143.605783:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307997568:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.605992:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3518 00000100:00100000:3.0:1746147143.606001:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307997440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147143.611703:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307997568:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5911us (6163us total) trans 0 rc 90112/90112 00000100:00100000:2.0:1746147143.611714:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3517 00002000:00100000:2.0:1746147143.611724:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->90111) req@ffff8800984d6a00 x1830967307997568/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 90112/90112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.611733:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6a00 with x1830967307997568 ext(0->90111) 00002000:00010000:2.0:1746147143.611739:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6a00 00000100:00100000:3.0:1746147143.615754:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307997440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9748us (10159us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147143.615763:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3518 00002000:00100000:3.0:1746147143.615772:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800984d5880 x1830967307997440/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.615781:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5880 with x1830967307997440 ext(1048576->2097151) 00002000:00010000:3.0:1746147143.615786:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5880 00000100:00100000:0.0:1746147143.626914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.627313:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307997824 00000100:00100000:3.0:1746147143.627321:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307997824 00002000:00100000:3.0:1746147143.627375:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800984d6300 x1830967307997824/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.627385:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6300 with x1830967307997824 ext(2097152->3145727) 00002000:00010000:3.0:1746147143.627390:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6300 00000100:00100000:3.0:1746147143.627628:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3519 00000100:00100000:3.0:1746147143.627636:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307997824:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147143.632255:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147143.645557:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967307997824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17913us (18640us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147143.645568:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3519 00002000:00100000:3.0:1746147143.645578:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800984d6300 x1830967307997824/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.645586:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6300 with x1830967307997824 ext(2097152->3145727) 00002000:00010000:3.0:1746147143.645591:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6300 00000100:00100000:0.0:1746147143.662164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.662250:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307998080 00000100:00100000:3.0:1746147143.662258:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307998080 00000100:00100000:3.0:1746147143.662299:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15283 00000100:00100000:3.0:1746147143.662306:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32334:x1830967307998080:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147143.662329:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.662345:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348000/0x3139939425056471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77e9b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.662406:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662416:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662425:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662435:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662440:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662444:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662532:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662540:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662545:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147143.662552:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147143.662607:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662616:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662621:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662626:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662630:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136349a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147143.662633:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662638:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662647:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147143.662649:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147143.662652:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.662656:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425056478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663185:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663191:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663195:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663199:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136348600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147143.663202:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663206:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663213:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1900) 00010000:00010000:3.0:1746147143.663215:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147143.663217:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663221:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x313993942505647f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.663255:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348000/0x3139939425056471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 47 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.663265:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 46 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.663270:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147143.663272:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147143.663274:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348c00, rc 0) 00000100:00100000:3.0:1746147143.664539:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32334:x1830967307998080:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2228us (2378us total) trans 8589935975 rc 0/0 00000100:00100000:3.0:1746147143.664547:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15283 00000100:00100000:0.0:1746147143.675839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.675930:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307998208 00000100:00100000:1.0:1746147143.675938:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307998208 00000100:00100000:1.0:1746147143.675988:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14617 00000100:00100000:1.0:1746147143.675995:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32334:x1830967307998208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147143.676013:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.676028:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ea2 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.676052:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.676059:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.676066:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.676070:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.676072:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.676074:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3768320->4059135] (req 3768320->4059135) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.676128:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 21 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.676139:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 21 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746147143.676148:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310686592:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.676226:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.676232:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 10 pid: 9585 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746147143.676239:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310686720:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.676256:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.676263:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.676268:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310686848:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.676279:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.680836:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310686592:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.680850:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310686720:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.680856:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310686848:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.680881:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3768320->4059135] (req 3768320->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.680896:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563800, rc 0) 00000100:00100000:1.0:1746147143.680956:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32334:x1830967307998208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4960us (5123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.680963:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14617 00000100:00100000:0.0:1746147143.686418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.686471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.686559:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307998464 00000100:00100000:3.0:1746147143.686566:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307998464 00010000:00010000:3.0:1746147143.686603:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 22 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.686648:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307998336 00000100:00100000:3.0:1746147143.686651:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6403 00000100:00100000:2.0:1746147143.686652:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307998336 00000100:00100000:3.0:1746147143.686659:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967307998464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.686668:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 11 pid: 9585 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.686671:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.686687:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 22 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.686695:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6404 00010000:00010000:3.0:1746147143.686697:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 22 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746147143.686700:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967307998336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.686707:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.686715:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x31399394250562f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d98 expref: 22 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.686715:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 11 pid: 9585 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.686723:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 11 pid: 9585 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746147143.686735:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db33000/0x3139939425056408 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e47 expref: 11 pid: 9585 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.686826:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147143.686855:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.687871:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967307998336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1168us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.687878:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6404 00000100:00100000:3.0:1746147143.687938:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967307998464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1278us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.687945:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6403 00000100:00100000:0.0:1746147143.688009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.688389:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307998592 00000100:00100000:3.0:1746147143.688393:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307998592 00010000:00010000:3.0:1746147143.688409:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.688435:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6405 00000100:00100000:3.0:1746147143.688440:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967307998592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.688448:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.688459:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.688468:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.688481:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6a00/0x3139939425056279 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d59 expref: 33 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.688492:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.688493:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.688498:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.688506:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.688529:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.688538:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310686976:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.688606:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.692386:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967310686976:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.692406:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.692457:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967307998592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4014us (4448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.692466:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6405 00000100:00100000:0.0:1746147143.693032:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.693692:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307998848 00000100:00100000:3.0:1746147143.693698:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307998848 00002000:00100000:3.0:1746147143.693739:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3768320->3772415) req@ffff8800984d7b80 x1830967307998848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.693748:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7b80 with x1830967307998848 ext(3768320->3772415) 00002000:00010000:3.0:1746147143.693752:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d7b80 00000100:00100000:3.0:1746147143.693781:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3520 00000100:00100000:3.0:1746147143.693788:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307998848:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147143.694471:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307998848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 682us (1438us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147143.694478:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3520 00002000:00100000:3.0:1746147143.694483:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3768320->3772415) req@ffff8800984d7b80 x1830967307998848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.694494:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7b80 with x1830967307998848 ext(3768320->3772415) 00002000:00010000:3.0:1746147143.694497:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d7b80 00000100:00100000:0.0:1746147143.697512:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.697716:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307999104 00000100:00100000:3.0:1746147143.697725:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307999104 00000100:00100000:3.0:1746147143.697769:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15284 00000100:00100000:3.0:1746147143.697776:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:32337:x1830967307999104:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147143.697797:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.697813:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348200/0x313993942505649b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ea9 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.697913:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.697938:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 45 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.697944:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.697970:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 45 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.697981:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 45 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.697992:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310687104:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.698779:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.700641:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310687104:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.700663:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147143.701148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.701324:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307999360 00000100:00100000:3.0:1746147143.701329:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307999360 00010000:00010000:3.0:1746147143.701353:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 46 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.701387:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6406 00000100:00100000:3.0:1746147143.701393:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967307999360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.701404:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.701409:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 46 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.701419:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 46 pid: 9138 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.701437:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348c00/0x3139939425056486 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e9b expref: 46 pid: 9138 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.701496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.701593:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307999488 00000100:00100000:2.0:1746147143.701597:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307999488 00002000:00100000:2.0:1746147143.701622:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (4055040->4059135) req@ffff8800984d4a80 x1830967307999488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.701631:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4a80 with x1830967307999488 ext(4055040->4059135) 00002000:00010000:2.0:1746147143.701635:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d4a80 00000100:00100000:2.0:1746147143.701648:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3521 00000100:00100000:2.0:1746147143.701653:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307999488:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:3.0:1746147143.701836:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147143.701841:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.701849:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.701854:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147143.701873:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147143.701961:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.701968:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147143.701982:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.702114:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348200/0x313993942505649b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.702136:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.702142:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.702144:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147143.702146:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348a00, rc 0) 00000100:00100000:2.0:1746147143.702295:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967307999488:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 640us (797us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147143.702302:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3521 00002000:00100000:2.0:1746147143.702307:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (4055040->4059135) req@ffff8800984d4a80 x1830967307999488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.702314:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4a80 with x1830967307999488 ext(4055040->4059135) 00002000:00010000:2.0:1746147143.702317:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d4a80 00000100:00100000:3.0:1746147143.702364:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967307999360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 970us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.702371:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6406 00000100:00100000:1.0:1746147143.702720:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:32337:x1830967307999104:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4944us (5215us total) trans 8589935976 rc 0/0 00000100:00100000:1.0:1746147143.702729:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15284 00000100:00100000:0.0:1746147143.707286:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.707410:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307999744 00000100:00100000:1.0:1746147143.707417:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307999744 00000100:00100000:1.0:1746147143.707468:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5480 00000100:00100000:1.0:1746147143.707475:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32334:x1830967307999744:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147143.707632:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32334:x1830967307999744:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 156us (351us total) trans 8589935977 rc 0/0 00000100:00100000:1.0:1746147143.707638:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5480 00000100:00100000:0.0:1746147143.746036:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.746138:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967307999872 00000100:00100000:1.0:1746147143.746147:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967307999872 00000100:00100000:1.0:1746147143.746252:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14618 00000100:00100000:1.0:1746147143.746260:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:32337:x1830967307999872:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147143.746276:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.746291:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77eb0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.746317:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.746323:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.746329:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.746338:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147143.746340:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147143.746343:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.746365:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.746375:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.746386:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310687232:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.746755:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147143.746763:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 16 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746147143.746771:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310687360:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.746800:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.746807:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 35 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.746819:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310687488:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.746836:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.749036:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310687232:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.749045:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310687360:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147143.752707:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310687488:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147143.752745:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.752763:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563a00, rc 0) 00000100:00100000:1.0:1746147143.752811:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:32337:x1830967307999872:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6551us (6782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.752819:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14618 00000100:00100000:0.0:1746147143.753424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.753657:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000000 00000100:00100000:3.0:1746147143.753663:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000000 00010000:00010000:3.0:1746147143.753691:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.754597:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6407 00000100:00100000:3.0:1746147143.754605:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308000000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.754618:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.754636:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.754647:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.754667:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x31399394250563c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e16 expref: 16 pid: 1854 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.754684:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.754716:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308000000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.754722:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6407 00000100:00100000:0.0:1746147143.755120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.755812:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000128 00000100:00100000:3.0:1746147143.755817:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000128 00010000:00010000:3.0:1746147143.755836:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.755893:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6408 00000100:00100000:3.0:1746147143.755899:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308000128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.755907:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.755928:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.755940:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.755959:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c10200/0x313993942505646a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e94 expref: 15 pid: 12225 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746147143.755969:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.756610:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308000128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 708us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.756616:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6408 00000100:00100000:2.0:1746147143.757200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.757345:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000256 00000100:00100000:3.0:1746147143.757349:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000256 00010000:00010000:3.0:1746147143.757364:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.757392:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6409 00000100:00100000:3.0:1746147143.757397:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308000256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.757405:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.757416:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.757425:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.757438:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c11c00/0x3139939425056432 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e63 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.757447:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.757449:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.757455:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.757461:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.757486:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.757496:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310687616:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.757560:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.762438:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310687616:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.762458:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.762509:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308000256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5110us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.762519:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6409 00000100:00100000:0.0:1746147143.764890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.765822:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000512 00000100:00100000:2.0:1746147143.765831:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000512 00002000:00100000:2.0:1746147143.765875:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3805184->3809279) req@ffff880098c70a80 x1830967308000512/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.765885:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70a80 with x1830967308000512 ext(3805184->3809279) 00002000:00010000:2.0:1746147143.765890:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c70a80 00000100:00100000:2.0:1746147143.765934:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3522 00000100:00100000:2.0:1746147143.765943:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308000512:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147143.767477:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308000512:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1531us (2589us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147143.767486:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3522 00002000:00100000:2.0:1746147143.767494:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3805184->3809279) req@ffff880098c70a80 x1830967308000512/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.767501:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70a80 with x1830967308000512 ext(3805184->3809279) 00002000:00010000:2.0:1746147143.767505:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c70a80 00000100:00100000:0.0:1746147143.775903:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.777289:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000640 00000100:00100000:3.0:1746147143.777299:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000640 00000100:00100000:3.0:1746147143.777398:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14619 00000100:00100000:3.0:1746147143.777406:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+21:32337:x1830967308000640:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147143.777425:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.777442:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77eb7 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.777470:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.777481:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.777483:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.777486:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->3149823] (req 3145728->3149823) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.777511:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.777523:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 31 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.777534:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310687744:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.778507:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.781559:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310687744:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.781584:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->3149823] (req 3145728->3149823) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.781598:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136349400, rc 0) 00000100:00100000:3.0:1746147143.781679:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:32337:x1830967308000640:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4272us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.781687:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14619 00000100:00100000:0.0:1746147143.782390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.782541:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000768 00000100:00100000:2.0:1746147143.782548:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000768 00002000:00100000:2.0:1746147143.782579:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3768320->4059135) req@ffff880098c73480 x1830967308000768/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.782588:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73480 with x1830967308000768 ext(3768320->4059135) 00010000:00010000:2.0:1746147143.782595:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 32 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.782606:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 32 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.782613:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c73480 00000100:00100000:2.0:1746147143.783113:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1109 00000100:00100000:2.0:1746147143.783120:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308000768:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147143.788603:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308000768:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5465us (6197us total) trans 21474841482 rc 0/0 00000100:00100000:0.0:1746147143.788618:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1109 00002000:00100000:0.0:1746147143.788632:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3768320->4059135) req@ffff880098c73480 x1830967308000768/t21474841482(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.788642:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73480 with x1830967308000768 ext(3768320->4059135) 00010000:00010000:0.0:1746147143.788654:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 34 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746147143.788675:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 34 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746147143.788682:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c73480 00000100:00100000:0.0:1746147143.790542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.790782:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308000896 00000100:00100000:3.0:1746147143.790792:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308000896 00000100:00100000:3.0:1746147143.790837:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14620 00000100:00100000:3.0:1746147143.790845:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967308000896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.790865:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.792726:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x31399394250564be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ebe expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.792802:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310687872:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147143.792931:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.796082:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.796150:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308001152 00000100:00100000:1.0:1746147143.796160:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308001152 00000100:00100000:1.0:1746147143.796217:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15285 00000100:00100000:1.0:1746147143.796225:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32344:x1830967308001152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147143.796249:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.796265:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562400/0x31399394250564c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ec5 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.796328:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796340:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796349:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796360:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796365:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796369:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796454:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x31399394250564da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796463:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x31399394250564da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796469:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x31399394250564da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147143.796477:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.796539:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796544:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796549:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796554:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796559:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092562e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.796563:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796568:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796577:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147143.796580:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.796583:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796587:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562e00/0x31399394250564cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796611:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796616:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796620:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796624:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092562000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.796626:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.796630:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.797075:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006a00) 00010000:00010000:1.0:1746147143.797078:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.797081:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.797119:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x31399394250564d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.797155:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562400/0x31399394250564c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ec5 expref: 49 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.797165:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x31399394250564da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ec5 expref: 48 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.797171:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.797173:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147143.797174:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563400, rc 0) 00000100:00100000:1.0:1746147143.797224:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32344:x1830967308001152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1000us (1149us total) trans 8589935978 rc 0/0 00000100:00100000:1.0:1746147143.797230:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15285 00002000:00010000:3.0:1746147143.801968:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147142 -> 1746147143 00002000:00010000:3.0:1746147143.801977:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147142 -> 1746147143 00002000:00010000:3.0:1746147143.801979:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147142 -> 1746147143 00000100:00100000:3.0:1746147143.802003:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310687872:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.802040:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x31399394250564be lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ebe expref: 23 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.802055:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x31399394250564be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ebe expref: 23 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.802079:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348000, rc 0) 00000100:00100000:3.0:1746147143.802170:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967308000896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11324us (11635us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.802180:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14620 00000100:00100000:0.0:1746147143.802701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.802741:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.802770:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.802823:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.802904:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308001408 00000100:00100000:2.0:1746147143.802911:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308001408 00000100:00100000:2.0:1746147143.802955:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308001536 00000100:00100000:2.0:1746147143.802958:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308001536 00000100:00100000:2.0:1746147143.802968:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308001664 00000100:00100000:2.0:1746147143.802970:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308001664 00000100:00100000:2.0:1746147143.802983:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14621 00000100:00100000:2.0:1746147143.802990:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308001408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.803006:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.803023:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0afc00/0x31399394250564e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ecc expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.803066:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310688000:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.803156:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.803174:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14622 00000100:00100000:2.0:1746147143.803180:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308001536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.803187:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.803194:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0aec00/0x31399394250564ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ed3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.803214:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310688128:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.803232:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.803246:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14623 00000100:00100000:2.0:1746147143.803251:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308001664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.803258:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.803267:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x31399394250564f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77eda expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.803288:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310688256:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.803306:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.804318:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308001280 00000100:00100000:3.0:1746147143.804323:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308001280 00010000:00010000:3.0:1746147143.804343:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.804374:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6410 00000100:00100000:3.0:1746147143.804381:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308001280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.804390:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.804408:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.804421:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.804439:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.804441:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.804448:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.804456:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.804475:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.804483:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310688384:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.804520:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.805048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.805067:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308001792 00000100:00100000:0.0:1746147143.805069:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308001792 00000100:00100000:0.0:1746147143.805103:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 813 00000100:00100000:0.0:1746147143.805108:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308001792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147143.805115:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147143.805126:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563400/0x31399394250564da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ec5 expref: 48 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147143.805152:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147143.805156:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147143.805174:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967308001792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147143.805180:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 813 00010000:00010000:3.0:1746147143.807448:0:12225:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88009cd46d80 x1830967310688256) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.807467:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310688000:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.807470:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425056494 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4059135) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea2 expref: 36 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.807484:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310688256:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147143.807490:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afc00/0x31399394250564e8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ecc expref: 38 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.807500:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afc00/0x31399394250564e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ecc expref: 38 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.807501:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x31399394250564f6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eda expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.807509:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932e3800/0x31399394250564f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eda expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.807511:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afc00, rc 0) 00010000:00010000:3.0:1746147143.807515:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932e3800, rc 0) 00000100:00100000:3.0:1746147143.807651:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308001664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4398us (4826us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147143.807651:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308001408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4660us (4908us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.807658:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14623 00002000:00010000:3.0:1746147143.807713:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147142 -> 1746147143 00000100:00100000:3.0:1746147143.807721:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310688128:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.807733:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0aec00/0x31399394250564ef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ed3 expref: 37 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.807740:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0aec00/0x31399394250564ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ed3 expref: 37 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.807747:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0aec00, rc 0) 00000100:00100000:2.0:1746147143.807764:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14621 00000100:00100000:3.0:1746147143.807820:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308001536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4638us (5048us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.807828:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14622 00000100:00100000:0.0:1746147143.812318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.812363:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310688384:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.812381:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.812417:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308001280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8035us (9726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.812426:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6410 00000100:00100000:1.0:1746147143.812508:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308002048 00000100:00100000:1.0:1746147143.812515:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308002048 00002000:00100000:1.0:1746147143.812544:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3149823) req@ffff880098c71500 x1830967308002048/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.812554:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71500 with x1830967308002048 ext(3145728->3149823) 00002000:00010000:1.0:1746147143.812558:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c71500 00000100:00100000:1.0:1746147143.812580:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3523 00000100:00100000:1.0:1746147143.812586:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308002048:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.812748:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308002048:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 162us (439us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147143.812754:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3523 00002000:00100000:1.0:1746147143.812759:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3149823) req@ffff880098c71500 x1830967308002048/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.812766:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71500 with x1830967308002048 ext(3145728->3149823) 00002000:00010000:1.0:1746147143.812768:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c71500 00000100:00100000:0.0:1746147143.814460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.814548:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308002176 00000100:00100000:3.0:1746147143.814554:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308002176 00000100:00100000:3.0:1746147143.814595:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14624 00000100:00100000:3.0:1746147143.814600:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32344:x1830967308002176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.814612:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.814627:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ee1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.814649:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.814656:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.814658:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.814661:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.814694:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.814703:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 13 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.814713:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310688512:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.815185:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.823523:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310688512:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.823550:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.823565:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348600, rc 0) 00000100:00100000:3.0:1746147143.824328:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32344:x1830967308002176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9723us (9867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.824337:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14624 00000100:00100000:0.0:1746147143.825214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.825272:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308002304 00000100:00100000:1.0:1746147143.825280:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308002304 00002000:00100000:1.0:1746147143.825317:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (90112->1048575) req@ffff880098c70e00 x1830967308002304/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.825327:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70e00 with x1830967308002304 ext(90112->1048575) 00010000:00010000:1.0:1746147143.825335:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 14 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.825347:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 14 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746147143.825353:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098c70e00 00000100:00100000:1.0:1746147143.825385:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1110 00000100:00100000:1.0:1746147143.825392:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308002304:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147143.839440:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308002304:12345-192.168.204.25@tcp:4:cat.0 Request processed in 14039us (14218us total) trans 17179874216 rc 0/0 00000100:00100000:0.0:1746147143.839452:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1110 00002000:00100000:0.0:1746147143.839464:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (90112->1048575) req@ffff880098c70e00 x1830967308002304/t17179874216(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.839472:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70e00 with x1830967308002304 ext(90112->1048575) 00010000:00010000:0.0:1746147143.839482:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 16 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746147143.839501:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 16 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746147143.839508:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098c70e00 00000100:00100000:0.0:1746147143.848928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.849219:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308002560 00000100:00100000:2.0:1746147143.849229:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308002560 00002000:00100000:2.0:1746147143.849265:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3805183) req@ffff880098c71180 x1830967308002560/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.849275:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71180 with x1830967308002560 ext(2097152->3805183) 00002000:00010000:2.0:1746147143.849280:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c71180 00000100:00100000:2.0:1746147143.849312:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3524 00000100:00100000:2.0:1746147143.849319:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308002560:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.849928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.850412:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308002816 00000100:00100000:0.0:1746147143.850416:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308002816 00002000:00100000:0.0:1746147143.850438:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e501c00 x1830967308002816/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 504/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.850446:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501c00 with x1830967308002816 ext(2097152->4194303) 00002000:00010000:0.0:1746147143.850449:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e501c00 00000100:00100000:0.0:1746147143.850475:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3525 00000100:00100000:0.0:1746147143.850481:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308002816:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147143.850572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.850593:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308002944 00000100:00100000:3.0:1746147143.850596:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308002944 00010000:00010000:3.0:1746147143.850613:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.850645:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6411 00000100:00100000:3.0:1746147143.850650:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308002944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147143.850659:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.850672:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.851886:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.851908:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425056455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e7f expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.851939:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.851941:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.851948:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.851956:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.851987:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.851997:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310688640:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.852061:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.857271:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310688640:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.857292:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.857341:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308002944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6689us (6768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.857351:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6411 00000100:00100000:0.0:1746147143.861302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.861350:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.861386:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308003456 00000100:00100000:0.0:1746147143.861393:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308003456 00002000:00100000:0.0:1746147143.861435:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a897c380 x1830967308003456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.861444:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c380 with x1830967308003456 ext(0->1048575) 00002000:00010000:0.0:1746147143.861448:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897c380 00000100:00100000:0.0:1746147143.861465:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3526 00000100:00100000:0.0:1746147143.861472:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308003456:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147143.863607:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308003328 00000100:00100000:1.0:1746147143.863616:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308003328 00000100:00100000:1.0:1746147143.863695:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15286 00000100:00100000:1.0:1746147143.863707:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32347:x1830967308003328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147143.863731:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147143.863748:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ee8 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.863842:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.863859:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.863868:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.863887:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.863893:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.863898:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864007:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x3139939425056519 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864016:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x3139939425056519 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864021:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x3139939425056519 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147143.864029:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147143.864132:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864137:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864145:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864157:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864162:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974a6000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.864165:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864170:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864185:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147143.864188:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.864191:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864196:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x313993942505650b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864214:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864219:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864224:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864227:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147143.864229:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864243:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864262:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006700) 00010000:00010000:1.0:1746147143.864264:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147143.864266:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864270:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x3139939425056512 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147143.864306:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee8 expref: 50 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.864321:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x3139939425056519 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee8 expref: 49 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.864327:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147143.864329:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147143.864331:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562000, rc 0) 00000100:00100000:1.0:1746147143.864375:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32347:x1830967308003328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 668us (3083us total) trans 8589935979 rc 0/0 00000100:00100000:1.0:1746147143.864387:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15286 00000100:00100000:0.0:1746147143.872306:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308002560:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22977us (23387us total) trans 0 rc 1708032/1708032 00000100:00100000:0.0:1746147143.872318:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3524 00002000:00100000:0.0:1746147143.872328:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3805183) req@ffff880098c71180 x1830967308002560/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1708032/1708032 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.872337:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71180 with x1830967308002560 ext(2097152->3805183) 00002000:00010000:0.0:1746147143.872343:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c71180 00000100:00100000:0.0:1746147143.883852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.884994:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308003712 00000100:00100000:2.0:1746147143.885006:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308003712 00002000:00100000:2.0:1746147143.885062:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a897ed80 x1830967308003712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.885072:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ed80 with x1830967308003712 ext(4194304->4919295) 00002000:00010000:2.0:1746147143.885079:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897ed80 00000100:00100000:2.0:1746147143.885728:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3527 00000100:00100000:2.0:1746147143.885738:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308003712:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.885877:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308002816:12345-192.168.204.25@tcp:3:cat.0 Request processed in 35387us (35952us total) trans 0 rc 2093056/2093056 00000100:00100000:0.0:1746147143.885889:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3525 00002000:00100000:0.0:1746147143.885899:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e501c00 x1830967308002816/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 504/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.885908:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501c00 with x1830967308002816 ext(2097152->4194303) 00002000:00010000:0.0:1746147143.885922:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e501c00 00000100:00100000:1.0:1746147143.887664:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308003456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 26182us (26304us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147143.887675:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3526 00002000:00100000:1.0:1746147143.887685:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a897c380 x1830967308003456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.887704:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c380 with x1830967308003456 ext(0->1048575) 00002000:00010000:1.0:1746147143.887709:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897c380 00000100:00100000:2.0:1746147143.887857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.887934:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308003840 00000100:00100000:2.0:1746147143.887964:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308003840 00000100:00100000:2.0:1746147143.888499:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 814 00000100:00100000:2.0:1746147143.888507:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967308003840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147143.888520:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147143.888546:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x3139939425056519 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee8 expref: 49 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147143.888578:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147143.888583:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147143.888603:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308003840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147143.888609:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 814 00000100:00100000:0.0:1746147143.893807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.893893:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308003968 00000100:00100000:3.0:1746147143.893907:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308003968 00000100:00100000:3.0:1746147143.894578:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14625 00000100:00100000:3.0:1746147143.894591:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308003968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.894618:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.894641:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77eef expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.894671:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.894673:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.894681:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.894697:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.894707:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348c00, rc 0) 00000100:00100000:3.0:1746147143.894761:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308003968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 174us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.894767:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14625 00000100:00100000:2.0:1746147143.895442:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308003712:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9701us (11597us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147143.895453:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3527 00002000:00100000:2.0:1746147143.895462:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a897ed80 x1830967308003712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.895472:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ed80 with x1830967308003712 ext(4194304->4919295) 00002000:00010000:2.0:1746147143.895477:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897ed80 00000100:00100000:2.0:1746147143.898039:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310688768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746147143.898115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147143.899418:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310688768 00000100:00100000:3.0:1746147143.899427:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310688768 00000100:00100000:3.0:1746147143.899476:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1746147143.899484:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310688768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1746147143.899505:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 1221350464 pending 5074944 free 3909718016 avail 3678195712 00000100:00100000:3.0:1746147143.899556:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310688768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.899561:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1746147143.899599:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310688768:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1746147143.899718:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147143.900239:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.900512:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004096 00000100:00100000:2.0:1746147143.900516:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004096 00000100:00100000:2.0:1746147143.900549:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14626 00000100:00100000:2.0:1746147143.900554:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308004096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147143.900564:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147143.900579:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942505652e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ef6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.900621:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310688896:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147143.900695:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.905438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.905936:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310688896:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147143.905972:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942505652e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ef6 expref: 37 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.905985:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942505652e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ef6 expref: 37 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147143.906016:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae800, rc 0) 00000100:00100000:2.0:1746147143.906779:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308004096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6222us (6540us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147143.906788:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14626 00000100:00100000:2.0:1746147143.906812:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004224 00000100:00100000:2.0:1746147143.906817:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004224 00000100:00100000:3.0:1746147143.909014:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14627 00000100:00100000:3.0:1746147143.909037:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308004224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.909058:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.909080:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348400/0x3139939425056535 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77efd expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.909169:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689024:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147143.909288:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.911018:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689024:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147143.911052:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348400/0x3139939425056535 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77efd expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.911065:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348400/0x3139939425056535 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77efd expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.911081:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348400, rc 0) 00000100:00100000:3.0:1746147143.911152:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308004224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2124us (5723us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147143.911160:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14627 00000100:00100000:0.0:1746147143.913156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.913767:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004352 00000100:00100000:3.0:1746147143.913775:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004352 00000100:00100000:3.0:1746147143.913834:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14628 00000100:00100000:3.0:1746147143.913842:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32344:x1830967308004352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.913862:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.913882:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f04 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.913921:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.913932:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.913935:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.913938:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.913968:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.913981:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 15 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.913992:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310689152:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.914078:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.915780:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310689152:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.915807:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.915822:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348800, rc 0) 00000100:00100000:3.0:1746147143.915869:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32344:x1830967308004352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2026us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.915878:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14628 00000100:00100000:0.0:1746147143.917414:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.918177:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004480 00000100:00100000:2.0:1746147143.918186:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004480 00002000:00100000:2.0:1746147143.918230:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3805184->4194303) req@ffff8800a897f100 x1830967308004480/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.918240:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f100 with x1830967308004480 ext(3805184->4194303) 00010000:00010000:2.0:1746147143.918249:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 16 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.918265:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 16 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.918277:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a897f100 00000100:00100000:2.0:1746147143.918438:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1111 00000100:00100000:2.0:1746147143.918447:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308004480:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147143.924002:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308004480:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5543us (6580us total) trans 17179874217 rc 0/0 00000100:00100000:0.0:1746147143.924018:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1111 00002000:00100000:0.0:1746147143.924031:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3805184->4194303) req@ffff8800a897f100 x1830967308004480/t17179874217(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.924040:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f100 with x1830967308004480 ext(3805184->4194303) 00010000:00010000:0.0:1746147143.924053:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746147143.924070:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746147143.924078:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a897f100 00000100:00100000:0.0:1746147143.929140:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.929286:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004608 00000100:00100000:1.0:1746147143.929297:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004608 00010000:00010000:1.0:1746147143.929336:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.929379:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6412 00000100:00100000:1.0:1746147143.929387:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308004608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.929405:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.929428:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.929440:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.929463:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x31399394250564b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb0 expref: 18 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.930083:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.930111:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.930120:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.930129:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.930172:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147143.930185:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310689280:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147143.930311:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.931843:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967310689280:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147143.931861:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.931902:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308004608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2515us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.931921:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6412 00000100:00100000:0.0:1746147143.934660:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.934752:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004864 00000100:00100000:2.0:1746147143.934761:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004864 00002000:00100000:2.0:1746147143.934811:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800a897c000 x1830967308004864/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.934822:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c000 with x1830967308004864 ext(2097152->3145727) 00002000:00010000:2.0:1746147143.934828:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897c000 00000100:00100000:2.0:1746147143.934863:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3528 00000100:00100000:2.0:1746147143.934871:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308004864:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147143.938505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.938608:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308004992 00000100:00100000:3.0:1746147143.938618:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308004992 00000100:00100000:3.0:1746147143.938686:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14629 00000100:00100000:3.0:1746147143.938695:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32347:x1830967308004992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147143.938719:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.938739:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f0b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.938768:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.938776:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.938778:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.938781:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.938813:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.938825:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 21 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.938837:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689408:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.938940:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.941561:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308004864:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6680us (6898us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147143.941574:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3528 00002000:00100000:2.0:1746147143.941585:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800a897c000 x1830967308004864/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.941595:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c000 with x1830967308004864 ext(2097152->3145727) 00002000:00010000:2.0:1746147143.941600:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897c000 00000100:00100000:3.0:1746147143.942588:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689408:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.942615:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.942631:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348000, rc 0) 00000100:00100000:3.0:1746147143.942651:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32347:x1830967308004992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3959us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.942658:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14629 00000100:00100000:2.0:1746147143.944204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.944204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.944637:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005248 00000100:00100000:3.0:1746147143.944645:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005248 00000100:00100000:3.0:1746147143.944695:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14630 00000100:00100000:3.0:1746147143.944703:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:32351:x1830967308005248:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147143.944722:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.944740:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f12 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.944768:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.944776:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.944784:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 9 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.944789:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.944791:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.944794:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1859584->1949695] (req 1859584->1949695) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.944820:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 9 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.944830:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 9 pid: 17600 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.944843:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689536:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.944940:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147143.944947:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 23 pid: 9585 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.944955:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689664:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.944981:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.944990:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 33 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.945051:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005120 00000100:00100000:2.0:1746147143.945055:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005120 00002000:00100000:2.0:1746147143.945080:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3149823) req@ffff8800909f8e00 x1830967308005120/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 4584/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.945113:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8e00 with x1830967308005120 ext(3145728->3149823) 00010000:00010000:2.0:1746147143.945120:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 24 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.945128:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 24 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.945134:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909f8e00 00000100:00100000:2.0:1746147143.945148:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1112 00000100:00100000:2.0:1746147143.945154:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308005120:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147143.945702:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689792:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.945741:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.946174:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967308005120:12345-192.168.204.25@tcp:4:cat.0 Request processed in 1018us (1975us total) trans 21474841483 rc 0/0 00000100:00100000:2.0:1746147143.946181:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1112 00002000:00100000:2.0:1746147143.946187:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3149823) req@ffff8800909f8e00 x1830967308005120/t21474841483(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 4584/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.946194:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8e00 with x1830967308005120 ext(3145728->3149823) 00010000:00010000:2.0:1746147143.946200:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 26 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.946208:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 26 pid: 12225 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.946213:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909f8e00 00000100:00100000:0.0:1746147143.949027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.949067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.949120:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005504 00000100:00100000:1.0:1746147143.949128:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005504 00010000:00010000:1.0:1746147143.949165:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 10 pid: 17600 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746147143.949204:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005376 00000100:00100000:1.0:1746147143.949206:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005376 00010000:00010000:1.0:1746147143.949217:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 26 pid: 9585 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746147143.949232:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6413 00000100:00100000:1.0:1746147143.949239:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308005504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.949254:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.949274:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 10 pid: 17600 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746147143.949291:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 10 pid: 17600 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746147143.949319:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.949357:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308005504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.949363:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6413 00000100:00100000:1.0:1746147143.949377:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6414 00000100:00100000:1.0:1746147143.949381:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967308005376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.949389:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.949394:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 26 pid: 9585 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746147143.949403:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 26 pid: 9585 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746147143.949419:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.949431:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967308005376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.949436:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6414 00010000:00010000:3.0:1746147143.949657:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x31399394250563f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e32 expref: 9 pid: 17600 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.949676:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689536:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.949685:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x313993942505640f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e4e expref: 25 pid: 9585 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746147143.949698:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689664:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.950243:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310689792:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.950283:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1859584->1949695] (req 1859584->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.950293:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348200, rc 0) 00000100:00100000:3.0:1746147143.950320:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:32351:x1830967308005248:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5618us (6118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.950327:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14630 00000100:00100000:0.0:1746147143.951724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.952252:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005632 00000100:00100000:3.0:1746147143.952257:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005632 00000100:00100000:3.0:1746147143.952295:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14631 00000100:00100000:3.0:1746147143.952301:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32344:x1830967308005632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147143.952477:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147143.952495:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f19 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.952519:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147143.952524:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.952531:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147143.952534:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.952572:0:9586:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.952585:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.952594:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:3.0:1746147143.952636:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32344:x1830967308005632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 334us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.952641:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14631 00000100:00100000:0.0:1746147143.952692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.952822:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005760 00000100:00100000:1.0:1746147143.952826:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005760 00010000:00010000:1.0:1746147143.952847:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 24 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.952868:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6415 00000100:00100000:1.0:1746147143.952873:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308005760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.952882:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.952910:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 24 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.952932:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 24 pid: 12225 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.952949:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136349400/0x31399394250564b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3149823) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eb7 expref: 24 pid: 12225 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746147143.952969:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147143.952974:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.952976:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.952982:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.953007:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308005888 00000100:00100000:3.0:1746147143.953010:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308005888 00010000:00010000:1.0:1746147143.953017:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.953022:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.953038:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6416 00010000:00010000:1.0:1746147143.953042:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.953043:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308005888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.953052:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.953068:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310690048:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.953105:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147143.953114:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.953122:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.953133:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f09f400/0x31399394250563b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e08 expref: 35 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.953140:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489540 going to sleep for 11 seconds 00010000:00010000:3.0:1746147143.953142:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.953144:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.953147:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.953154:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.953831:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147143.953839:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310690176:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.953872:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147143.955653:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.955783:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310690048:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147143.955785:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310690176:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147143.955800:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147143.955800:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147143.955832:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967308005888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2788us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.955843:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6416 00000100:00100000:2.0:1746147143.955854:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308006144 00000100:00100000:2.0:1746147143.955861:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308006144 00002000:00100000:2.0:1746147143.955903:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1859584->1863679) req@ffff8800909fb100 x1830967308006144/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.955922:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb100 with x1830967308006144 ext(1859584->1863679) 00002000:00010000:2.0:1746147143.955927:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fb100 00000100:00100000:2.0:1746147143.955945:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3529 00000100:00100000:2.0:1746147143.955951:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967308006144:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.956078:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308005760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3203us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.956084:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6415 00000100:00100000:2.0:1746147143.956261:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967308006144:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 310us (614us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147143.956419:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.956436:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308006400 00000100:00100000:1.0:1746147143.956439:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308006400 00002000:00100000:1.0:1746147143.956453:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2732032->2736127) req@ffff8800909f9180 x1830967308006400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.956461:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9180 with x1830967308006400 ext(2732032->2736127) 00010000:00010000:1.0:1746147143.956468:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.956481:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746147143.956486:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909f9180 00000100:00100000:1.0:1746147143.956507:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1113 00000100:00100000:1.0:1746147143.956513:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308006400:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.956573:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308006400:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 60us (153us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147143.956582:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1113 00002000:00100000:1.0:1746147143.956587:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2732032->2736127) req@ffff8800909f9180 x1830967308006400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.956689:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9180 with x1830967308006400 ext(2732032->2736127) 00010000:00010000:1.0:1746147143.956694:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.956702:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746147143.956708:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909f9180 00000100:00100000:2.0:1746147143.956770:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3529 00002000:00100000:2.0:1746147143.956776:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1859584->1863679) req@ffff8800909fb100 x1830967308006144/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.956782:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb100 with x1830967308006144 ext(1859584->1863679) 00002000:00010000:2.0:1746147143.956784:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fb100 00000100:00100000:0.0:1746147143.961463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.961602:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308006656 00000100:00100000:1.0:1746147143.961612:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308006656 00002000:00100000:1.0:1746147143.961654:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1945600->1949695) req@ffff8800909f8380 x1830967308006656/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.961664:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8380 with x1830967308006656 ext(1945600->1949695) 00002000:00010000:1.0:1746147143.961670:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8380 00000100:00100000:1.0:1746147143.961738:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3530 00000100:00100000:1.0:1746147143.961747:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308006656:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.961896:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308006656:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 149us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147143.961903:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3530 00002000:00100000:1.0:1746147143.961909:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1945600->1949695) req@ffff8800909f8380 x1830967308006656/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.961949:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8380 with x1830967308006656 ext(1945600->1949695) 00002000:00010000:1.0:1746147143.961952:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8380 00000100:00100000:0.0:1746147143.964280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.964476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.964544:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308007040 00000100:00100000:2.0:1746147143.964547:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308006912 00000100:00100000:3.0:1746147143.964552:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308007040 00000100:00100000:2.0:1746147143.964552:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308006912 00002000:00100000:2.0:1746147143.964591:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2732032->3145727) req@ffff8800909f9880 x1830967308006912/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.964601:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9880 with x1830967308006912 ext(2732032->3145727) 00000100:00100000:3.0:1746147143.964602:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14632 00000100:00100000:3.0:1746147143.964609:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32347:x1830967308007040:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147143.964609:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.964623:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 34 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746147143.964625:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746147143.964634:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909f9880 00010000:00010000:3.0:1746147143.964642:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f20 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147143.964659:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1114 00000100:00100000:2.0:1746147143.964664:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308006912:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:3.0:1746147143.964673:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.964680:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.964682:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147143.964685:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->3297279] (req 3145728->3297279) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.964716:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.964726:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746147143.964737:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310690304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147143.964813:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147143.968406:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310690304:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147143.968530:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->3297279] (req 3145728->3297279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147143.968548:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372c400, rc 0) 00000100:00100000:3.0:1746147143.968600:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32347:x1830967308007040:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3989us (4122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147143.968609:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14632 00000100:00100000:2.0:1746147143.970532:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.970682:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308007168 00000100:00100000:1.0:1746147143.970689:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308007168 00010000:00010000:1.0:1746147143.970720:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746147143.970757:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6417 00000100:00100000:1.0:1746147143.970764:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308007168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.970776:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.970794:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.970804:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.970826:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136348800/0x313993942505653c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f04 expref: 38 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.970851:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.970853:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.970860:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.970868:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.970906:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147143.971000:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310690432:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147143.971118:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147143.971544:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308006912:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6877us (7271us total) trans 21474841484 rc 0/0 00000100:00100000:2.0:1746147143.971553:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1114 00002000:00100000:2.0:1746147143.971562:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2732032->3145727) req@ffff8800909f9880 x1830967308006912/t21474841484(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/448 e 0 to 0 dl 1746147154 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.971571:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9880 with x1830967308006912 ext(2732032->3145727) 00010000:00010000:2.0:1746147143.971579:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 36 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746147143.971591:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 36 pid: 9586 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746147143.971597:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800909f9880 00000100:00100000:1.0:1746147143.972678:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310690432:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147143.972698:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.972736:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308007168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1972us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.972744:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6417 00000100:00100000:0.0:1746147143.974221:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.974295:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147143.974368:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308007552 00000100:00100000:1.0:1746147143.974375:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308007552 00000100:00100000:2.0:1746147143.974385:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308007424 00000100:00100000:2.0:1746147143.974388:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308007424 00010000:00010000:1.0:1746147143.974407:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 36 pid: 9586 timeout: 781 lvb_type: 0 00002000:00100000:2.0:1746147143.974417:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3293184->3297279) req@ffff8800909fad80 x1830967308007424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.974425:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fad80 with x1830967308007424 ext(3293184->3297279) 00002000:00010000:2.0:1746147143.974428:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fad80 00000100:00100000:2.0:1746147143.974445:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3531 00000100:00100000:2.0:1746147143.974454:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308007424:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.974546:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6418 00000100:00100000:1.0:1746147143.974551:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308007552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147143.974560:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147143.974576:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 36 pid: 9586 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746147143.974594:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308007424:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 141us (379us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147143.974601:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3531 00002000:00100000:2.0:1746147143.974606:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3293184->3297279) req@ffff8800909fad80 x1830967308007424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147143.974612:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fad80 with x1830967308007424 ext(3293184->3297279) 00002000:00010000:2.0:1746147143.974614:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fad80 00010000:00010000:1.0:1746147143.974695:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 36 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.974726:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348000/0x3139939425056543 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f0b expref: 36 pid: 9586 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746147143.974741:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.974743:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147143.974751:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.974759:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147143.974789:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147143.974802:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310690560:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147143.974943:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147143.978406:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310690560:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147143.978429:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147143.978482:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308007552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3929us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147143.978493:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6418 00000100:00100000:2.0:1746147143.978561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147143.978690:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308007808 00000100:00100000:3.0:1746147143.978698:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308007808 00000100:00100000:3.0:1746147143.978733:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5481 00000100:00100000:3.0:1746147143.978739:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32347:x1830967308007808:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147143.978932:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32347:x1830967308007808:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 192us (371us total) trans 8589935980 rc 0/0 00000100:00100000:3.0:1746147143.978938:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5481 00000100:00100000:2.0:1746147143.982436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147143.982488:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147143.982564:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308008192 00000100:00100000:0.0:1746147143.982574:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308008192 00002000:00100000:0.0:1746147143.982622:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3297280->4194303) req@ffff88009cd47480 x1830967308008192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.982632:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47480 with x1830967308008192 ext(3297280->4194303) 00002000:00010000:0.0:1746147143.982640:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47480 00000100:00100000:0.0:1746147143.982655:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308008320 00000100:00100000:0.0:1746147143.982657:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308008320 00002000:00100000:0.0:1746147143.982670:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd45180 x1830967308008320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/0 e 0 to 0 dl 1746147154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147143.982677:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45180 with x1830967308008320 ext(2097152->4194303) 00002000:00010000:0.0:1746147143.982680:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd45180 00000100:00100000:0.0:1746147143.982693:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3532 00000100:00100000:0.0:1746147143.982700:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308008192:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.983120:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3533 00000100:00100000:1.0:1746147143.983128:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308008320:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147143.995721:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308008320:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12581us (13219us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147143.995735:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3533 00002000:00100000:1.0:1746147143.995747:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd45180 x1830967308008320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147143.995758:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45180 with x1830967308008320 ext(2097152->4194303) 00002000:00010000:1.0:1746147143.995858:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd45180 00000100:00100000:3.0:1746147143.998776:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308008192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 16063us (16337us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746147143.998790:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3532 00002000:00100000:3.0:1746147143.998802:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3297280->4194303) req@ffff88009cd47480 x1830967308008192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:519/0 lens 488/440 e 0 to 0 dl 1746147154 ref 1 fl Complete:/200/0 rc 897024/897024 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147143.998811:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47480 with x1830967308008192 ext(3297280->4194303) 00002000:00010000:3.0:1746147143.998817:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47480 00000100:00100000:0.0:1746147144.003696:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.003892:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308008448 00000100:00100000:3.0:1746147144.003903:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308008448 00000100:00100000:3.0:1746147144.003980:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14633 00000100:00100000:3.0:1746147144.003990:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967308008448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.004014:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.004034:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x313993942505655f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f27 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.004124:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310690688:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.004223:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746147144.004281:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147144.005339:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310690688:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.005366:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x313993942505655f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f27 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.005379:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x313993942505655f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f27 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.005405:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261200, rc 0) 00000100:00100000:3.0:1746147144.005436:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967308008448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1448us (1753us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.005445:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14633 00000100:00100000:0.0:1746147144.008552:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.008659:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308008704 00000100:00100000:3.0:1746147144.008669:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308008704 00002000:00100000:3.0:1746147144.008729:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800909f9500 x1830967308008704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.008740:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9500 with x1830967308008704 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.008745:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9500 00000100:00100000:3.0:1746147144.008765:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3534 00000100:00100000:3.0:1746147144.008774:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308008704:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:0.0:1746147144.009394:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147144.014581:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308008704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5796us (6027us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147144.014596:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3534 00002000:00100000:3.0:1746147144.014609:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800909f9500 x1830967308008704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.014619:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9500 with x1830967308008704 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.014625:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9500 00000100:00100000:0.0:1746147144.018512:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.019044:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308008832 00000100:00100000:3.0:1746147144.019054:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308008832 00000100:00100000:3.0:1746147144.019130:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14634 00000100:00100000:3.0:1746147144.019138:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308008832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.019157:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.019176:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x3139939425056566 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f2e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.019501:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310690816:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.019608:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.021826:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310690816:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.021859:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x3139939425056566 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f2e expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.021872:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x3139939425056566 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f2e expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.022225:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261c00, rc 0) 00000100:00100000:3.0:1746147144.022273:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308008832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3135us (3772us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.022282:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14634 00000100:00100000:0.0:1746147144.024170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.024308:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308008960 00000100:00100000:3.0:1746147144.024316:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308008960 00000100:00100000:3.0:1746147144.024355:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14635 00000100:00100000:3.0:1746147144.024362:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308008960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.024379:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.024396:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x313993942505656d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f35 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.024450:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310690944:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.024766:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.026346:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310690944:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.026374:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x313993942505656d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f35 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.026387:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x313993942505656d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f35 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.026413:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261400, rc 0) 00000100:00100000:3.0:1746147144.026446:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308008960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2083us (2280us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.026453:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14635 00000100:00100000:0.0:1746147144.032283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.032480:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308009216 00000100:00100000:1.0:1746147144.032490:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308009216 00000100:00100000:1.0:1746147144.032589:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5482 00000100:00100000:1.0:1746147144.032600:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32344:x1830967308009216:12345-192.168.204.25@tcp:35:cat.0 00000100:00080000:0.0:1746147144.032965:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147144.033287:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32344:x1830967308009216:12345-192.168.204.25@tcp:35:cat.0 Request processed in 687us (1012us total) trans 8589935981 rc 0/0 00000100:00100000:1.0:1746147144.033294:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5482 00000100:00100000:1.0:1746147144.107045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.107203:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308009472 00000100:00100000:2.0:1746147144.107214:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308009472 00000100:00100000:2.0:1746147144.107266:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15287 00000100:00100000:2.0:1746147144.107274:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32357:x1830967308009472:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147144.107301:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.107323:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425056574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f3c expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.107404:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107418:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107429:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107442:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107448:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107453:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107556:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425056589 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107565:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425056589 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107570:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425056589 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147144.107578:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147144.107653:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107659:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107664:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107670:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0ae400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147144.107673:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107679:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107690:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147144.107693:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147144.107697:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107701:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942505657b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107732:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107736:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107740:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107743:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0afc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147144.107745:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107749:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107755:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dde00) 00010000:00010000:2.0:1746147144.107757:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147144.107760:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107763:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x3139939425056582 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.107800:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425056574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f3c expref: 53 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.107810:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425056589 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f3c expref: 52 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.107815:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.107817:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147144.107819:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0000, rc 0) 00000100:00100000:2.0:1746147144.107881:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32357:x1830967308009472:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 607us (849us total) trans 8589935982 rc 0/0 00000100:00100000:2.0:1746147144.107887:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15287 00000100:00100000:0.0:1746147144.114567:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.114605:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308009600 00000100:00100000:2.0:1746147144.114618:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308009600 00000100:00100000:2.0:1746147144.114685:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 815 00000100:00100000:2.0:1746147144.114693:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967308009600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.114709:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.114735:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425056589 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f3c expref: 52 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.114751:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.114755:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.114812:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2003:x1830967308009600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.114819:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 815 00000100:00100000:0.0:1746147144.124608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.125432:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308009728 00000100:00100000:3.0:1746147144.125442:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308009728 00000100:00080000:0.0:1746147144.125540:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147144.125580:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14636 00000100:00100000:3.0:1746147144.125588:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308009728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.125608:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.125627:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260600/0x3139939425056597 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f43 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.125687:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310691072:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.125778:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.125892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.125954:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308009856 00000100:00100000:0.0:1746147144.125958:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308009856 00000100:00100000:0.0:1746147144.125996:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14637 00000100:00100000:0.0:1746147144.126002:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308009856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.126010:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.126020:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f4a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746147144.126023:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147144.126038:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.126040:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.126048:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 24 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.126145:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 24 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.126155:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56e00, rc 0) 00000100:00100000:0.0:1746147144.126194:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308009856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 192us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.126200:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14637 00000100:00100000:3.0:1746147144.129704:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310691072:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.129744:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260600/0x3139939425056597 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f43 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.129758:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260600/0x3139939425056597 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f43 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.129787:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260600, rc 0) 00000100:00100000:3.0:1746147144.129849:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308009728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4260us (5251us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.129857:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14636 00000100:00100000:0.0:1746147144.141075:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.141354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.143545:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308010240 00000100:00100000:3.0:1746147144.143559:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308010240 00002000:00100000:3.0:1746147144.143610:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800909f8000 x1830967308010240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.143622:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967308010240 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.143627:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8000 00000100:00100000:3.0:1746147144.143667:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308010368 00000100:00100000:3.0:1746147144.143670:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308010368 00002000:00100000:3.0:1746147144.143684:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800909f9f80 x1830967308010368/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.143690:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9f80 with x1830967308010368 ext(0->1048575) 00002000:00010000:3.0:1746147144.143693:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9f80 00000100:00100000:3.0:1746147144.143708:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3535 00000100:00100000:3.0:1746147144.143716:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308010240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.143854:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3536 00000100:00100000:0.0:1746147144.143862:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308010368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.161896:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308010240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18165us (20821us total) trans 0 rc 958464/958464 00000100:00100000:3.0:1746147144.161923:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3535 00002000:00100000:3.0:1746147144.161938:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800909f8000 x1830967308010240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.161948:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967308010240 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.161954:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8000 00000100:00100000:2.0:1746147144.166163:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308010368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22282us (24788us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.166182:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3536 00002000:00100000:2.0:1746147144.166199:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800909f9f80 x1830967308010368/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.166209:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9f80 with x1830967308010368 ext(0->1048575) 00002000:00010000:2.0:1746147144.166216:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9f80 00000100:00100000:0.0:1746147144.180959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.181277:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308010496 00000100:00100000:2.0:1746147144.181288:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308010496 00000100:00100000:2.0:1746147144.181382:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15288 00000100:00100000:2.0:1746147144.181395:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32361:x1830967308010496:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.181427:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.181449:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250565a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f51 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.181513:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181526:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181538:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181552:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181558:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181563:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181639:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181650:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.181657:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.181687:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.181700:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 27 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.181712:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310691200:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.181794:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.181874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.181920:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308010624 00000100:00100000:0.0:1746147144.181923:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308010624 00000100:00100000:0.0:1746147144.181955:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14638 00000100:00100000:0.0:1746147144.181961:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:32360:x1830967308010624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.181970:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.181981:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f58 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.182004:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.182012:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147144.182014:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147144.182016:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.182033:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.182041:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 36 pid: 9586 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.182049:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310691328:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147144.182070:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746147144.182338:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147144.184155:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310691328:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.184191:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.184211:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56c00, rc 0) 00000100:00100000:1.0:1746147144.184261:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:32360:x1830967308010624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2297us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.184270:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14638 00000100:00100000:2.0:1746147144.184426:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310691200:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.184445:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147144.184733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.184824:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308010880 00000100:00100000:1.0:1746147144.184830:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308010880 00000100:00100000:1.0:1746147144.184884:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5483 00000100:00100000:1.0:1746147144.184891:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f89050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:8487:x1830967308010880:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147144.185084:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f89050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+29:8487:x1830967308010880:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 193us (352us total) trans 8589935983 rc 0/0 00000100:00100000:1.0:1746147144.185119:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5483 00000100:00100000:2.0:1746147144.186256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.186286:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011008 00000100:00100000:2.0:1746147144.186291:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011008 00002000:00100000:2.0:1746147144.186346:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3297279) req@ffff88009cd44380 x1830967308011008/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.186355:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44380 with x1830967308011008 ext(3145728->3297279) 00010000:00010000:2.0:1746147144.186365:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 37 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.186377:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 37 pid: 9586 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.186384:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd44380 00000100:00080000:3.0:1746147144.186777:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147144.187410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.187493:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011136 00000100:00100000:3.0:1746147144.187500:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011136 00010000:00010000:3.0:1746147144.187532:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 29 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.187591:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6419 00000100:00100000:3.0:1746147144.187602:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308011136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147144.187619:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147144.187626:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 29 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.187637:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 29 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.187661:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x31399394250564a2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ea9 expref: 29 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.187685:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.187691:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.187704:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.187712:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.187739:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.187794:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308011136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 191us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.187800:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6419 00010000:00010000:3.0:1746147144.187830:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.187837:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147144.188336:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1115 00000100:00100000:2.0:1746147144.188353:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967308011008:12345-192.168.204.25@tcp:4:cat.0 00000004:00200000:3.0:1746147144.188611:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147144.188617:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147144.188640:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188654:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188664:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188670:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188676:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188696:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.188700:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188706:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188716:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147144.188718:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.188721:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188725:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188736:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188741:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188746:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188750:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.188752:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188756:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188762:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369ddd00) 00010000:00010000:3.0:1746147144.188764:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.188766:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188770:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1c00/0x31399394250565b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.188803:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250565a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.188816:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.188822:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.188823:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147144.188825:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:3.0:1746147144.188867:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32361:x1830967308010496:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7475us (7922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.188873:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15288 00000100:00100000:0.0:1746147144.191918:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.192365:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.192394:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.192464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.192487:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011264 00000100:00100000:0.0:1746147144.192496:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011264 00000100:00100000:0.0:1746147144.192554:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011520 00000100:00100000:0.0:1746147144.192556:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011520 00000100:00100000:0.0:1746147144.192570:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011392 00000100:00100000:0.0:1746147144.192572:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011392 00000100:00100000:0.0:1746147144.192588:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011648 00000100:00100000:0.0:1746147144.192590:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011648 00000100:00100000:0.0:1746147144.193350:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14639 00000100:00100000:0.0:1746147144.193362:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308011264:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147144.193385:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.193407:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f5f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.193435:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.193437:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.193449:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.193468:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.193481:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56800, rc 0) 00000100:00100000:0.0:1746147144.193540:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308011264:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 179us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.193578:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14640 00000100:00100000:1.0:1746147144.193589:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308011520:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147144.193599:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.193611:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x31399394250565cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f6d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.193681:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310691456:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147144.193759:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.193792:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14641 00000100:00100000:1.0:1746147144.193801:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308011392:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147144.193811:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.193824:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250565d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f66 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.193856:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310691584:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147144.193885:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.193921:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14642 00000100:00100000:1.0:1746147144.193929:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308011648:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147144.193937:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.193947:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f74 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.193959:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.193960:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.193967:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.193978:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.193986:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447200, rc 0) 00000100:00100000:1.0:1746147144.194009:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308011648:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 81us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.194016:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14642 00000100:00080000:3.0:1746147144.194327:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746147144.194332:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147144.194411:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14639 00000100:00100000:2.0:1746147144.196043:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308011008:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7693us (9791us total) trans 17179874218 rc 0/0 00000100:00100000:2.0:1746147144.196055:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1115 00002000:00100000:2.0:1746147144.196065:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3297279) req@ffff88009cd44380 x1830967308011008/t17179874218(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.196073:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44380 with x1830967308011008 ext(3145728->3297279) 00010000:00010000:2.0:1746147144.196081:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 39 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.196625:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 39 pid: 9586 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.196634:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd44380 00002000:00010000:1.0:1746147144.199507:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147143 -> 1746147144 00000100:00100000:1.0:1746147144.199541:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310691584:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147144.199585:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250565d6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f66 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.199601:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250565d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f66 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.199618:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447a00, rc 0) 00000100:00100000:1.0:1746147144.199698:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308011392:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5895us (7301us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147144.199708:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14641 00000100:00100000:0.0:1746147144.199991:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310691456:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.200016:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x31399394250565cf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f6d expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.200026:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x31399394250565cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f6d expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.200045:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447e00, rc 0) 00000100:00100000:0.0:1746147144.200076:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308011520:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6489us (7710us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.200082:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14640 00000100:00100000:0.0:1746147144.202801:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.203939:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308011904 00000100:00100000:3.0:1746147144.203948:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308011904 00000100:00100000:3.0:1746147144.204245:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15289 00000100:00100000:3.0:1746147144.204255:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32361:x1830967308011904:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147144.204275:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.204293:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260c00/0x31399394250565e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f7b expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.204390:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.204408:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.204415:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.204445:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.204455:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 12 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.204467:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310691712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.206011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.206171:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.206316:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012160 00000100:00100000:2.0:1746147144.206322:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012160 00000100:00100000:2.0:1746147144.206368:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15290 00000100:00100000:2.0:1746147144.206374:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:32363:x1830967308012160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147144.206391:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.206404:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f82 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.206481:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.206491:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.206498:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147144.207870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.207944:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012416 00000100:00100000:1.0:1746147144.207951:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012416 00010000:00010000:1.0:1746147144.207981:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 13 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.208018:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6420 00000100:00100000:1.0:1746147144.208025:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308012416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.208037:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147144.208040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147144.208042:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 13 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.208051:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 13 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.208057:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012288 00000100:00100000:0.0:1746147144.208060:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012288 00010000:00010000:1.0:1746147144.208072:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.208076:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.208076:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 39 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.208085:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147144.208111:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6421 00010000:00010000:1.0:1746147144.208113:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147144.208116:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308012288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.208120:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147144.208124:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.208125:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.208128:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147144.208141:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 39 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.208150:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 39 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.208152:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147144.208163:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372c400/0x3139939425056558 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f20 expref: 39 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.208177:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.208179:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.208185:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.208189:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308012416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 164us (325us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147144.208192:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.208195:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6420 00010000:00010000:0.0:1746147144.208216:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.208229:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310691840:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.208265:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.208272:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147144.208276:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a23c0 going to sleep for 11 seconds 00000004:00200000:2.0:1746147144.208288:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147144.208407:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x31399394250565f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.208423:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.208428:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.208430:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147144.208432:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1000, rc 0) 00000100:00100000:2.0:1746147144.208455:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:32363:x1830967308012160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2082us (2450us total) trans 8589935984 rc 0/0 00000100:00100000:2.0:1746147144.208464:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15290 00010000:00010000:3.0:1746147144.208579:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x31399394250565ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f51 expref: 12 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.208599:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310691712:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.208615:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.208620:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.208625:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147144.208636:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.208680:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260c00/0x31399394250565e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.208691:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.208697:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.208699:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147144.208700:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260200, rc 0) 00000100:00100000:3.0:1746147144.208717:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32361:x1830967308011904:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4465us (5925us total) trans 8589935985 rc 0/0 00000100:00100000:3.0:1746147144.208722:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15289 00000100:00100000:2.0:1746147144.211881:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310691840:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.211916:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.211976:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967308012288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3858us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.211987:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6421 00000100:00100000:0.0:1746147144.212063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.212302:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012544 00000100:00100000:3.0:1746147144.212310:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012544 00000100:00100000:3.0:1746147144.212346:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15291 00000100:00100000:3.0:1746147144.212353:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32361:x1830967308012544:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147144.212378:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.212397:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505660e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f89 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.212485:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.212499:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.212506:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.212512:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.212543:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.212555:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 29 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.212566:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310691968:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.212641:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.212648:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 13 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.212656:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310692096:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.212675:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.217054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.217122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.217155:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.217196:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012672 00000100:00100000:0.0:1746147144.217203:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012672 00010000:00010000:0.0:1746147144.217236:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 30 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.217261:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012800 00000100:00100000:0.0:1746147144.217263:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012800 00010000:00010000:0.0:1746147144.217270:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.217282:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6422 00000100:00100000:0.0:1746147144.217288:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308012672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147144.217304:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147144.217309:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 30 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.217319:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 30 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.217339:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147144.217343:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.217351:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.217356:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.217365:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147144.217403:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308012672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.217408:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6422 00000100:00100000:1.0:1746147144.217471:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6423 00000100:00100000:1.0:1746147144.217478:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308012800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.217484:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.217487:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.217491:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250565f9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f82 expref: 29 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.217496:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.217506:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.217508:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147144.217510:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310691968:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.217515:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.217522:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.217526:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x31399394250565eb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f7b expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.217535:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310692096:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.217539:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147144.217554:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147144.217557:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308012800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.217562:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6423 00010000:00010000:3.0:1746147144.217565:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.217569:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147144.217584:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308012928 00000100:00100000:1.0:1746147144.217587:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308012928 00000100:00100000:1.0:1746147144.217610:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14643 00000100:00100000:1.0:1746147144.217615:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+24:32363:x1830967308012928:12345-192.168.204.25@tcp:101:multiop.0 00000004:00200000:3.0:1746147144.217618:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147144.217622:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1746147144.217631:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1746147144.217640:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.217647:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f90 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.217669:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.217674:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260800/0x313993942505660e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.217678:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.217684:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.217685:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.217690:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.217691:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.217692:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.217694:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147144.217695:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2285568->2465791] (req 2285568->2465791) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.217696:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261400, rc 0) 00010000:00010000:1.0:1746147144.217717:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147144.217722:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32361:x1830967308012544:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5370us (5660us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147144.217728:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.217729:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15291 00000100:00100000:1.0:1746147144.217740:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310692224:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.217805:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.217814:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 9 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.217822:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310692352:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.217848:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.217856:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 34 pid: 9586 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.217864:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310692480:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.217883:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.222018:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.222065:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.222192:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310692224:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.222205:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310692352:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.222213:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310692480:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.222249:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2285568->2465791] (req 2285568->2465791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.222269:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00000100:00100000:1.0:1746147144.222319:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+25:32363:x1830967308012928:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4702us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.222334:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14643 00000100:00100000:2.0:1746147144.222418:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308013056 00000100:00100000:2.0:1746147144.222425:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308013056 00010000:00010000:2.0:1746147144.222455:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 10 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.222475:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308013184 00000100:00100000:2.0:1746147144.222477:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308013184 00010000:00010000:2.0:1746147144.222487:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.222501:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6424 00000100:00100000:2.0:1746147144.222507:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967308013056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.222520:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.222539:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 10 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.222547:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 10 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.222569:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x31399394250565dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f74 expref: 10 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.222583:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.222601:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967308013056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.222606:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6424 00000100:00100000:2.0:1746147144.222617:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6425 00000100:00100000:2.0:1746147144.222622:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967308013184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.222628:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.222634:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.222642:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.222653:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x3139939425056551 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f19 expref: 35 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.222661:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.222674:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967308013184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.222679:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6425 00000100:00100000:0.0:1746147144.224168:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.224236:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.224320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.224342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.224358:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308013824 00000100:00100000:1.0:1746147144.224364:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308013824 00000100:00100000:1.0:1746147144.224393:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308013952 00000100:00100000:1.0:1746147144.224395:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308013952 00000100:00100000:3.0:1746147144.224428:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308013568 00000100:00100000:3.0:1746147144.224431:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308013568 00002000:00100000:3.0:1746147144.224463:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009452a680 x1830967308013568/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.224473:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452a680 with x1830967308013568 ext(2097152->4194303) 00010000:00010000:3.0:1746147144.224481:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.224496:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 782 lvb_type: 1 00002000:00010000:3.0:1746147144.224503:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452a680 00000100:00100000:3.0:1746147144.224515:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308013696 00000100:00100000:3.0:1746147144.224517:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308013696 00002000:00100000:3.0:1746147144.224528:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098c72300 x1830967308013696/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.224534:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72300 with x1830967308013696 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.224537:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c72300 00000100:00100000:3.0:1746147144.224548:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1116 00000100:00100000:3.0:1746147144.224560:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967308013568:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147144.224683:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3537 00000100:00100000:2.0:1746147144.224692:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308013696:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147144.224849:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14644 00000100:00100000:1.0:1746147144.224855:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308013824:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147144.224864:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.224879:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056623 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f97 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.224902:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14645 00000100:00100000:0.0:1746147144.224922:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308013952:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147144.224932:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147144.224935:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310692608:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.224944:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77f9e expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.224960:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.224962:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.224971:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147144.225002:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fea80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147144.225008:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.225019:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:0.0:1746147144.225041:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308013952:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 133us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.225045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.225048:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14645 00000100:00100000:0.0:1746147144.225063:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308014080 00000100:00100000:0.0:1746147144.225066:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308014080 00000100:00100000:0.0:1746147144.225100:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14646 00000100:00100000:0.0:1746147144.225106:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308014080:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147144.225112:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.225119:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x3139939425056631 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fa5 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.225129:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.225136:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x3139939425056631 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fa5 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.225145:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x3139939425056631 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fa5 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.225161:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57000, rc 0) 00000100:00100000:0.0:1746147144.225180:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308014080:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 74us (135us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.225185:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14646 00000100:00100000:0.0:1746147144.229926:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310692608:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.229970:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056623 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f97 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.229986:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056623 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f97 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.229997:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447400, rc 0) 00000100:00100000:0.0:1746147144.230056:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308013824:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5199us (5733us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.230066:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14644 00000100:00100000:1.0:1746147144.235988:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.236040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.236067:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308014464 00000100:00100000:3.0:1746147144.236078:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308014464 00000100:00100000:0.0:1746147144.236111:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308014208 00000100:00100000:0.0:1746147144.236114:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308014208 00000100:00100000:0.0:1746147144.236739:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14647 00000100:00100000:0.0:1746147144.236749:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32357:x1830967308014208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147144.236771:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.236792:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fac expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.236825:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.236834:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147144.236836:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147144.236839:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.236866:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15292 00000100:00100000:3.0:1746147144.236873:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32361:x1830967308014464:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147144.236883:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.236898:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a600/0x313993942505663f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fb3 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.237009:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237027:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237041:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.237046:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.237052:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237057:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.237058:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 26 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.237062:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237067:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822b000 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:0.0:1746147144.237070:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310692736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.237071:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237077:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237085:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.237107:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147144.237110:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237116:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b000/0x3139939425056646 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.237161:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a600/0x313993942505663f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fb3 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.237167:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a600/0x313993942505663f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fb3 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.237178:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a600, rc 0) 00000100:00100000:3.0:1746147144.237205:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32361:x1830967308014464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 333us (1163us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.237210:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15292 00000100:00100000:3.0:1746147144.237668:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.237836:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967308013568:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 13280us (13675us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147144.237848:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1116 00002000:00100000:2.0:1746147144.237856:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009452a680 x1830967308013568/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.237866:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452a680 with x1830967308013568 ext(2097152->4194303) 00010000:00010000:2.0:1746147144.237873:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.237883:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 25 pid: 12225 timeout: 782 lvb_type: 1 00002000:00010000:2.0:1746147144.237889:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452a680 00000100:00100000:0.0:1746147144.239255:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.239368:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310692736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.239397:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.239412:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56000, rc 0) 00000100:00100000:3.0:1746147144.239445:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32357:x1830967308014208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2697us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.239452:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14647 00000100:00100000:2.0:1746147144.239525:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308014592 00000100:00100000:2.0:1746147144.239532:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308014592 00002000:00100000:2.0:1746147144.239565:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1859584->1949695) req@ffff880094528e00 x1830967308014592/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.239573:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528e00 with x1830967308014592 ext(1859584->1949695) 00010000:00010000:2.0:1746147144.239578:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 25 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.239586:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 25 pid: 9586 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.239592:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094528e00 00000100:00100000:2.0:1746147144.239617:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1117 00000100:00100000:2.0:1746147144.239624:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308014592:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147144.242899:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.242971:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308014848 00000100:00100000:1.0:1746147144.242984:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308014848 00000100:00100000:1.0:1746147144.243029:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5484 00000100:00100000:1.0:1746147144.243037:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32361:x1830967308014848:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1746147144.243213:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308013696:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 18522us (18976us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147144.243220:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3537 00000100:00100000:1.0:1746147144.243226:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32361:x1830967308014848:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 189us (336us total) trans 8589935986 rc 0/0 00002000:00100000:3.0:1746147144.243227:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098c72300 x1830967308013696/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147144.243232:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5484 00002000:00100000:3.0:1746147144.243233:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72300 with x1830967308013696 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.243237:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c72300 00000100:00100000:2.0:1746147144.243575:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.243775:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308014976 00000100:00100000:1.0:1746147144.243778:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308014976 00010000:00010000:1.0:1746147144.243797:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 27 pid: 12225 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.243958:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6426 00000100:00100000:1.0:1746147144.243964:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308014976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.243974:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.243992:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 29 pid: 12225 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.244004:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 29 pid: 12225 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.244026:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56e00/0x313993942505659e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f4a expref: 29 pid: 12225 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.244038:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.244040:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.244049:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.244057:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.244085:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.244126:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310692864:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.244183:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fe000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.244497:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967308014592:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4871us (5245us total) trans 21474841485 rc 0/0 00000100:00100000:3.0:1746147144.244505:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1117 00002000:00100000:3.0:1746147144.244513:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1859584->1949695) req@ffff880094528e00 x1830967308014592/t21474841485(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.244521:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528e00 with x1830967308014592 ext(1859584->1949695) 00010000:00010000:3.0:1746147144.244528:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 27 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.244539:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 27 pid: 9586 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746147144.244546:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094528e00 00000100:00100000:0.0:1746147144.247989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.248035:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310692864:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147144.248044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.248146:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308015232 00000100:00100000:2.0:1746147144.248146:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308015360 00000100:00100000:3.0:1746147144.248153:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308015232 00000100:00100000:2.0:1746147144.248153:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308015360 00010000:00010000:2.0:1746147144.248189:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 28 pid: 9586 timeout: 782 lvb_type: 0 00002000:00100000:3.0:1746147144.248195:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2285568->2289663) req@ffff88009452aa00 x1830967308015232/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.248204:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452aa00 with x1830967308015232 ext(2285568->2289663) 00002000:00010000:3.0:1746147144.248209:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452aa00 00000100:00100000:2.0:1746147144.248224:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6427 00000100:00100000:3.0:1746147144.248227:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3538 00000100:00100000:2.0:1746147144.248232:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967308015360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147144.248233:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308015232:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147144.248245:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.248266:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 28 pid: 9586 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.248378:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308015232:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 144us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147144.248385:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3538 00002000:00100000:3.0:1746147144.248390:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2285568->2289663) req@ffff88009452aa00 x1830967308015232/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.248396:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452aa00 with x1830967308015232 ext(2285568->2289663) 00010000:00010000:2.0:1746147144.248396:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 28 pid: 9586 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746147144.248399:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452aa00 00010000:00010000:2.0:1746147144.248422:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348200/0x313993942505654a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->1949695) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f12 expref: 27 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.248443:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.248445:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.248453:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.248462:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.248496:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.248508:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310692992:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147144.248577:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147144.248620:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.248642:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967308014976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4677us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.248648:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6426 00000100:00100000:2.0:1746147144.252198:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310692992:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.252220:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147144.252266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.252340:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.252408:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308015616 00000100:00100000:3.0:1746147144.252416:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308015616 00002000:00100000:3.0:1746147144.252459:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880094528a80 x1830967308015616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.252469:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528a80 with x1830967308015616 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.252475:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094528a80 00000100:00100000:3.0:1746147144.252492:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308015872 00000100:00100000:3.0:1746147144.252495:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308015872 00002000:00100000:3.0:1746147144.252506:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1662976->1667071) req@ffff88009452b800 x1830967308015872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.252512:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b800 with x1830967308015872 ext(1662976->1667071) 00002000:00010000:3.0:1746147144.252515:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452b800 00000100:00100000:3.0:1746147144.252527:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3539 00000100:00100000:3.0:1746147144.252534:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308015616:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147144.252996:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967308015360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4762us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.253005:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6427 00000100:00100000:0.0:1746147144.253412:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3540 00000100:00100000:0.0:1746147144.253420:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308015872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147144.253510:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308015872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 92us (1169us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147144.253516:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3540 00002000:00100000:0.0:1746147144.253521:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1662976->1667071) req@ffff88009452b800 x1830967308015872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.253528:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b800 with x1830967308015872 ext(1662976->1667071) 00002000:00010000:0.0:1746147144.253531:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009452b800 00000100:00100000:1.0:1746147144.253897:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.253935:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016128 00000100:00100000:1.0:1746147144.253939:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016128 00000100:00100000:1.0:1746147144.253977:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15293 00000100:00100000:1.0:1746147144.253982:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32367:x1830967308016128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147144.253999:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.254018:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098447200/0x313993942505664d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fba expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.254086:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254122:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254133:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254145:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254154:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254159:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254257:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254266:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254272:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147144.254280:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147144.254352:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254359:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254364:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254370:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098446c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147144.254373:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254380:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254390:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147144.254394:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147144.254398:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254402:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425056654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254411:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254416:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254420:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254424:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098447a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147144.254426:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254430:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254436:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006700) 00010000:00010000:1.0:1746147144.254438:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147144.254440:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254444:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942505665b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.254482:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447200/0x313993942505664d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 54 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.254497:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 53 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.254504:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.254506:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147144.254508:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446200, rc 0) 00000100:00100000:1.0:1746147144.254527:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32367:x1830967308016128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 545us (630us total) trans 8589935987 rc 0/0 00000100:00100000:1.0:1746147144.254533:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15293 00000100:00100000:0.0:1746147144.260420:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.260704:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016256 00000100:00100000:3.0:1746147144.260715:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016256 00000100:00100000:3.0:1746147144.260779:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14648 00000100:00100000:3.0:1746147144.260788:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32357:x1830967308016256:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.260807:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.260830:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fc1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.260868:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.260877:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.260885:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 39 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.260892:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.260894:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.260898:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.260945:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 39 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.260957:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 39 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.260970:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310693120:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.261081:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.261116:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 11 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.261381:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310693248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.261601:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.261613:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 17 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.261624:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310693376:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.261663:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.264898:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967308015616:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12349us (12618us total) trans 0 rc 2093056/2093056 00000100:00100000:2.0:1746147144.264920:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3539 00002000:00100000:2.0:1746147144.264931:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880094528a80 x1830967308015616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.264941:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528a80 with x1830967308015616 ext(2097152->4194303) 00002000:00010000:2.0:1746147144.264947:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094528a80 00000100:00100000:3.0:1746147144.265128:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310693120:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.265139:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310693248:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147144.265500:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.265517:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.265534:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016384 00000100:00100000:0.0:1746147144.265540:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016384 00000100:00100000:0.0:1746147144.265569:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016512 00000100:00100000:0.0:1746147144.265571:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016512 00000100:00100000:0.0:1746147144.265584:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14649 00000100:00100000:2.0:1746147144.265590:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14650 00000100:00100000:0.0:1746147144.265590:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308016384:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147144.265598:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308016512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.265611:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.265628:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fcf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.265652:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.265653:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.265661:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.265677:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.265687:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49c00, rc 0) 00000100:00100000:2.0:1746147144.265705:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308016512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 109us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.265710:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14650 00000100:00100000:3.0:1746147144.265787:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310693376:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.265811:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.265821:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:3.0:1746147144.265837:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32357:x1830967308016256:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5052us (5430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.265842:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14648 00010000:00010000:0.0:1746147144.265876:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.265884:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x313993942505667e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fc8 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.265895:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.265903:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x313993942505667e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc8 expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.265920:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x313993942505667e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc8 expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.265930:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57600, rc 0) 00000100:00100000:0.0:1746147144.265945:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308016384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 356us (447us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.265950:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14649 00000100:00100000:0.0:1746147144.265980:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.265991:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016640 00000100:00100000:0.0:1746147144.265993:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016640 00000100:00100000:0.0:1746147144.266009:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14651 00000100:00100000:0.0:1746147144.266013:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308016640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.266021:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.266030:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x3139939425056685 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fd6 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.266065:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310693504:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.267232:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.267262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.267281:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.267339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.268736:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016896 00000100:00100000:1.0:1746147144.268808:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308016768 00000100:00100000:1.0:1746147144.268814:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016768 00010000:00010000:1.0:1746147144.268851:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 40 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.268891:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308017024 00000100:00100000:1.0:1746147144.268894:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308017024 00010000:00010000:1.0:1746147144.268914:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 18 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.268933:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6428 00000100:00100000:1.0:1746147144.268941:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308016768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.268955:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.268975:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 40 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.268986:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 40 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.269009:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6200/0x313993942505638a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dfa expref: 40 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.269029:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.269070:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308016768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 129us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.269076:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6428 00000100:00100000:1.0:1746147144.269117:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6429 00000100:00100000:1.0:1746147144.269122:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308017024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.269129:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.269135:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 18 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.269143:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 18 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.269155:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425056336 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dd0 expref: 18 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.269162:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.269177:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308017024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 55us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.269183:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6429 00000100:00100000:0.0:1746147144.269394:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308016896 00010000:00010000:0.0:1746147144.269412:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746147144.269435:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6430 00000100:00100000:0.0:1746147144.269440:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308016896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147144.269446:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147144.269455:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746147144.269465:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746147144.269483:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250563fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e39 expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746147144.269500:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.269502:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.269510:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.269519:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.269554:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.269567:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310693632:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147144.269644:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2000 going to sleep for 11 seconds 00002000:00010000:0.0:1746147144.269744:0:17600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147143 -> 1746147144 00002000:00010000:0.0:1746147144.269747:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147143 -> 1746147144 00002000:00010000:0.0:1746147144.269749:0:17600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147143 -> 1746147144 00000100:00100000:0.0:1746147144.269761:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310693504:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.269783:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x3139939425056685 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fd6 expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.269792:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x3139939425056685 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fd6 expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.269800:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57000, rc 0) 00000100:00100000:0.0:1746147144.269821:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308016640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3806us (3839us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.269827:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14651 00000100:00100000:0.0:1746147144.271194:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.272420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.272442:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308017408 00000100:00100000:0.0:1746147144.272449:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308017408 00000100:00100000:0.0:1746147144.272488:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14652 00000100:00100000:0.0:1746147144.272496:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308017408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.272513:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.272533:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x313993942505668c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fdd expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.272583:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310693760:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147144.272725:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308017280 00000100:00100000:1.0:1746147144.272730:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308017280 00000100:00100000:1.0:1746147144.272758:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5485 00000100:00100000:1.0:1746147144.272764:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:32363:x1830967308017280:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147144.272977:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:32363:x1830967308017280:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 212us (1788us total) trans 8589935988 rc 0/0 00000100:00100000:1.0:1746147144.272984:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5485 00000100:00100000:2.0:1746147144.273067:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310693632:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.273084:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.273125:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308016896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3684us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.273132:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6430 00000100:00100000:1.0:1746147144.273236:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.273350:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308017536 00000100:00100000:2.0:1746147144.273354:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308017536 00000100:00100000:2.0:1746147144.273379:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14653 00000100:00100000:2.0:1746147144.273384:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308017536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.273392:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.273403:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x3139939425056693 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77fe4 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.273430:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310693888:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.273747:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.274155:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.280049:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.280121:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308017792 00000100:00100000:2.0:1746147144.280131:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308017792 00000100:00100000:0.0:1746147144.280169:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147144.280189:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1429504->1433599) req@ffff88009c30bb80 x1830967308017792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147144.280195:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308018048 00000100:00100000:0.0:1746147144.280198:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308018048 00002000:00100000:2.0:1746147144.280200:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30bb80 with x1830967308017792 ext(1429504->1433599) 00002000:00010000:2.0:1746147144.280207:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30bb80 00002000:00100000:0.0:1746147144.280217:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1662975) req@ffff88011e484380 x1830967308018048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.280225:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e484380 with x1830967308018048 ext(1048576->1662975) 00002000:00010000:0.0:1746147144.280229:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e484380 00000100:00100000:0.0:1746147144.280241:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3541 00000100:00100000:0.0:1746147144.280247:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308017792:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147144.280267:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3542 00000100:00100000:3.0:1746147144.280275:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308018048:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.280381:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308017792:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 133us (343us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147144.280390:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3541 00002000:00100000:0.0:1746147144.280395:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1429504->1433599) req@ffff88009c30bb80 x1830967308017792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.280402:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30bb80 with x1830967308017792 ext(1429504->1433599) 00002000:00010000:0.0:1746147144.280405:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30bb80 00002000:00010000:0.0:1746147144.280465:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147143 -> 1746147144 00002000:00010000:0.0:1746147144.280468:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147140 -> 1746147144 00002000:00010000:0.0:1746147144.280470:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147143 -> 1746147144 00000100:00100000:0.0:1746147144.280480:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310693888:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.280511:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x3139939425056693 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fe4 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746147144.280512:0:17600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147143 -> 1746147144 00002000:00010000:1.0:1746147144.280515:0:17600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147143 -> 1746147144 00010000:00010000:0.0:1746147144.280523:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x3139939425056693 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fe4 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147144.280527:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310693760:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.280538:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49e00, rc 0) 00010000:00010000:1.0:1746147144.280545:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x313993942505668c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fdd expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.280555:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x313993942505668c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fdd expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147144.280559:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308017536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7174us (7322us total) trans 0 rc 301/301 00010000:00010000:1.0:1746147144.280564:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:0.0:1746147144.280565:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14653 00000100:00100000:1.0:1746147144.280584:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308017408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8090us (8168us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147144.280590:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14652 00000100:00100000:2.0:1746147144.284675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.284900:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308018304 00000100:00100000:3.0:1746147144.284932:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308018304 00002000:00100000:3.0:1746147144.284980:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800909fb480 x1830967308018304/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.284991:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb480 with x1830967308018304 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.284997:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fb480 00000100:00100000:3.0:1746147144.285032:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3543 00000100:00100000:3.0:1746147144.285040:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308018304:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.290485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.292305:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308018560 00000100:00100000:1.0:1746147144.292322:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308018560 00000100:00100000:1.0:1746147144.292377:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5486 00000100:00100000:1.0:1746147144.292387:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32357:x1830967308018560:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147144.292594:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:32357:x1830967308018560:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 208us (2119us total) trans 8589935989 rc 0/0 00000100:00100000:1.0:1746147144.292604:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5486 00000100:00100000:3.0:1746147144.293845:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308018048:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13565us (13669us total) trans 0 rc 614400/614400 00000100:00100000:3.0:1746147144.293856:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3542 00002000:00100000:3.0:1746147144.293865:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1662975) req@ffff88011e484380 x1830967308018048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.293875:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e484380 with x1830967308018048 ext(1048576->1662975) 00002000:00010000:3.0:1746147144.293881:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e484380 00000100:00100000:3.0:1746147144.294412:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308018304:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9371us (9747us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147144.294418:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3543 00002000:00100000:3.0:1746147144.294424:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800909fb480 x1830967308018304/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.294432:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb480 with x1830967308018304 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.294435:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fb480 00000100:00100000:0.0:1746147144.297200:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.297950:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308018816 00000100:00100000:3.0:1746147144.297960:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308018816 00002000:00100000:3.0:1746147144.298013:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1433600->2097151) req@ffff88011e486680 x1830967308018816/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.298023:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486680 with x1830967308018816 ext(1433600->2097151) 00002000:00010000:3.0:1746147144.298029:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e486680 00000100:00100000:3.0:1746147144.298052:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3544 00000100:00100000:3.0:1746147144.298061:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308018816:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.303237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.303288:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.303363:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308018944 00000100:00100000:2.0:1746147144.303374:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308018944 00000100:00100000:2.0:1746147144.303418:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019072 00000100:00100000:2.0:1746147144.303420:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019072 00000100:00100000:2.0:1746147144.303437:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14654 00000100:00100000:2.0:1746147144.303445:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308018944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.303466:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.303485:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48800/0x313993942505669a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77feb expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.303542:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310694016:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.303627:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.303655:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14655 00000100:00100000:2.0:1746147144.303661:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308019072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.303669:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.303679:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x31399394250566a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ff2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.303713:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310694144:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.303744:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.305149:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308018816:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7081us (7953us total) trans 0 rc 663552/663552 00000100:00100000:3.0:1746147144.305161:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3544 00002000:00100000:3.0:1746147144.305171:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1433600->2097151) req@ffff88011e486680 x1830967308018816/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.305181:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486680 with x1830967308018816 ext(1433600->2097151) 00002000:00010000:3.0:1746147144.305186:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e486680 00000100:00100000:2.0:1746147144.305918:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310694144:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.305952:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x31399394250566a1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ff2 expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.305966:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x31399394250566a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ff2 expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.305981:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49e00, rc 0) 00000100:00100000:3.0:1746147144.306221:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310694016:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.306238:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d48800/0x313993942505669a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77feb expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.306247:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48800/0x313993942505669a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77feb expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.306260:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48800, rc 0) 00000100:00100000:2.0:1746147144.306421:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308019072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2759us (3131us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.306429:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14655 00000100:00100000:3.0:1746147144.306494:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308018944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3049us (3268us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.306500:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14654 00000100:00100000:0.0:1746147144.311603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.311661:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.311747:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019328 00000100:00100000:2.0:1746147144.311758:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019328 00000100:00100000:2.0:1746147144.311811:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019456 00000100:00100000:2.0:1746147144.311813:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019456 00000100:00100000:2.0:1746147144.311843:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14656 00000100:00100000:2.0:1746147144.311852:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967308019328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.311873:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.311892:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49600/0x31399394250566a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e77ff9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.311960:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310694272:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.312045:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.312225:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14657 00000100:00100000:3.0:1746147144.312234:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308019456:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.312243:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.312254:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x31399394250566af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78000 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.312284:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310694400:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.312321:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.313678:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.313790:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019584 00000100:00100000:3.0:1746147144.313795:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019584 00002000:00100000:3.0:1746147144.313835:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009885a680 x1830967308019584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.313844:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885a680 with x1830967308019584 ext(2097152->3145727) 00002000:00010000:3.0:1746147144.313849:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885a680 00000100:00100000:3.0:1746147144.313867:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3545 00000100:00100000:3.0:1746147144.313873:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308019584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.316522:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310694272:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.316566:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49600/0x31399394250566a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ff9 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.316582:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49600/0x31399394250566a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ff9 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.316598:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49600, rc 0) 00000100:00100000:2.0:1746147144.316649:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967308019328:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4798us (5058us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.316658:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14656 00000100:00100000:2.0:1746147144.318151:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310694400:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.318182:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x31399394250566af lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78000 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.318194:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x31399394250566af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78000 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.318203:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b400, rc 0) 00000100:00100000:2.0:1746147144.318249:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308019456:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6016us (6586us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.318256:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14657 00000100:00100000:3.0:1746147144.323032:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308019584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9146us (9349us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.323044:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3545 00002000:00100000:3.0:1746147144.323058:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009885a680 x1830967308019584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.323069:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885a680 with x1830967308019584 ext(2097152->3145727) 00002000:00010000:3.0:1746147144.323075:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885a680 00000100:00100000:0.0:1746147144.328207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.328976:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019712 00000100:00100000:2.0:1746147144.328987:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019712 00000100:00100000:2.0:1746147144.329047:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14658 00000100:00100000:2.0:1746147144.329056:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32367:x1830967308019712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.329080:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.329133:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78007 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.329168:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.329177:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147144.329179:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147144.329183:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.329216:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.329228:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 24 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.329241:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310694528:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.329354:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.332801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.333007:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019840 00000100:00100000:3.0:1746147144.333016:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019840 00002000:00100000:3.0:1746147144.333064:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2285568->2465791) req@ffff880098859180 x1830967308019840/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.333075:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859180 with x1830967308019840 ext(2285568->2465791) 00010000:00010000:3.0:1746147144.333085:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 25 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.333552:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 25 pid: 12225 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746147144.333569:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098859180 00000100:00100000:3.0:1746147144.333605:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1118 00000100:00100000:3.0:1746147144.333614:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967308019840:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147144.333703:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310694528:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.333736:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.333752:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49800, rc 0) 00000100:00100000:2.0:1746147144.333779:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32367:x1830967308019712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4725us (5584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.333787:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14658 00000100:00100000:3.0:1746147144.339290:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308019840:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5664us (6487us total) trans 21474841486 rc 0/0 00000100:00100000:3.0:1746147144.339305:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1118 00002000:00100000:3.0:1746147144.339318:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2285568->2465791) req@ffff880098859180 x1830967308019840/t21474841486(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.339327:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859180 with x1830967308019840 ext(2285568->2465791) 00010000:00010000:3.0:1746147144.339337:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 27 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.339354:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 27 pid: 12225 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746147144.339360:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098859180 00000100:00100000:0.0:1746147144.344159:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.344232:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308019968 00000100:00100000:2.0:1746147144.344243:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308019968 00010000:00010000:2.0:1746147144.344289:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 27 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.346884:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6431 00000100:00100000:1.0:1746147144.346915:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2002:x1830967308019968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.346937:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.346961:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 27 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.346973:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 27 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.346995:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505661c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2465791) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f90 expref: 27 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.347022:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.347024:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.347030:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.347650:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.347690:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.347704:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310694656:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.348059:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.353436:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310694656:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147144.353466:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.353580:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967308019968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6682us (9431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.353591:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6431 00000100:00100000:0.0:1746147144.361460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.361494:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.361523:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308020224 00000100:00100000:3.0:1746147144.361531:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308020224 00000100:00100000:0.0:1746147144.361535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.361570:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308020608 00002000:00100000:3.0:1746147144.361572:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88013486b800 x1830967308020224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147144.361573:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308020608 00002000:00100000:3.0:1746147144.361579:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486b800 with x1830967308020224 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.361585:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013486b800 00000100:00100000:3.0:1746147144.361597:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308020480 00000100:00100000:3.0:1746147144.361598:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308020480 00002000:00100000:3.0:1746147144.361606:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880134868000 x1830967308020480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.361610:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134868000 with x1830967308020480 ext(3145728->4194303) 00002000:00010000:3.0:1746147144.361612:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134868000 00000100:00100000:0.0:1746147144.361617:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15294 00000100:00100000:3.0:1746147144.361620:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3546 00000100:00100000:3.0:1746147144.361624:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308020224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.361624:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32371:x1830967308020608:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147144.362159:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3547 00000100:00100000:1.0:1746147144.362168:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308020480:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147144.363734:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.363758:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x31399394250566bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7800e expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.363828:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363843:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363859:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363873:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363879:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363885:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363977:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363987:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.363993:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147144.364031:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147144.364036:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147144.364051:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364061:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364068:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364073:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364078:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364311:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b80600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147144.364317:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364324:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364336:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147144.364340:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147144.364343:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364349:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x31399394250566c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364378:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364384:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364388:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364392:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147144.364395:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364400:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364406:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098239c00) 00010000:00010000:0.0:1746147144.364408:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147144.364410:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364415:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81600/0x31399394250566cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.364443:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x31399394250566bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7800e expref: 15 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.364461:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7800e expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.364467:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147144.364469:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147144.364471:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80e00, rc 0) 00000100:00100000:0.0:1746147144.364507:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32371:x1830967308020608:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2882us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.364516:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15294 00000100:00100000:1.0:1746147144.376143:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308020480:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13964us (14635us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147144.376156:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3547 00002000:00100000:1.0:1746147144.376168:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880134868000 x1830967308020480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147144.376178:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134868000 with x1830967308020480 ext(3145728->4194303) 00002000:00010000:1.0:1746147144.376184:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134868000 00000100:00100000:0.0:1746147144.384267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.384382:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308020736 00000100:00100000:1.0:1746147144.384392:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308020736 00000100:00100000:1.0:1746147144.384463:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 816 00000100:00100000:1.0:1746147144.384473:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308020736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.384488:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.384518:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x31399394250566d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7800e expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.384550:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.384555:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.384568:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308020224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22940us (23118us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147144.384576:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308020736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.384577:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3546 00000100:00100000:1.0:1746147144.384582:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 816 00002000:00100000:3.0:1746147144.384588:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88013486b800 x1830967308020224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.384596:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486b800 with x1830967308020224 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.384600:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013486b800 00000100:00100000:0.0:1746147144.384997:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.385026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.385051:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308020992 00000100:00100000:2.0:1746147144.385056:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308020992 00000100:00100000:0.0:1746147144.385058:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.385074:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308020864 00000100:00100000:0.0:1746147144.385077:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308020864 00000100:00100000:2.0:1746147144.385079:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308021120 00000100:00100000:2.0:1746147144.385081:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308021120 00000100:00100000:2.0:1746147144.385154:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14659 00000100:00100000:2.0:1746147144.385161:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308020992:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.385175:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.385204:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d48600/0x31399394250566d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7801c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.385252:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310694784:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.385310:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.385559:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14660 00000100:00100000:0.0:1746147144.385566:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308021120:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147144.385573:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.385584:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78023 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.385597:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.385599:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.385606:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.385619:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.385629:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80400, rc 0) 00000100:00100000:0.0:1746147144.385650:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308021120:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 84us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.385655:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14660 00000100:00100000:0.0:1746147144.385666:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14661 00000100:00100000:0.0:1746147144.385670:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308020864:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147144.385676:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.385683:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x31399394250566e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78015 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.385705:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310694912:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.385726:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.388468:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310694784:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.388502:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d48600/0x31399394250566d9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7801c expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.388515:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d48600/0x31399394250566d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7801c expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.388536:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48600, rc 0) 00000100:00100000:2.0:1746147144.388576:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308020992:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3414us (3578us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.388583:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14659 00000100:00100000:2.0:1746147144.390298:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310694912:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.390320:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x31399394250566e7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78015 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.390331:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x31399394250566e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78015 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.390342:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80200, rc 0) 00000100:00100000:2.0:1746147144.390384:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308020864:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4712us (5357us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.390394:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14661 00000100:00100000:0.0:1746147144.396307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.396405:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308021376 00000100:00100000:2.0:1746147144.396413:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308021376 00000100:00100000:2.0:1746147144.396586:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15295 00000100:00100000:2.0:1746147144.396593:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32371:x1830967308021376:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.396615:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.396630:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250566ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7802a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.396710:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.396723:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.396730:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 53 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.396739:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.396765:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 53 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.396775:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 53 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.396786:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310695040:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.396927:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.396935:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.396943:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310695168:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.397063:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.397967:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.398033:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308021632 00000100:00100000:3.0:1746147144.398038:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308021632 00002000:00100000:3.0:1746147144.398067:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012e322a00 x1830967308021632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.398077:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e322a00 with x1830967308021632 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.398081:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e322a00 00000100:00100000:3.0:1746147144.398129:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3548 00000100:00100000:3.0:1746147144.398135:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308021632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.398314:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310695040:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.398323:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310695168:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.398341:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147144.400292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.400333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.400357:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308021760 00000100:00100000:1.0:1746147144.400363:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308021760 00010000:00010000:1.0:1746147144.400395:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 54 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.400407:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308021888 00000100:00100000:2.0:1746147144.400411:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308021888 00010000:00010000:2.0:1746147144.400427:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 15 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.400436:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6432 00000100:00100000:1.0:1746147144.400442:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2000:x1830967308021760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.400452:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.400457:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 54 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.400461:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6433 00000100:00100000:2.0:1746147144.400466:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308021888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.400467:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 54 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.400473:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.400476:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 15 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.400486:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425056662 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fba expref: 54 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.400625:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 15 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.400652:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.400657:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.400664:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.400668:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.400702:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967308021760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 260us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.400708:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6432 00010000:00010000:2.0:1746147144.400753:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056615 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f89 expref: 15 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.400771:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.400774:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.400781:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.400786:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.400807:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147144.400813:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.400819:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147144.400824:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308021888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 358us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.400830:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6433 00000004:00200000:3.0:1746147144.400834:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.400942:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250566ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 15 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.400968:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.400973:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.400975:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147144.400977:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49e00, rc 0) 00000100:00100000:3.0:1746147144.401003:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32371:x1830967308021376:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4411us (4705us total) trans 8589935990 rc 0/0 00000100:00100000:3.0:1746147144.401009:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15295 00000100:00100000:3.0:1746147144.404360:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308021632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6217us (6386us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147144.404371:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3548 00002000:00100000:3.0:1746147144.404380:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012e322a00 x1830967308021632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.404392:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e322a00 with x1830967308021632 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.404397:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e322a00 00000100:00100000:0.0:1746147144.404950:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.405012:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308022016 00000100:00100000:3.0:1746147144.405020:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308022016 00000100:00100000:3.0:1746147144.405052:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15296 00000100:00100000:3.0:1746147144.405058:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32371:x1830967308022016:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147144.405080:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.405114:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6400/0x3139939425056703 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78031 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.405183:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.405197:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 15 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.405203:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.405227:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 15 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.405238:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 15 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.405249:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310695296:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.405317:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.412641:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.412749:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310695296:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.412770:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147144.413219:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308022144 00000100:00100000:2.0:1746147144.413225:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308022144 00010000:00010000:2.0:1746147144.413258:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 16 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.413298:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6434 00000100:00100000:2.0:1746147144.413306:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2003:x1830967308022144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.413318:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.413323:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 16 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.413334:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 16 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.413354:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x31399394250566f5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7802a expref: 16 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.413382:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.413386:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.413395:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.413401:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.413417:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.413467:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967308022144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 160us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.413473:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6434 00010000:00010000:2.0:1746147144.413501:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.413507:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147144.413549:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147144.413554:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147144.413568:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.413987:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6400/0x3139939425056703 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78031 expref: 15 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.414000:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78031 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.414007:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.414009:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147144.414011:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6e00, rc 0) 00000100:00100000:2.0:1746147144.414035:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32371:x1830967308022016:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8977us (9086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.414042:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15296 00000100:00100000:2.0:1746147144.418578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.419424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.419501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.419527:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308022528 00000100:00100000:2.0:1746147144.419536:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308022528 00000100:00100000:2.0:1746147144.419587:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308022656 00000100:00100000:2.0:1746147144.419589:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308022656 00000100:00100000:2.0:1746147144.419608:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14662 00000100:00100000:2.0:1746147144.419616:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308022528:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.419636:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147144.419637:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14663 00000100:00100000:0.0:1746147144.419645:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967308022656:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147144.419653:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.419654:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x3139939425056711 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78038 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.419662:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e1800/0x3139939425056718 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7803f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.419703:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310695552:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.419703:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310695424:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.419861:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.419930:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.419999:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308022400 00000100:00100000:1.0:1746147144.420004:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308022400 00000100:00100000:1.0:1746147144.421607:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5487 00000100:00100000:1.0:1746147144.421617:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32367:x1830967308022400:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147144.421836:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:32367:x1830967308022400:12345-192.168.204.25@tcp:35:cat.0 Request processed in 221us (3267us total) trans 8589935991 rc 0/0 00000100:00100000:1.0:1746147144.421844:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5487 00000100:00100000:0.0:1746147144.422337:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310695424:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147144.422370:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1800/0x3139939425056718 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7803f expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.422384:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1800/0x3139939425056718 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7803f expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.422399:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1800, rc 0) 00000100:00100000:0.0:1746147144.422423:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967308022656:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2779us (2921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.422430:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14663 00000100:00100000:3.0:1746147144.422919:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310695552:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.422954:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x3139939425056711 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78038 expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.422967:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x3139939425056711 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78038 expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.422990:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48e00, rc 0) 00000100:00100000:3.0:1746147144.423060:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308022528:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3443us (3636us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.423068:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14662 00000100:00100000:0.0:1746147144.429197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.429254:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308022912 00000100:00100000:2.0:1746147144.429265:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308022912 00000100:00100000:2.0:1746147144.429320:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15297 00000100:00100000:2.0:1746147144.429328:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32371:x1830967308022912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.429347:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.429363:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505671f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78046 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.429445:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.429457:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.429466:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147144.429476:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147144.430250:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505671f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.430281:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.430291:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.430294:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147144.430296:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48000, rc 0) 00000100:00100000:2.0:1746147144.430366:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32371:x1830967308022912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1038us (1179us total) trans 8589935992 rc 0/0 00000100:00100000:2.0:1746147144.430373:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15297 00000100:00100000:2.0:1746147144.436547:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.436590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.436605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.436619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.436898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.437060:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023168 00000100:00100000:3.0:1746147144.437062:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023424 00000100:00100000:1.0:1746147144.437070:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023168 00000100:00100000:3.0:1746147144.437073:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023424 00000100:00100000:3.0:1746147144.437119:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023680 00000100:00100000:3.0:1746147144.437122:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023680 00000100:00100000:1.0:1746147144.437143:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023040 00000100:00100000:1.0:1746147144.437146:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023040 00000100:00100000:3.0:1746147144.437161:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023296 00000100:00100000:3.0:1746147144.437163:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023296 00000100:00100000:1.0:1746147144.437169:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14664 00000100:00100000:1.0:1746147144.437178:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308023168:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:3.0:1746147144.437187:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14665 00000100:00100000:3.0:1746147144.437194:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308023680:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147144.437224:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437231:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437243:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437246:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437252:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.437253:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.437259:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437260:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.437261:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.437263:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 5/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437271:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437273:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437275:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437289:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 12 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.437299:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.437300:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 12 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.437310:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 35 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.437312:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310695680:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.437321:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310695808:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.437474:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14666 00000100:00100000:1.0:1746147144.437481:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308023040:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147144.437482:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437491:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 35 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.437498:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310695936:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.437502:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437512:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.437516:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147144.437519:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.437526:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147144.437533:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14667 00010000:00010000:1.0:1746147144.437534:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437535:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437537:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.437538:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308023296:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147144.437552:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437553:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.437560:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437562:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 16 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.437569:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.437570:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.437572:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.437573:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310696064:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.437584:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437590:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.437596:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310696192:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.437608:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147144.437611:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00010000:00010000:1.0:1746147144.437616:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.437623:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310696320:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.437636:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14668 00000100:00100000:3.0:1746147144.437640:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308023424:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147144.437650:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437654:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437658:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 38 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.437662:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437667:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.437667:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.437669:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.437670:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310696448:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.437685:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00010000:00010000:3.0:1746147144.437687:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.437694:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 38 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.437703:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310696576:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.437711:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.437720:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.437728:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310696704:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.437752:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437760:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 25 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.437768:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310696832:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.437781:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.437881:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.437897:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023552 00000100:00100000:1.0:1746147144.437900:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023552 00000100:00100000:1.0:1746147144.437935:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14669 00000100:00100000:1.0:1746147144.437940:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967308023552:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147144.437958:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437972:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.437979:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.437985:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.437991:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437993:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.437995:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.438010:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.438017:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 13 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.438025:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310696960:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.438051:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.438059:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 38 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.438070:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310697088:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.438110:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.438118:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.438125:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310697216:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.438148:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.438233:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.442513:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310695808:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.442600:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310695680:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147144.445686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.445721:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.445764:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023808 00000100:00100000:0.0:1746147144.445773:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023808 00010000:00010000:0.0:1746147144.445811:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 13 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746147144.445839:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6435 00000100:00100000:0.0:1746147144.445848:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967308023808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147144.445860:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147144.445882:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 13 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746147144.445893:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 13 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.445931:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310696192:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147144.445932:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x31399394250566e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78023 expref: 13 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746147144.445954:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147144.445955:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.445993:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308023808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 146us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.445999:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6435 00000100:00100000:2.0:1746147144.446010:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310696576:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.446026:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.446045:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024320 00000100:00100000:2.0:1746147144.446048:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024320 00002000:00100000:2.0:1746147144.446077:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1433599) req@ffff880099154e00 x1830967308024320/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.446109:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154e00 with x1830967308024320 ext(1048576->1433599) 00010000:00010000:2.0:1746147144.446116:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.446126:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.446126:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310696704:192.168.204.25@tcp:104: 00002000:00010000:2.0:1746147144.446132:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099154e00 00000100:00100000:2.0:1746147144.446148:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1119 00000100:00100000:2.0:1746147144.446154:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308024320:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147144.446215:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967310695936:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.446231:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.446305:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310696064:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.446314:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310696320:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.446321:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310696448:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.446340:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.446795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.446829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.446870:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024448 00000100:00100000:3.0:1746147144.446874:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024448 00010000:00010000:3.0:1746147144.446889:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.446921:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024576 00000100:00100000:3.0:1746147144.446924:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024576 00010000:00010000:3.0:1746147144.446935:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 36 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.446948:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6436 00000100:00100000:3.0:1746147144.446954:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308024448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147144.446962:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147144.446974:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.446982:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.446994:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x31399394250563ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77e2b expref: 12 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.447006:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.447037:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2003:x1830967308024448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.447043:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6436 00000100:00100000:3.0:1746147144.447054:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6437 00000100:00100000:3.0:1746147144.447059:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308024576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147144.447065:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147144.447071:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 36 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.447079:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 36 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.447108:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942505637c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dec expref: 36 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.447120:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.447133:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308024576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.447138:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6437 00000100:00100000:2.0:1746147144.452066:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.452117:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.452140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.452166:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024064 00000100:00100000:0.0:1746147144.452173:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024064 00000100:00100000:3.0:1746147144.452183:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024704 00000100:00100000:2.0:1746147144.452186:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310696832:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.452193:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024704 00002000:00100000:0.0:1746147144.452207:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1662976->2097151) req@ffff880091c3f480 x1830967308024064/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147144.452214:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147144.452216:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3f480 with x1830967308024064 ext(1662976->2097151) 00010000:00010000:0.0:1746147144.452223:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.452225:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 41 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.452232:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 35 pid: 1853 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746147144.452242:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c3f480 00000100:00100000:3.0:1746147144.452253:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308023936 00000100:00100000:3.0:1746147144.452256:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308023936 00000100:00100000:0.0:1746147144.452260:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1120 00010000:00010000:3.0:1746147144.452267:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 17 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.452267:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.452267:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308024064:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147144.452282:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024192 00000100:00100000:3.0:1746147144.452284:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024192 00000100:00100000:2.0:1746147144.452287:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6438 00010000:00010000:3.0:1746147144.452293:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 14 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.452293:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308024704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.452302:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147144.452309:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6439 00000100:00100000:3.0:1746147144.452316:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308023936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.452316:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 41 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.452324:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 41 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.452327:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.452346:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136348600/0x31399394250564fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ee1 expref: 41 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.452347:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 17 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.452357:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 17 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.452370:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147144.452380:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136348c00/0x3139939425056527 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77eef expref: 17 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746147144.452380:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6440 00000100:00100000:0.0:1746147144.452386:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308024192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147144.452390:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308024704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (272us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147144.452392:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147144.452392:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147144.452395:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6438 00010000:00010000:0.0:1746147144.452400:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 14 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746147144.452407:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 14 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.452408:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310696960:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147144.452418:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x31399394250565c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f5f expref: 14 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.452420:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310697088:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.452424:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308023936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 108us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.452430:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6439 00010000:00010000:0.0:1746147144.452430:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.452431:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147144.452432:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310697216:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147144.452435:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.452442:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.452456:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.452458:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147144.452473:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308024192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.452479:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6440 00010000:00010000:3.0:1746147144.452480:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452487:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452502:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452509:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452516:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452522:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f212800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147144.452525:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452537:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452547:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.452552:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.452595:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308023040:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15114us (15974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.452603:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14666 00000100:00100000:1.0:1746147144.452830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.452864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.452890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.452925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.452970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.452984:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024960 00000100:00100000:2.0:1746147144.452985:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308024832 00000100:00100000:1.0:1746147144.452987:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024960 00000100:00100000:2.0:1746147144.452990:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308024832 00010000:00010000:1.0:1746147144.453000:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 42 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.453004:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.453018:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025088 00000100:00100000:2.0:1746147144.453019:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025216 00000100:00100000:1.0:1746147144.453020:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025088 00000100:00100000:2.0:1746147144.453021:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025216 00010000:00010000:2.0:1746147144.453029:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.453032:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 37 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.453037:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025344 00000100:00100000:2.0:1746147144.453039:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025344 00000100:00100000:1.0:1746147144.453044:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6441 00010000:00010000:2.0:1746147144.453048:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 26 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.453050:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308024960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.453057:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147144.453058:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6442 00000100:00100000:2.0:1746147144.453063:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308024832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.453066:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 42 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.453069:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.453075:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 42 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.453086:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.453113:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.453123:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57c00/0x313993942505662a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f9e expref: 12 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.453131:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.453149:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308024832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.453154:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6442 00000100:00100000:2.0:1746147144.453165:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6443 00000100:00100000:2.0:1746147144.453169:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308025216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.453175:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.453181:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.453184:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6444 00010000:00010000:2.0:1746147144.453188:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.453191:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308025088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.453198:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56c00/0x31399394250565c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77f58 expref: 16 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.453199:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.453206:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147144.453209:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 37 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.453218:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 37 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.453219:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308025216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.453225:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6443 00010000:00010000:0.0:1746147144.453230:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49800/0x31399394250566b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78007 expref: 37 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.453231:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6445 00000100:00100000:2.0:1746147144.453234:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308025344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.453239:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147144.453239:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.453240:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.453244:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453247:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 26 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.453250:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453254:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 26 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.453264:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7600/0x313993942505632f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77dc9 expref: 26 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.453265:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147144.453272:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.453273:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.453275:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453281:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.453282:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308025088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.453287:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6444 00010000:00010000:2.0:1746147144.453293:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.453308:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308025344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.453313:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6445 00010000:00010000:2.0:1746147144.453326:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453332:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453343:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453349:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453355:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453360:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f212400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147144.453363:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453369:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453377:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453383:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x3139939425056734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453396:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056677 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fcf expref: 42 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.453412:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.453413:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.453416:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453421:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453430:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308023168:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 16252us (16895us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147144.453431:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.453437:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14664 00000100:00100000:1.0:1746147144.453446:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308024960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 397us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.453451:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6441 00000100:00100000:2.0:1746147144.453474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147144.453479:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453485:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453489:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025472 00000100:00100000:2.0:1746147144.453491:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025472 00010000:00010000:1.0:1746147144.453495:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453500:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453505:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14670 00010000:00010000:1.0:1746147144.453506:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453509:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308025472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147144.453516:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147144.453518:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.453518:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453523:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.453529:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7804d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453530:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.453534:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x3139939425056757 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147144.453538:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x68141747, atime: 0x68141747, ctime: 0x68141747, blocks: 0x7c8 00010000:00010000:2.0:1746147144.453547:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.453549:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147144.453561:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308023552:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15621us (15680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.453567:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14669 00000100:00100000:1.0:1746147144.453589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.453598:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025600 00000100:00100000:1.0:1746147144.453600:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025600 00000100:00100000:1.0:1746147144.453613:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14671 00010000:00010000:2.0:1746147144.453614:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147144.453617:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308025600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.453625:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.453628:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.453631:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49600, rc 0) 00010000:00010000:1.0:1746147144.453637:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78054 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453645:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308025472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 136us (171us total) trans 0 rc 0/0 00002000:00010000:1.0:1746147144.453647:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141747, atime: 0x68141746, ctime: 0x68141746, blocks: 0x808 00000100:00100000:2.0:1746147144.453649:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14670 00010000:00010000:1.0:1746147144.453658:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.453659:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.453665:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.453675:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.453681:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d200, rc 0) 00000100:00100000:2.0:1746147144.453685:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.453709:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025728 00000100:00100000:2.0:1746147144.453712:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025728 00000100:00100000:2.0:1746147144.453727:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14672 00000100:00100000:2.0:1746147144.453732:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967308025728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.453739:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.453745:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x313993942505676c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7805b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453774:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310697344:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.453818:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800879f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.453854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.453864:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025856 00000100:00100000:2.0:1746147144.453865:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025856 00000100:00100000:2.0:1746147144.453877:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14673 00000100:00100000:2.0:1746147144.453880:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308025856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.453884:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.453888:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x3139939425056773 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78062 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453915:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310697472:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.453928:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453931:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147144.453937:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.453949:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.453955:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.453962:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147144.453974:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c6200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147144.453977:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.453980:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308025984 00010000:00010000:3.0:1746147144.453982:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.453984:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308025984 00010000:00010000:3.0:1746147144.453992:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.453992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147144.453998:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6200/0x313993942505673b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.454008:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308026112 00000100:00100000:0.0:1746147144.454010:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308026112 00000100:00100000:0.0:1746147144.454023:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14674 00000100:00100000:0.0:1746147144.454028:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967308025984:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147144.454033:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967308023680:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 16840us (17426us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147144.454035:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147144.454038:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14665 00010000:00010000:0.0:1746147144.454042:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78069 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.454051:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14675 00002000:00010000:0.0:1746147144.454051:0:17600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141747, atime: 0x68141747, ctime: 0x68141747, blocks: 0x1590 00000100:00100000:3.0:1746147144.454056:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967308026112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.454059:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.454060:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.454061:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.454064:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.454068:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78070 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.454072:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147144.454075:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141748, atime: 0x68141748, ctime: 0x68141748, blocks: 0x1008 00010000:00010000:0.0:1746147144.454080:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0400, rc 0) 00010000:00010000:3.0:1746147144.454081:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.454082:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.454086:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.454111:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147144.454111:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308025984:12345-192.168.204.25@tcp:101:cat.0 Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.454115:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14674 00010000:00010000:3.0:1746147144.454117:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:3.0:1746147144.454130:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967308026112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 74us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.454135:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14675 00000100:00100000:1.0:1746147144.454395:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967308025600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 776us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.454401:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14671 00000100:00100000:2.0:1746147144.454806:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308024320:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8650us (9082us total) trans 17179874219 rc 0/0 00000100:00100000:2.0:1746147144.454815:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1119 00002000:00100000:2.0:1746147144.454821:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1433599) req@ffff880099154e00 x1830967308024320/t17179874219(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.454835:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154e00 with x1830967308024320 ext(1048576->1433599) 00010000:00010000:2.0:1746147144.454841:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.454849:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.454855:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099154e00 00000100:00100000:2.0:1746147144.458671:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308024064:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6393us (6600us total) trans 21474841487 rc 0/0 00000100:00100000:2.0:1746147144.458683:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1120 00002000:00100000:2.0:1746147144.458695:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1662976->2097151) req@ffff880091c3f480 x1830967308024064/t21474841487(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.458704:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3f480 with x1830967308024064 ext(1662976->2097151) 00010000:00010000:2.0:1746147144.458715:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 36 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.458728:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 36 pid: 1853 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.458736:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c3f480 00000100:00100000:2.0:1746147144.458798:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310697472:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.458799:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310697344:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.458824:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x313993942505676c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7805b expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.458825:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x3139939425056773 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78062 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.458837:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x313993942505676c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7805b expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.458838:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x3139939425056773 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78062 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.458848:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49400, rc 0) 00010000:00010000:2.0:1746147144.458848:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:2.0:1746147144.458867:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308025856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4985us (5012us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.458871:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967308025728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5138us (5185us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.458873:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14673 00000100:00100000:3.0:1746147144.458876:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14672 00000100:00100000:0.0:1746147144.460184:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.460585:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308026240 00000100:00100000:3.0:1746147144.460594:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308026240 00010000:00010000:3.0:1746147144.460629:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.460664:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6446 00000100:00100000:3.0:1746147144.460673:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308026240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147144.460687:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147144.460702:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.460712:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.460732:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x3139939425056670 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fc1 expref: 39 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.460780:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.460783:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.460788:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.460796:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.460835:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.460885:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308026240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 213us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.460891:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6446 00010000:00010000:2.0:1746147144.460922:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460931:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460948:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460956:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460963:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460969:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147144.460972:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460984:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.460996:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.461001:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x3139939425056750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.461049:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967308023424:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 23407us (24458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.461057:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14668 00000100:00100000:0.0:1746147144.462208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.462281:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308026368 00000100:00100000:3.0:1746147144.462286:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308026368 00010000:00010000:3.0:1746147144.462307:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 36 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.462331:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6447 00000100:00100000:3.0:1746147144.462336:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308026368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147144.462346:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147144.462358:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 36 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.462368:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 36 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.462383:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x3139939425056638 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77fac expref: 36 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.462394:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.462396:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.462399:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.462404:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.462434:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.462471:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308026368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.462477:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6447 00010000:00010000:2.0:1746147144.462720:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462727:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462742:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462748:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462754:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462764:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0f400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147144.462767:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462773:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462782:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.462788:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425056749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.462837:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2002:x1830967308023296:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 25297us (25938us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.462844:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14667 00000100:00100000:0.0:1746147144.464699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.464751:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308026624 00000100:00100000:2.0:1746147144.464757:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308026624 00000100:00100000:2.0:1746147144.464805:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15298 00000100:00100000:2.0:1746147144.464812:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32371:x1830967308026624:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147144.464860:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.464882:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x313993942505670a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78031 expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464897:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.464901:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147144.464936:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.464948:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 53 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464954:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464960:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464965:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464971:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 53 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464977:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.464982:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.465010:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.465021:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 29 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.465039:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697600:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.465726:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 53 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.465735:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 53 pid: 7239 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.465743:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697728:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.465785:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.465792:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 29 pid: 7239 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.465799:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697856:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.465821:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.465828:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 29 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.465835:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697984:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.465855:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.465864:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 29 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.465871:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310698112:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.465893:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 53 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.465900:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 53 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.465918:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310698240:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.465940:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801355989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.466650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.466717:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.466801:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697600:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.466831:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308026880 00000100:00100000:3.0:1746147144.466835:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308026880 00002000:00100000:3.0:1746147144.466869:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098820700 x1830967308026880/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.466878:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820700 with x1830967308026880 ext(0->1048575) 00002000:00010000:3.0:1746147144.466883:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820700 00000100:00100000:3.0:1746147144.466896:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027136 00000100:00100000:3.0:1746147144.466898:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027136 00002000:00100000:3.0:1746147144.466921:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012ca10e00 x1830967308027136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.466927:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10e00 with x1830967308027136 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.466930:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca10e00 00000100:00100000:3.0:1746147144.466953:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3549 00000100:00100000:3.0:1746147144.466959:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308026880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147144.466983:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3550 00000100:00100000:1.0:1746147144.466991:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967308027136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.467749:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.468114:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.468131:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027264 00000100:00100000:0.0:1746147144.468135:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027264 00010000:00010000:0.0:1746147144.468158:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 30 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.468184:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027648 00000100:00100000:0.0:1746147144.468187:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027648 00010000:00010000:0.0:1746147144.468196:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 31 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.468209:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6448 00000100:00100000:1.0:1746147144.468218:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308027264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.468229:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.468235:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 31 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.468246:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 31 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.468266:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250562d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77d75 expref: 31 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.468283:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.468289:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.468297:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.468324:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308027264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 107us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.468329:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6448 00000100:00100000:1.0:1746147144.468344:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6449 00000100:00100000:1.0:1746147144.468349:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308027648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.468355:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.468359:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 29 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.468366:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 29 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.468375:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.468378:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.468383:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.468397:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308027648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.468403:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6449 00000100:00100000:0.0:1746147144.468549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.468561:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027520 00000100:00100000:0.0:1746147144.468564:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027520 00010000:00010000:0.0:1746147144.468575:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 29 pid: 7239 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.468699:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697728:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.468708:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697856:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.468715:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x3139939425055fa8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77b99 expref: 29 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.468725:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310697984:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.468732:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310698112:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147144.468833:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6450 00000100:00100000:0.0:1746147144.468839:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308027520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147144.468846:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147144.468850:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 28 pid: 7239 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.468857:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 28 pid: 7239 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.468868:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x3139939425055faf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba0 expref: 28 pid: 7239 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.468880:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147144.468884:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.468889:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147144.468912:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967308027520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.468918:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6450 00000100:00100000:0.0:1746147144.468954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.468963:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027776 00000100:00100000:0.0:1746147144.468965:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027776 00010000:00010000:0.0:1746147144.468974:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 27 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.468991:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6451 00000100:00100000:0.0:1746147144.468995:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967308027776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147144.469001:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147144.469003:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 27 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.469010:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 27 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.469019:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425056026 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77be6 expref: 27 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.469026:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147144.469029:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147144.469037:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147144.469048:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308027776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.469053:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6451 00000100:00100000:3.0:1746147144.469165:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310698240:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.469209:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147144.472851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.472916:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.472995:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027904 00000100:00100000:2.0:1746147144.473004:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027904 00010000:00010000:2.0:1746147144.473041:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 54 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.473072:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308027392 00000100:00100000:2.0:1746147144.473074:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308027392 00010000:00010000:2.0:1746147144.473083:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 55 pid: 7239 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.473166:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6452 00000100:00100000:1.0:1746147144.473177:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2002:x1830967308027904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.473192:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.473198:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 55 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.473209:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 55 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.473234:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x3139939425056003 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77bdf expref: 55 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.473249:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.473254:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.473261:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.473304:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2002:x1830967308027904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 129us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.473311:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6452 00000100:00100000:2.0:1746147144.473399:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6453 00000100:00100000:2.0:1746147144.473404:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2001:x1830967308027392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.473411:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.473413:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 53 pid: 7239 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.473421:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 53 pid: 7239 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.473432:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425055fb6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e77ba7 expref: 53 pid: 7239 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.473441:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.473444:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.473451:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.473457:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.473818:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.473838:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967308027392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 433us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.473845:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6453 00010000:00010000:3.0:1746147144.474051:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.474059:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147144.474479:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2003:x1830967308027136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7489us (7761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147144.474488:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3550 00002000:00100000:1.0:1746147144.474498:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012ca10e00 x1830967308027136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147144.474507:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10e00 with x1830967308027136 ext(1048576->2097151) 00002000:00010000:1.0:1746147144.474511:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca10e00 00000040:00080000:3.0:1746147144.475129:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].587, 88 off59720 00000004:00080000:3.0:1746147144.475149:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465059011ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.475214:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].524, 88 off54168 00000004:00080000:3.0:1746147144.475219:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465129503ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475232:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].525, 88 off54256 00000004:00080000:3.0:1746147144.475235:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465145145ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475244:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].588, 88 off59808 00000004:00080000:3.0:1746147144.475247:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465157473ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.475265:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].589, 88 off59896 00000004:00080000:3.0:1746147144.475268:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465178795ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.475278:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].526, 88 off54344 00000004:00080000:3.0:1746147144.475283:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465193443ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475294:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].527, 88 off54432 00000004:00080000:3.0:1746147144.475296:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465206719ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475306:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].528, 88 off54520 00000004:00080000:3.0:1746147144.475308:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465218473ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475316:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].590, 88 off59984 00000004:00080000:3.0:1746147144.475318:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465228746ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.475337:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].529, 88 off54608 00000004:00080000:3.0:1746147144.475340:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465250220ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475346:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].591, 88 off60072 00000004:00080000:3.0:1746147144.475348:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465259011ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.475360:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].530, 88 off54696 00000004:00080000:3.0:1746147144.475362:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682465272991ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.475369:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].592, 88 off60160 00000004:00080000:3.0:1746147144.475371:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465282119ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.475381:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].593, 88 off60248 00000004:00080000:3.0:1746147144.475383:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682465293755ns, next at 554081470618ns, rc = 0 00000100:00100000:2.0:1746147144.475729:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308026880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8765us (9076us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.475741:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3549 00002000:00100000:2.0:1746147144.475749:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098820700 x1830967308026880/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.475757:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820700 with x1830967308026880 ext(0->1048575) 00002000:00010000:2.0:1746147144.475761:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820700 00000040:00080000:3.0:1746147144.477118:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].594, 88 off60336 00000004:00080000:3.0:1746147144.477127:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682467036860ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.477146:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].595, 88 off60424 00000004:00080000:3.0:1746147144.477149:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682467059208ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.477161:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].531, 88 off54784 00000004:00080000:3.0:1746147144.477164:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682467074073ns, next at 554081490131ns, rc = 0 00000001:00080000:2.0:1746147144.481285:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935993 is committed 00000004:00080000:2.0:1746147144.481295:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 526 committed 00000004:00080000:2.0:1746147144.481310:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 587 committed 00000004:00080000:2.0:1746147144.481322:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 586 committed 00000004:00080000:2.0:1746147144.481324:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 585 committed 00000004:00080000:2.0:1746147144.481325:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 584 committed 00000004:00080000:2.0:1746147144.481326:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 525 committed 00000004:00080000:2.0:1746147144.481327:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 583 committed 00000004:00080000:2.0:1746147144.481329:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 524 committed 00000004:00080000:2.0:1746147144.481330:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 582 committed 00000004:00080000:2.0:1746147144.481332:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 523 committed 00000004:00080000:2.0:1746147144.481334:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 522 committed 00000004:00080000:2.0:1746147144.481335:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 521 committed 00000004:00080000:2.0:1746147144.481337:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 581 committed 00000004:00080000:2.0:1746147144.481338:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 580 committed 00000004:00080000:2.0:1746147144.481340:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 520 committed 00000004:00080000:2.0:1746147144.481341:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 519 committed 00000004:00080000:2.0:1746147144.481343:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 579 committed 00000001:00080000:2.0:1746147144.481352:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935991 is committed 00000001:00080000:2.0:1746147144.481360:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935988 is committed 00000004:00010000:3.0:1746147144.481809:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098823b80 reply state ffff88009a97f000 transno 8589935993 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.481827:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.481835:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.481838:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746147144.481841:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147144.481937:0:6215:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147144.481951:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32371:x1830967308026624:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 17135us (17254us total) trans 8589935993 rc 0/0 00000100:00100000:3.0:1746147144.481958:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15298 00010000:00010000:3.0:1746147144.481994:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.482000:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.482005:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.482010:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822ba00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.482014:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.482019:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.482030:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:1.0:1746147144.482031:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310698368:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147144.482032:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147144.482035:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.482039:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x3139939425056788 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147144.482128:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482553:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310698624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.482589:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482608:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310699136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.482618:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482630:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147144.482634:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310698496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.482649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482658:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310699008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.482669:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482687:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310698368 00000100:00100000:2.0:1746147144.482693:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310698368 00000100:00100000:2.0:1746147144.482723:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310698624 00000100:00100000:2.0:1746147144.482724:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310698624 00000100:00100000:2.0:1746147144.482732:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699136 00000100:00100000:2.0:1746147144.482734:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699136 00000100:00100000:2.0:1746147144.482741:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310698496 00000100:00100000:2.0:1746147144.482743:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310698496 00000100:00100000:2.0:1746147144.482753:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699008 00000100:00100000:2.0:1746147144.482754:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699008 00000100:00100000:2.0:1746147144.482763:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14676 00000100:00100000:2.0:1746147144.482768:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3765:x1830967310698368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147144.482790:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310699520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.482817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.482833:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310700032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.482848:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147144.482851:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147144.482854:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.482856:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147142 -> 1746147142 00002000:00010000:2.0:1746147144.482857:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147142 -> 1746147142 00000100:00100000:1.0:1746147144.482858:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00002000:00010000:2.0:1746147144.482859:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147144.482863:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310699648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.482878:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482881:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3765:x1830967310698368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (754us total) trans 21474841488 rc 0/0 00000100:00100000:1.0:1746147144.482886:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310700160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.482890:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14676 00000100:00100000:2.0:1746147144.482898:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699520 00000100:00100000:2.0:1746147144.482900:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699520 00000100:00100000:1.0:1746147144.482900:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.482921:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310700032 00000100:00100000:2.0:1746147144.482922:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310700032 00000100:00100000:2.0:1746147144.482929:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699648 00000100:00100000:2.0:1746147144.482931:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699648 00000100:00100000:1.0:1746147144.482931:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310700160 00000100:00100000:1.0:1746147144.482937:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310700160 00000100:00100000:2.0:1746147144.482939:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14677 00000100:00100000:2.0:1746147144.482943:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3767:x1830967310698624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147144.482964:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14678 00000100:00100000:1.0:1746147144.482971:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967310699136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.482991:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967310698624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (402us total) trans 21474841489 rc 0/0 00000100:00100000:2.0:1746147144.482996:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14677 00000100:00100000:2.0:1746147144.483005:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14679 00000100:00100000:2.0:1746147144.483009:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967310698496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147144.483051:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147144.483053:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.483054:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.483056:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.483057:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00002000:00010000:1.0:1746147144.483062:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147144.483065:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.483068:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147144.483070:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000100:00100000:2.0:1746147144.483071:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967310698496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (421us total) trans 17179874220 rc 0/0 00002000:00010000:1.0:1746147144.483072:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:2.0:1746147144.483075:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14679 00000100:00100000:2.0:1746147144.483082:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14680 00000100:00100000:2.0:1746147144.483086:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967310699008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147144.483119:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967310699136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (498us total) trans 21474841490 rc 0/0 00000100:00100000:1.0:1746147144.483125:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14678 00000100:00100000:2.0:1746147144.483150:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967310699008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (479us total) trans 21474841491 rc 0/0 00000100:00100000:2.0:1746147144.483158:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14680 00000100:00100000:2.0:1746147144.483168:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14681 00000100:00100000:2.0:1746147144.483171:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310699520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.483220:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967310699520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (402us total) trans 17179874221 rc 0/0 00000100:00100000:2.0:1746147144.483224:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14681 00000100:00100000:2.0:1746147144.483237:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14682 00000100:00100000:2.0:1746147144.483241:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310700032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.483257:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310698752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.483279:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.483286:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310698752 00000100:00100000:2.0:1746147144.483287:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967310700032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (439us total) trans 17179874222 rc 0/0 00000100:00100000:1.0:1746147144.483289:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310698752 00000100:00100000:2.0:1746147144.483292:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14682 00000100:00100000:3.0:1746147144.483298:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.483302:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14683 00000100:00100000:1.0:1746147144.483306:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14684 00000100:00100000:2.0:1746147144.483307:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310699648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.483311:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.483311:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310700160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.483319:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.483332:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.483339:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310700288:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147144.483343:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:2.0:1746147144.483345:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.483346:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.483348:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147143 -> 1746147143 00002000:00010000:2.0:1746147144.483350:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:3.0:1746147144.483351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.483359:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1746147144.483363:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310698880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.483364:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967310699648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (485us total) trans 17179874223 rc 0/0 00000100:00100000:2.0:1746147144.483369:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14683 00000100:00100000:3.0:1746147144.483374:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.483376:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699264 00000100:00100000:2.0:1746147144.483378:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699264 00000100:00100000:3.0:1746147144.483380:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.483385:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699776 00000100:00100000:2.0:1746147144.483387:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699776 00000100:00100000:3.0:1746147144.483392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.483393:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310700288 00000100:00100000:2.0:1746147144.483394:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310700288 00000100:00100000:3.0:1746147144.483398:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.483399:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310698880 00000100:00100000:2.0:1746147144.483400:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310698880 00000100:00100000:2.0:1746147144.483405:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699392 00000100:00100000:2.0:1746147144.483407:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699392 00000100:00100000:3.0:1746147144.483409:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.483411:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310699904 00000100:00100000:2.0:1746147144.483413:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310699904 00000100:00100000:2.0:1746147144.483419:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14685 00000100:00100000:2.0:1746147144.483423:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310698752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.483424:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14686 00000100:00100000:3.0:1746147144.483428:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310699264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147144.483456:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147144.483459:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00002000:00010000:2.0:1746147144.483460:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:2.0:1746147144.483462:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:2.0:1746147144.483464:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147144.483483:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310698752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (204us total) trans 21474841492 rc 0/0 00000100:00100000:2.0:1746147144.483488:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14685 00000100:00100000:3.0:1746147144.483491:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310699264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (180us total) trans 21474841493 rc 0/0 00000100:00100000:3.0:1746147144.483496:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14686 00000100:00100000:2.0:1746147144.483498:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14687 00000100:00100000:2.0:1746147144.483502:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310699776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.483504:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14688 00000100:00100000:3.0:1746147144.483508:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967310700288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.483537:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14689 00000100:00100000:3.0:1746147144.483541:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310698880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147144.483581:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147144.483584:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147144.483586:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147144.483587:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147144.483589:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:3.0:1746147144.483608:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967310698880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (232us total) trans 21474841494 rc 0/0 00000100:00100000:3.0:1746147144.483612:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14689 00000100:00100000:3.0:1746147144.483621:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14690 00000100:00100000:3.0:1746147144.483625:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310699392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.483674:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967310699392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (280us total) trans 21474841495 rc 0/0 00000100:00100000:3.0:1746147144.483678:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14690 00000100:00100000:3.0:1746147144.483687:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14691 00000100:00100000:3.0:1746147144.483691:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310699904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.483860:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310699776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 357us (525us total) trans 17179874224 rc 0/0 00000100:00100000:2.0:1746147144.483865:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14687 00002000:00010000:3.0:1746147144.483873:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:3.0:1746147144.483876:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:3.0:1746147144.483878:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147144.483879:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746147144.483881:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00080000:2.0:1746147144.483881:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746147144.483883:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147144.483897:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310699904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (488us total) trans 17179874226 rc 0/0 00000004:00080000:2.0:1746147144.483913:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098822a00/2, rc 0, transno 17179874220 00000100:00100000:3.0:1746147144.483916:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14691 00000100:00100000:2.0:1746147144.483922:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310698496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147144.483931:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca13100/2, rc 0, transno 21474841491 00000100:00100000:2.0:1746147144.483934:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310699008:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147144.483937:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:3.0:1746147144.483939:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147144.483941:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:2.0:1746147144.483941:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10a80/2, rc 0, transno 21474841489 00002000:00010000:3.0:1746147144.483943:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000100:00100000:2.0:1746147144.483943:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310698624:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147144.483945:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000004:00080000:2.0:1746147144.483949:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca12300/2, rc 0, transno 21474841490 00000100:00100000:2.0:1746147144.483951:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310699136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.483971:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967310700288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 463us (619us total) trans 17179874225 rc 0/0 00000100:00100000:3.0:1746147144.483976:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14688 00000004:00080000:3.0:1746147144.483992:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11880/2, rc 0, transno 21474841494 00000100:00100000:3.0:1746147144.483995:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310698880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.484011:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca13480/2, rc 0, transno 21474841495 00000100:00100000:3.0:1746147144.484014:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699392:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.484021:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70380/2, rc 0, transno 17179874226 00000100:00100000:3.0:1746147144.484027:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147144.484034:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10000/2, rc 0, transno 21474841492 00000100:00100000:3.0:1746147144.484036:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310698752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.484041:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11f80/2, rc 0, transno 21474841493 00000100:00100000:3.0:1746147144.484043:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699264:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.484048:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c73800/2, rc 0, transno 17179874224 00000100:00100000:3.0:1746147144.484051:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310699776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147144.484056:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095062300/2, rc 0, transno 17179874225 00000100:00100000:3.0:1746147144.484058:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310700288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.484064:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746147144.484068:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310700416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.484086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.484137:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310700416 00000100:00100000:3.0:1746147144.484140:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310700416 00000100:00100000:3.0:1746147144.484155:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14692 00000100:00100000:3.0:1746147144.484159:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310700416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147144.484163:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147144.484166:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.484167:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147144.484168:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.484170:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000004:00080000:0.0:1746147144.484184:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e500a80/2, rc 0, transno 17179874223 00000100:00100000:0.0:1746147144.484188:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310699648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.484192:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3766:x1830967310700160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 881us (1291us total) trans 17179874227 rc 0/0 00000100:00100000:1.0:1746147144.484196:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14684 00000004:00080000:0.0:1746147144.484197:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095063100/2, rc 0, transno 17179874227 00000100:00100000:0.0:1746147144.484199:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310700160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147144.484205:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e501180/2, rc 0, transno 17179874221 00000100:00100000:0.0:1746147144.484207:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310699520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147144.484213:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c72d80/2, rc 0, transno 17179874222 00000100:00100000:0.0:1746147144.484215:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310700032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.484220:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967310700416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (133us total) trans 17179874228 rc 0/0 00000100:00100000:3.0:1746147144.484225:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14692 00000004:00080000:1.0:1746147144.484227:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca12680/2, rc 0, transno 21474841488 00000100:00100000:1.0:1746147144.484230:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310698368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.484244:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd45f80/2, rc 0, transno 17179874228 00000100:00100000:3.0:1746147144.484247:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310700416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147144.484429:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.484521:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028032 00000100:00100000:3.0:1746147144.484524:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028032 00000100:00100000:3.0:1746147144.484547:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15299 00000100:00100000:3.0:1746147144.484551:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+7:32375:x1830967308028032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.484568:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.484581:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ea2a00/0x313993942505678f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78077 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.484616:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ea2a00/0x313993942505678f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78077 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.484629:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ea2a00/0x313993942505678f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78077 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.484641:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.484644:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147144.484646:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ea2a00, rc 0) 00000100:00100000:3.0:1746147144.485233:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+8:32375:x1830967308028032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 680us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.485238:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15299 00000100:00100000:2.0:1746147144.485705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.485893:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028160 00000100:00100000:3.0:1746147144.485896:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028160 00000100:00100000:3.0:1746147144.485931:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15300 00000100:00100000:3.0:1746147144.485935:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32371:x1830967308028160:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147144.485946:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.485955:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7807e expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.485980:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.485987:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.485996:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.485998:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147144.486000:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32e00, rc 0) 00000100:00100000:3.0:1746147144.486020:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32371:x1830967308028160:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.486025:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15300 00000100:00100000:0.0:1746147144.489951:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.490500:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028288 00000100:00100000:2.0:1746147144.490509:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028288 00000100:00100000:2.0:1746147144.490566:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15301 00000100:00100000:2.0:1746147144.490573:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32371:x1830967308028288:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.490595:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.490617:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x313993942505679d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78085 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.490846:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.490861:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.490871:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147144.490900:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147144.490919:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147144.490937:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.490964:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x313993942505679d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.490999:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.491007:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.491010:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147144.491012:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99000, rc 0) 00000100:00100000:2.0:1746147144.491625:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32371:x1830967308028288:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1050us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.491632:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15301 00000100:00100000:1.0:1746147144.494328:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.494488:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028544 00000100:00100000:2.0:1746147144.494495:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028544 00002000:00100000:2.0:1746147144.494532:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801312e8000 x1830967308028544/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.494541:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8000 with x1830967308028544 ext(1048576->2097151) 00002000:00010000:2.0:1746147144.494545:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8000 00000100:00100000:2.0:1746147144.494559:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3551 00000100:00100000:2.0:1746147144.494567:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308028544:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.495084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.495147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.495164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.495179:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.495247:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028672 00000100:00100000:3.0:1746147144.495254:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028672 00000100:00100000:2.0:1746147144.495415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.495443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.495460:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028800 00000100:00100000:2.0:1746147144.495464:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028800 00000100:00100000:1.0:1746147144.495493:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308028928 00000100:00100000:1.0:1746147144.495497:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308028928 00000100:00100000:2.0:1746147144.495543:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029056 00000100:00100000:2.0:1746147144.495546:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029056 00000100:00100000:1.0:1746147144.495554:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029312 00000100:00100000:1.0:1746147144.495557:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029312 00000100:00100000:3.0:1746147144.496011:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029184 00000100:00100000:3.0:1746147144.496016:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029184 00000100:00100000:2.0:1746147144.496019:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14693 00000100:00100000:2.0:1746147144.496026:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308028800:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147144.496039:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14694 00010000:00010000:2.0:1746147144.496039:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147144.496046:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308028928:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.496053:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78093 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.496060:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147144.496067:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14695 00010000:00010000:2.0:1746147144.496071:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.496073:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.496076:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7809a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.496079:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147144.496080:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308028672:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.496111:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147144.496116:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x68141748, atime: 0x68141748, ctime: 0x68141748, blocks: 0x808 00010000:00010000:2.0:1746147144.496121:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00010000:00010000:3.0:1746147144.496133:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.496135:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.496141:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147144.496150:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308028800:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 124us (1002us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147144.496154:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147144.496157:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14693 00010000:00010000:3.0:1746147144.496163:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32200, rc 0) 00000100:00100000:2.0:1746147144.496171:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14696 00000100:00100000:2.0:1746147144.496176:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308029056:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147144.496181:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.496182:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.496192:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780a1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.496192:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7808c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.496195:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308028928:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 150us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.496201:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14694 00010000:00010000:1.0:1746147144.496204:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.496206:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746147144.496207:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141748, atime: 0x68141748, ctime: 0x68141748, blocks: 0x800 00010000:00010000:1.0:1746147144.496211:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.496214:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.496216:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147144.496217:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14697 00010000:00010000:2.0:1746147144.496220:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.496222:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147144.496227:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308029312:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147144.496229:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00010000:00010000:2.0:1746147144.496233:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.496237:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.496239:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f400, rc 0) 00010000:00010000:3.0:1746147144.496244:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780af expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.496249:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308028672:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 173us (1172us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147144.496254:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147144.496255:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308029056:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 79us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.496255:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14695 00010000:00010000:3.0:1746147144.496256:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.496259:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147144.496261:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14696 00000100:00100000:1.0:1746147144.496268:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14698 00010000:00010000:3.0:1746147144.496269:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147144.496273:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308029184:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147144.496275:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33a00, rc 0) 00010000:00010000:1.0:1746147144.496279:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.496286:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780a8 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.496292:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308029312:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 70us (879us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147144.496295:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.496296:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147144.496298:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14697 00010000:00010000:1.0:1746147144.496300:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.496308:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.496314:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05a00, rc 0) 00000100:00100000:1.0:1746147144.496329:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308029184:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 57us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.496334:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14698 00000100:00100000:1.0:1746147144.499808:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.500163:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029568 00000100:00100000:2.0:1746147144.500171:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029568 00000100:00100000:2.0:1746147144.500225:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15302 00000100:00100000:2.0:1746147144.500232:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:32377:x1830967308029568:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147144.500247:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.500262:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x31399394250567d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780b6 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.500323:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500333:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500342:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500352:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500357:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500362:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500445:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500454:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.500460:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.500485:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.500674:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 8 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.500686:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310700544:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.501191:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.501995:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310700544:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.502011:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147144.502018:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.502120:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029696 00000100:00100000:1.0:1746147144.502126:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029696 00000100:00100000:3.0:1746147144.502144:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308028544:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7577us (7823us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746147144.502149:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 9 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.502154:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3551 00002000:00100000:3.0:1746147144.502162:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801312e8000 x1830967308028544/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.502170:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8000 with x1830967308028544 ext(1048576->2097151) 00000100:00100000:1.0:1746147144.502170:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6454 00002000:00010000:3.0:1746147144.502175:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8000 00000100:00100000:1.0:1746147144.502176:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308029696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.502185:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.502189:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 9 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.502198:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 9 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.502435:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425056726 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78046 expref: 9 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.502450:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.502454:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.502461:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.502467:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.502486:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.502504:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308029696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 329us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.502509:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6454 00010000:00010000:3.0:1746147144.502542:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502549:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147144.502562:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.502640:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502645:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502650:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502654:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.502657:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502662:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502669:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.502672:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147144.502674:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.502678:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f200/0x31399394250567ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503156:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503161:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503166:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503172:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503176:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504e400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.503178:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503187:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503194:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147144.503196:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.503198:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503202:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x31399394250567dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503210:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503215:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503219:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503223:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.503225:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503236:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503245:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a46ad200) 00010000:00010000:3.0:1746147144.503247:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.503249:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503253:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250567e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.503287:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x31399394250567d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780b6 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.503294:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x31399394250567d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780b6 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.503294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147144.503300:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e200, rc 0) 00000100:00100000:3.0:1746147144.503322:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32377:x1830967308029568:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3090us (3521us total) trans 8589935994 rc 301/301 00000100:00100000:3.0:1746147144.503328:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15302 00000100:00100000:0.0:1746147144.503434:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.503464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.503465:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029824 00000100:00100000:1.0:1746147144.503470:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029824 00000100:00100000:0.0:1746147144.503477:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308029952 00000100:00100000:0.0:1746147144.503480:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308029952 00000100:00100000:1.0:1746147144.503493:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030208 00000100:00100000:1.0:1746147144.503495:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030208 00000100:00100000:0.0:1746147144.503500:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14699 00000100:00100000:1.0:1746147144.503518:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14700 00000100:00100000:1.0:1746147144.503524:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308029952:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147144.503579:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14701 00000100:00100000:1.0:1746147144.503581:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308029952:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.503585:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308030208:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147144.503586:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14700 00000100:00100000:0.0:1746147144.503597:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308029824:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147144.503622:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308030208:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.503630:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14701 00000100:00100000:1.0:1746147144.503631:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.503639:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030464 00000100:00100000:0.0:1746147144.503639:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308029824:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 132us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.503641:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030464 00000100:00100000:0.0:1746147144.503644:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14699 00000100:00100000:2.0:1746147144.503654:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14702 00000100:00100000:1.0:1746147144.503655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.503658:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308030464:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147144.503659:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030080 00000100:00100000:0.0:1746147144.503661:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030080 00000100:00100000:0.0:1746147144.503675:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14703 00000100:00100000:0.0:1746147144.503680:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308030080:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147144.503684:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308030464:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 25us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.503684:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.503689:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14702 00000100:00100000:3.0:1746147144.503694:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030336 00000100:00100000:3.0:1746147144.503698:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030336 00000100:00100000:0.0:1746147144.503711:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308030080:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (55us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.503715:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14704 00000100:00100000:0.0:1746147144.503718:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14703 00000100:00100000:3.0:1746147144.503719:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308030336:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147144.503765:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308030336:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.503770:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14704 00000100:00100000:0.0:1746147144.508432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.508479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.508508:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.508594:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030592 00000100:00100000:2.0:1746147144.508606:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030592 00000100:00100000:0.0:1746147144.508608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.508648:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030720 00000100:00100000:2.0:1746147144.508650:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030720 00000100:00100000:2.0:1746147144.509276:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030848 00000100:00100000:0.0:1746147144.509276:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308030976 00000100:00100000:2.0:1746147144.509279:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030848 00000100:00100000:0.0:1746147144.509281:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308030976 00000100:00100000:2.0:1746147144.509309:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14705 00000100:00100000:0.0:1746147144.509314:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14706 00000100:00100000:2.0:1746147144.509316:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967308030592:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147144.509318:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14707 00000100:00100000:0.0:1746147144.509318:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308030720:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147144.509324:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308030848:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147144.509340:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14708 00000100:00100000:3.0:1746147144.509364:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967308030976:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147144.509402:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967308030592:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 86us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.509402:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308030848:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 77us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.509402:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308030720:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 83us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.509406:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14706 00000100:00100000:2.0:1746147144.509409:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14705 00000100:00100000:1.0:1746147144.509416:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14707 00000100:00100000:3.0:1746147144.509439:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308030976:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 89us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.509445:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14708 00000100:00100000:0.0:1746147144.510292:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.510366:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.510404:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.510426:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308031104 00000100:00100000:0.0:1746147144.510430:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308031104 00000100:00100000:0.0:1746147144.510460:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308031232 00000100:00100000:0.0:1746147144.510462:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308031232 00000100:00100000:0.0:1746147144.510473:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308031360 00000100:00100000:0.0:1746147144.510474:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308031360 00000100:00100000:0.0:1746147144.510487:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14709 00000100:00100000:0.0:1746147144.510492:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308031104:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147144.510539:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308031104:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 46us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.510544:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14709 00000100:00100000:0.0:1746147144.510555:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14710 00000100:00100000:0.0:1746147144.510559:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308031232:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147144.510589:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308031232:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.510594:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14711 00000100:00100000:1.0:1746147144.510600:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:32375:x1830967308031360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147144.510609:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.510623:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780bd expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.510642:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.510644:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.510650:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.510668:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.510676:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05200, rc 0) 00000100:00100000:1.0:1746147144.510692:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:32375:x1830967308031360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.510727:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14710 00000100:00100000:1.0:1746147144.511064:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14711 00000100:00100000:0.0:1746147144.515062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.515147:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.515347:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308031744 00000100:00100000:1.0:1746147144.515355:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308031744 00000100:00100000:3.0:1746147144.515413:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308031616 00000100:00100000:3.0:1746147144.515417:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308031616 00002000:00100000:3.0:1746147144.515449:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a897f800 x1830967308031616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.515458:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f800 with x1830967308031616 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.515462:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897f800 00000100:00100000:3.0:1746147144.515477:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3552 00000100:00100000:3.0:1746147144.515484:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308031616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147144.515831:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14712 00000100:00100000:1.0:1746147144.515838:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308031744:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147144.515986:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147144.515989:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.515991:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147144.515993:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.515994:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147144.516055:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308031744:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 217us (907us total) trans 21474841496 rc 0/0 00000100:00100000:1.0:1746147144.516060:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14712 00000100:00100000:2.0:1746147144.517584:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.518424:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308032000 00000100:00100000:3.0:1746147144.518431:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308032000 00000100:00100000:3.0:1746147144.518513:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15303 00000100:00100000:3.0:1746147144.518520:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32379:x1830967308032000:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.518555:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.518581:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250567ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780c4 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.518681:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518693:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518702:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518726:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518732:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518736:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518851:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518859:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.518865:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147144.518873:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.519603:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519611:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519617:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519652:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.519656:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519661:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519671:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.519868:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147144.519873:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519879:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056814 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519898:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519916:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519921:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519925:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519928:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.519930:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519935:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519941:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147144.519942:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.519944:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519948:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x3139939425056806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519954:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519958:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519962:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519965:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.519967:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519970:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519975:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1900) 00010000:00010000:3.0:1746147144.519976:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.519978:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.519981:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32a00/0x313993942505680d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.520030:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250567ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780c4 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.520037:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250567ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780c4 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.520043:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:3.0:1746147144.520104:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32379:x1830967308032000:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1571us (2508us total) trans 8589935995 rc 301/301 00000100:00100000:3.0:1746147144.520111:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15303 00000100:00100000:2.0:1746147144.520333:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.520433:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308032128 00000100:00100000:0.0:1746147144.520437:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308032128 00000100:00100000:0.0:1746147144.520478:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14713 00000100:00100000:0.0:1746147144.520485:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308032128:12345-192.168.204.25@tcp:22:lfs.0 00000100:00100000:3.0:1746147144.520617:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308031616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5132us (5561us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.520625:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3552 00002000:00100000:3.0:1746147144.520632:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8800a897f800 x1830967308031616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.520641:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f800 with x1830967308031616 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.520645:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a897f800 00002000:00010000:0.0:1746147144.520897:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147144.520900:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147144.520914:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147144.520916:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147144.520917:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147144.520936:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308032128:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 452us (604us total) trans 17179874229 rc 0/0 00000100:00100000:0.0:1746147144.520942:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14713 00000100:00100000:0.0:1746147144.532475:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.532781:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.532942:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308032384 00000100:00100000:3.0:1746147144.532953:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308032384 00000100:00100000:0.0:1746147144.533009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.533024:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308032640 00000100:00100000:3.0:1746147144.533027:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308032640 00000100:00100000:0.0:1746147144.533038:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308032896 00000100:00100000:0.0:1746147144.533044:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308032896 00000100:00100000:3.0:1746147144.533051:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3553 00000100:00100000:3.0:1746147144.533059:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308032384:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:2.0:1746147144.533073:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3554 00000100:00100000:2.0:1746147144.533081:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308032640:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147144.533109:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.533119:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.533122:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.533124:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.533129:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.533132:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.533133:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.533136:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.533140:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.533144:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.533346:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3555 00000100:00100000:0.0:1746147144.533355:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308032896:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147144.533383:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.533395:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.533396:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.533401:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.533411:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.534525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.535178:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308033024 00000100:00100000:0.0:1746147144.535195:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308033024 00000100:00100000:0.0:1746147144.535258:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14714 00000100:00100000:0.0:1746147144.535267:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:32375:x1830967308033024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.535287:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.535372:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780cb expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.535406:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.535408:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.535416:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 18 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.535431:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 18 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.535443:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e400, rc 0) 00000100:00100000:0.0:1746147144.535713:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:32375:x1830967308033024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 446us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.535721:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14714 00000100:00100000:0.0:1746147144.537318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.537352:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.537367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.537400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.537417:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308033280 00000100:00100000:0.0:1746147144.537423:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308033280 00000100:00100000:0.0:1746147144.537460:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308033536 00000100:00100000:0.0:1746147144.537462:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308033536 00000100:00100000:0.0:1746147144.537471:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308033792 00000100:00100000:0.0:1746147144.537472:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308033792 00000100:00100000:0.0:1746147144.537482:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308034048 00000100:00100000:0.0:1746147144.537484:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308034048 00000100:00100000:0.0:1746147144.537495:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3556 00000100:00100000:0.0:1746147144.537501:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308033280:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147144.537531:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.537543:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.537545:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.537549:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.537560:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.538349:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3557 00000100:00100000:1.0:1746147144.538358:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967308033536:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147144.538375:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.538387:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.538389:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.538391:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.538399:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.538746:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3558 00000100:00100000:0.0:1746147144.538752:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308033792:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147144.538768:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.538776:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.538777:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.538779:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.538786:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.539600:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3559 00000100:00100000:2.0:1746147144.539607:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967308034048:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147144.539621:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.539627:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.539628:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.539631:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.539639:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.541801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.542432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147144.542559:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.542571:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.542583:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.542590:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147144.542594:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.542600:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.542617:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.542623:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425056822 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.542680:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967308032384:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 9622us (10213us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746147144.542688:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3553 00000100:00100000:3.0:1746147144.542718:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308034304 00000100:00100000:3.0:1746147144.542724:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308034304 00000100:00100000:3.0:1746147144.542762:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3560 00000100:00100000:3.0:1746147144.542767:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967308034304:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147144.542791:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.542800:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.542802:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.542806:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.542814:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.543422:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308034560 00000100:00100000:3.0:1746147144.543426:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308034560 00000100:00100000:3.0:1746147144.543450:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15304 00000100:00100000:3.0:1746147144.543455:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32377:x1830967308034560:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.543473:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.543476:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147144.543491:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ea2a00/0x313993942505678f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78077 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.543517:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.543521:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147144.543531:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425056861 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780d2 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.543566:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.543576:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.543583:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.543588:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.543611:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.543623:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 7 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.543634:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310700672:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.543695:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.543701:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 7 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.543708:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310700800:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.543724:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.544538:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.544637:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308034688 00000100:00100000:3.0:1746147144.544641:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308034688 00000100:00100000:3.0:1746147144.544681:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15305 00000100:00100000:3.0:1746147144.544688:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:32375:x1830967308034688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.544696:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.544704:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780d9 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544733:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.544739:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544750:0:16099:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.544760:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544769:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.544771:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147144.544773:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.544778:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95600, rc 0) 00000100:00100000:3.0:1746147144.544800:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:32375:x1830967308034688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 113us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.544805:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15305 00010000:00010000:3.0:1746147144.544897:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544921:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544927:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544933:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095053800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147144.544936:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544943:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544954:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.544959:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425056829 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.544989:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967308032640:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 11909us (12213us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.544995:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3554 00000100:00100000:0.0:1746147144.548121:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.548184:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308034816 00000100:00100000:1.0:1746147144.548192:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308034816 00000100:00100000:3.0:1746147144.548210:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310700672:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.548218:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099013480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310700800:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.548240:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.548252:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 8 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.548278:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6455 00000100:00100000:1.0:1746147144.548285:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308034816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.548298:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.548303:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 8 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.548311:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 8 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.548328:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32e00/0x3139939425056796 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7807e expref: 8 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.548716:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.548774:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308034944 00000100:00100000:2.0:1746147144.548778:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308034944 00010000:00010000:2.0:1746147144.548793:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 9 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.548825:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6456 00000100:00100000:2.0:1746147144.548830:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308034944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.548840:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.548844:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 9 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.548852:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 9 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.548865:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99000/0x31399394250567a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78085 expref: 9 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.548893:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.548897:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.548918:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.548925:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147144.548933:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.548957:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.548989:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308034944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 159us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.548995:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6456 00010000:00010000:3.0:1746147144.549116:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.549122:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00000040:00080000:3.0:1746147144.549391:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].596, 88 off60512 00000004:00080000:3.0:1746147144.549397:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539307528ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549424:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].532, 88 off54872 00000004:00080000:3.0:1746147144.549427:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539337556ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549451:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].533, 88 off54960 00000004:00080000:3.0:1746147144.549454:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539364279ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549462:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].597, 88 off60600 00000004:00080000:3.0:1746147144.549465:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539375369ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549472:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].598, 88 off60688 00000004:00080000:3.0:1746147144.549476:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539386383ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549773:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].534, 88 off55048 00000004:00080000:3.0:1746147144.549778:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539688438ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549792:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].535, 88 off55136 00000004:00080000:3.0:1746147144.549794:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539704483ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549801:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].536, 88 off55224 00000004:00080000:3.0:1746147144.549803:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539713350ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549810:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].599, 88 off60776 00000004:00080000:3.0:1746147144.549815:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539725330ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549824:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].537, 88 off55312 00000004:00080000:3.0:1746147144.549826:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539736720ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549832:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].600, 88 off60864 00000004:00080000:3.0:1746147144.549835:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539745501ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549841:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].538, 88 off55400 00000004:00080000:3.0:1746147144.549843:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539753960ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147144.549851:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].601, 88 off60952 00000004:00080000:3.0:1746147144.549853:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539763531ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549860:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].602, 88 off61040 00000004:00080000:3.0:1746147144.549863:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539773873ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549870:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].603, 88 off61128 00000004:00080000:3.0:1746147144.549872:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539782756ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549878:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].604, 88 off61216 00000004:00080000:3.0:1746147144.549881:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682539791266ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147144.549887:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].539, 88 off55488 00000004:00080000:3.0:1746147144.549889:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 682539799751ns, next at 554081490131ns, rc = 0 00010000:00010000:1.0:1746147144.549947:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.549954:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.549961:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.549985:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:2001:x1830967308034816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1701us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.549990:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6455 00010000:00010000:1.0:1746147144.550682:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.550691:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.550698:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.550702:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147144.550706:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.550713:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.550725:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.550730:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425056830 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.550775:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308032896:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17421us (17766us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147144.550784:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3555 00010000:00010000:0.0:1746147144.554844:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.554859:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.554867:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.554873:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03ca00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147144.554877:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.554884:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.554914:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.554920:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03ca00/0x313993942505683e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.555001:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308033280:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17495us (18009us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147144.555011:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3556 00010000:00010000:0.0:1746147144.556157:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.556167:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.556174:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.556184:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fca00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147144.556187:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.556192:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.556203:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.556208:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fca00/0x313993942505684c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746147144.556239:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935996 is committed 00000004:00080000:2.0:1746147144.556246:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 534 committed 00000100:00100000:0.0:1746147144.556256:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308033792:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17502us (18886us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147144.556263:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3558 00000004:00080000:2.0:1746147144.556351:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 596 committed 00000004:00080000:2.0:1746147144.556925:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 595 committed 00000100:00100000:1.0:1746147144.557009:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310700928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.557049:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.557065:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310701184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.557076:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310701440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.557111:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.557120:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310701312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.557131:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310701696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.557137:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.557150:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310701824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.557154:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.557170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.557192:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310700928 00000100:00100000:1.0:1746147144.557198:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310700928 00000100:00100000:1.0:1746147144.557223:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701184 00000100:00100000:1.0:1746147144.557225:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701184 00000100:00100000:1.0:1746147144.557234:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701312 00000100:00100000:1.0:1746147144.557236:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701312 00000100:00100000:1.0:1746147144.557245:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701696 00000100:00100000:1.0:1746147144.557246:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701696 00000100:00100000:1.0:1746147144.557255:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701824 00000100:00100000:1.0:1746147144.557256:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701824 00000100:00100000:1.0:1746147144.557268:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14715 00000100:00100000:1.0:1746147144.557273:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310700928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147144.557321:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14716 00000100:00100000:0.0:1746147144.557328:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967310701184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.557383:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14717 00000100:00100000:1.0:1746147144.557388:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3765:x1830967310701312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147144.557399:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147144.557403:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147143 -> 1746147143 00002000:00010000:0.0:1746147144.557405:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147143 -> 1746147143 00002000:00010000:0.0:1746147144.557407:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147143 -> 1746147143 00002000:00010000:0.0:1746147144.557409:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147144.557438:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967310701184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (332us total) trans 17179874231 rc 0/0 00000100:00100000:1.0:1746147144.557441:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3765:x1830967310701312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (302us total) trans 17179874232 rc 0/0 00000100:00100000:1.0:1746147144.557446:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14717 00000004:00080000:2.0:1746147144.557497:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 594 committed 00000004:00080000:2.0:1746147144.557499:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 593 committed 00000004:00080000:2.0:1746147144.557501:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 533 committed 00000004:00080000:2.0:1746147144.557503:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 592 committed 00000004:00080000:2.0:1746147144.557504:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 532 committed 00000004:00080000:2.0:1746147144.557506:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 591 committed 00000004:00080000:2.0:1746147144.557507:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 531 committed 00000004:00080000:2.0:1746147144.557509:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 530 committed 00000004:00080000:2.0:1746147144.557511:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 529 committed 00000004:00080000:2.0:1746147144.557512:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 590 committed 00000004:00080000:2.0:1746147144.557513:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 589 committed 00000004:00080000:2.0:1746147144.557515:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 528 committed 00000004:00080000:2.0:1746147144.557516:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 527 committed 00000004:00080000:2.0:1746147144.557520:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 588 committed 00000001:00080000:2.0:1746147144.557525:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935995 is committed 00000100:00100000:2.0:1746147144.557542:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310701056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.557565:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.557580:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310701568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.557593:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.557599:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310702080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.557614:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.557621:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310702592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.557632:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.557641:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147144.557646:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310701952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.557659:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.557665:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310702464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147144.557676:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147144.557692:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701056 00000100:00100000:2.0:1746147144.557695:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701056 00000100:00100000:0.0:1746147144.557969:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14716 00000100:00100000:1.0:1746147144.557975:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14718 00000100:00100000:0.0:1746147144.557981:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701568 00000100:00100000:1.0:1746147144.557982:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3764:x1830967310701696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147144.557984:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701568 00000100:00100000:0.0:1746147144.557994:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702080 00000100:00100000:0.0:1746147144.557996:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702080 00000100:00100000:0.0:1746147144.558003:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702592 00000100:00100000:0.0:1746147144.558005:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702592 00000100:00100000:0.0:1746147144.558010:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701952 00000100:00100000:0.0:1746147144.558012:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701952 00000100:00100000:0.0:1746147144.558018:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702464 00000100:00100000:0.0:1746147144.558019:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702464 00000100:00100000:0.0:1746147144.558026:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14719 00002000:00010000:1.0:1746147144.558028:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147144.558030:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00000100:00100000:0.0:1746147144.558031:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967310701824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147144.558032:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147144.558034:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.558036:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:1.0:1746147144.558054:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967310701696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (900us total) trans 17179874233 rc 0/0 00000100:00100000:1.0:1746147144.558058:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14718 00000100:00100000:1.0:1746147144.558068:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14720 00000100:00100000:1.0:1746147144.558072:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310701568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147144.558074:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147144.558077:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147144.558079:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147144.558080:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147144.558082:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147144.558120:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967310701824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (948us total) trans 17179874234 rc 0/0 00000100:00100000:0.0:1746147144.558125:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14719 00000100:00100000:0.0:1746147144.558135:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14721 00000100:00100000:0.0:1746147144.558139:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3767:x1830967310702080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147144.558142:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310701568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (548us total) trans 17179874235 rc 0/0 00000100:00100000:1.0:1746147144.558147:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14720 00000100:00100000:1.0:1746147144.558158:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14722 00000100:00100000:1.0:1746147144.558162:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3767:x1830967310702592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147144.558193:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147144.558195:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00002000:00010000:0.0:1746147144.558197:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.558198:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147144.558198:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:0.0:1746147144.558201:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147144.558218:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3767:x1830967310702080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (603us total) trans 21474841497 rc 0/0 00000100:00100000:0.0:1746147144.558223:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14721 00000100:00100000:0.0:1746147144.558232:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14723 00000100:00100000:0.0:1746147144.558236:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3767:x1830967310701952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147144.558273:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147144.558275:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147143 -> 1746147143 00002000:00010000:0.0:1746147144.558277:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147142 -> 1746147142 00002000:00010000:0.0:1746147144.558279:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147142 -> 1746147142 00002000:00010000:0.0:1746147144.558280:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147144.558297:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3767:x1830967310701952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (637us total) trans 21474841499 rc 0/0 00000100:00100000:0.0:1746147144.558301:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14723 00000100:00100000:0.0:1746147144.558310:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14724 00000100:00100000:0.0:1746147144.558314:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3767:x1830967310702464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147144.558362:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3767:x1830967310702464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (684us total) trans 21474841500 rc 0/0 00000100:00100000:0.0:1746147144.558368:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14724 00002000:00010000:1.0:1746147144.558670:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.558672:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147144.558673:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147144.558675:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:1.0:1746147144.558693:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3767:x1830967310702592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 531us (1060us total) trans 21474841498 rc 0/0 00000100:00100000:1.0:1746147144.558698:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14722 00000100:00100000:1.0:1746147144.558713:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147144.558727:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.558734:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702336 00000100:00100000:1.0:1746147144.558737:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.558738:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702336 00000100:00100000:1.0:1746147144.558746:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.558754:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702848 00000100:00100000:3.0:1746147144.558756:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702848 00000004:00080000:1.0:1746147144.558764:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095234a80/2, rc 0, transno 17179874232 00000100:00100000:3.0:1746147144.558765:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14725 00000100:00100000:1.0:1746147144.558768:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310701312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.558770:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967310702336:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147144.558774:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d94a80/2, rc 0, transno 17179874234 00000100:00100000:1.0:1746147144.558777:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310701824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147144.558783:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147144.558787:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147144.558799:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147144.558806:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702720:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147144.558813:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147144.558815:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147144.558816:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746147144.558817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147144.558818:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147144.558821:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147144.558829:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.558844:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967310702336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (115us total) trans 21474841501 rc 0/0 00000100:00100000:3.0:1746147144.558849:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14725 00000100:00100000:3.0:1746147144.558857:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702208 00000100:00100000:3.0:1746147144.558860:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702208 00000100:00100000:3.0:1746147144.558867:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310702720 00000100:00100000:3.0:1746147144.558869:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310702720 00000100:00100000:3.0:1746147144.558875:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310701440 00000100:00100000:3.0:1746147144.558876:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310701440 00000100:00100000:3.0:1746147144.558883:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14726 00000100:00100000:3.0:1746147144.558887:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3765:x1830967310702848:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147144.558895:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093144700/2, rc 0, transno 21474841501 00000100:00100000:1.0:1746147144.558907:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702336:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147144.558929:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147144.558931:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147143 -> 1746147143 00002000:00010000:1.0:1746147144.558932:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147143 -> 1746147143 00002000:00010000:1.0:1746147144.558934:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147143 -> 1746147143 00002000:00010000:1.0:1746147144.558935:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147144.558957:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967310700928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1684us (1908us total) trans 17179874230 rc 0/0 00000100:00100000:3.0:1746147144.558958:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3765:x1830967310702848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (209us total) trans 21474841502 rc 0/0 00000100:00100000:1.0:1746147144.558962:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14715 00000100:00100000:3.0:1746147144.558964:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14726 00000100:00100000:1.0:1746147144.558971:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14727 00000100:00100000:3.0:1746147144.558975:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14728 00000100:00100000:1.0:1746147144.558976:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3765:x1830967310702208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.558979:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3765:x1830967310702720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147144.559010:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147144.559012:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.559014:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.559015:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.559017:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147144.559032:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3765:x1830967310702720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (213us total) trans 21474841504 rc 0/0 00000100:00100000:1.0:1746147144.559033:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3765:x1830967310702208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (232us total) trans 21474841503 rc 0/0 00000100:00100000:3.0:1746147144.559037:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14728 00000100:00100000:1.0:1746147144.559040:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14727 00000100:00100000:3.0:1746147144.559046:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14729 00000100:00100000:3.0:1746147144.559050:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3766:x1830967310701440:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147144.559060:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099013480/2, rc 0, transno 17179874230 00000100:00100000:1.0:1746147144.559064:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310700928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147144.559074:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74380/2, rc 0, transno 21474841503 00000100:00100000:1.0:1746147144.559076:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147144.559082:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093146300/2, rc 0, transno 21474841504 00000100:00100000:1.0:1746147144.559084:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702720:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147144.559085:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:3.0:1746147144.559087:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:3.0:1746147144.559103:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147144.559104:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746147144.559106:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000004:00080000:1.0:1746147144.559107:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093144e00/2, rc 0, transno 21474841502 00000100:00100000:1.0:1746147144.559109:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310702848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.559127:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967310701440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (296us total) trans 17179874236 rc 0/0 00000100:00100000:3.0:1746147144.559131:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14729 00000004:00080000:1.0:1746147144.559135:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095234380/2, rc 0, transno 17179874236 00000100:00100000:1.0:1746147144.559137:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310701440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147144.559254:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099011880/2, rc 0, transno 17179874231 00000100:00100000:3.0:1746147144.559258:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310701184:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147144.559265:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d94700/2, rc 0, transno 17179874233 00000100:00100000:3.0:1746147144.559267:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310701696:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147144.559311:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.559321:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.559324:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147144.559327:0:9138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.559335:0:9138:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.559342:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.559362:0:9138:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.559370:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310702976:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147144.559429:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f3fea80 going to sleep for 11 seconds 00000004:00080000:3.0:1746147144.559463:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74a80/2, rc 0, transno 21474841499 00000100:00100000:3.0:1746147144.559467:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310701952:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.559474:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093145180/2, rc 0, transno 21474841500 00000100:00100000:3.0:1746147144.559477:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310702464:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.559483:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d94380/2, rc 0, transno 17179874235 00000100:00100000:3.0:1746147144.559486:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310701568:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147144.559491:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77480/2, rc 0, transno 21474841497 00000100:00100000:3.0:1746147144.559493:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310702080:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147144.559500:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093147800/2, rc 0, transno 21474841498 00000100:00100000:3.0:1746147144.559502:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310702592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147144.559533:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147144.559540:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310703104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.559558:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147144.559575:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310703104 00000100:00100000:3.0:1746147144.559577:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310703104 00000100:00100000:3.0:1746147144.559592:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14730 00000100:00100000:3.0:1746147144.559597:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310703104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147144.559651:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310703104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (92us total) trans 17179874237 rc 0/0 00000100:00100000:3.0:1746147144.559656:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14730 00000004:00080000:3.0:1746147144.559674:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394000/2, rc 0, transno 17179874237 00000100:00100000:3.0:1746147144.559677:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310703104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147144.559803:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14731 00000100:00100000:2.0:1746147144.559810:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967310701056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147144.559855:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147144.559858:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00002000:00010000:2.0:1746147144.559859:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:2.0:1746147144.559861:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:2.0:1746147144.559863:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147144.559886:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967310701056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (2320us total) trans 17179874238 rc 0/0 00000100:00100000:2.0:1746147144.559891:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14731 00000004:00080000:3.0:1746147144.560058:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099010700/2, rc 0, transno 17179874238 00000100:00100000:3.0:1746147144.560061:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310701056:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147144.563150:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.563165:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.563172:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.563178:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095052a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147144.563181:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.563188:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.563204:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.563210:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425056853 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.563279:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308034048:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23669us (25874us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.563287:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3559 00000100:00100000:1.0:1746147144.564957:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.565039:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310702976:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147144.565069:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95c00/0x3139939425056861 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 10 pid: 9138 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147144.565102:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.565131:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94200, rc 0) 00000100:00100000:3.0:1746147144.565435:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32377:x1830967308034560:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 21977us (23001us total) trans 8589935996 rc 0/0 00000100:00100000:3.0:1746147144.565443:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15304 00000100:00100000:0.0:1746147144.565444:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308035072 00000100:00100000:0.0:1746147144.565452:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308035072 00000100:00100000:0.0:1746147144.565525:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5488 00000100:00100000:0.0:1746147144.565532:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32375:x1830967308035072:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147144.565594:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32375:x1830967308035072:12345-192.168.204.25@tcp:49:cat.0 Request processed in 63us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.565603:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5488 00010000:00010000:1.0:1746147144.565701:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.565710:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.565716:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.565721:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9a0e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147144.565724:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.565730:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.565744:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.565749:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x3139939425056845 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.565889:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308033536:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 27532us (28535us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147144.565897:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3557 00010000:00010000:3.0:1746147144.569302:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.569318:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.569325:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.569331:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990c7800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147144.569334:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.569341:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.569356:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.569362:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505685a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.569454:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308034304:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 26682us (27657us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.569464:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3560 00000100:00100000:0.0:1746147144.573761:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.574369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.574454:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308035328 00000100:00100000:3.0:1746147144.574462:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308035328 00000100:00100000:3.0:1746147144.574514:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15306 00000100:00100000:3.0:1746147144.574522:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:32371:x1830967308035328:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:3.0:1746147144.574604:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.574624:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.574635:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00010000:3.0:1746147144.574715:0:9138:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093145500 reply state ffff8800991ec000 transno 8589935997 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.574723:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147144.574729:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.574732:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746147144.574735:0:9138:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147144.574794:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32371:x1830967308035328:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 273us (1042us total) trans 8589935997 rc 0/0 00000100:00100000:3.0:1746147144.574799:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15306 00000100:00100000:1.0:1746147144.574940:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308035456 00000100:00100000:1.0:1746147144.574944:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308035456 00000100:00100000:1.0:1746147144.574966:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14732 00000100:00100000:1.0:1746147144.574971:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:32377:x1830967308035456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147144.574980:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.574990:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780e0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.575019:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.575027:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.575033:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.575035:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.575037:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3067904->3145727] (req 3067904->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.575059:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.575069:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 12 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.575079:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310703232:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147144.575360:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.575368:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 19 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.575376:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310703360:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147144.575408:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.577223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.577271:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308035712 00000100:00100000:3.0:1746147144.577285:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308035712 00002000:00100000:3.0:1746147144.577314:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880094186d80 x1830967308035712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.577324:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967308035712 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.577328:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186d80 00000100:00100000:3.0:1746147144.577355:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3561 00000100:00100000:3.0:1746147144.577361:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308035712:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147144.578672:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.578702:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310703232:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.578761:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308035840 00000100:00100000:2.0:1746147144.578766:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308035840 00000100:00100000:2.0:1746147144.578792:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15307 00000100:00100000:2.0:1746147144.578798:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32371:x1830967308035840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147144.578811:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.578827:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095052a00/0x3139939425056884 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780e7 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.578865:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095052a00/0x3139939425056884 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e7 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.578882:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095052a00/0x3139939425056884 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e7 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.578896:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.578898:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147144.578909:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052a00, rc 0) 00000100:00100000:2.0:1746147144.578930:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32371:x1830967308035840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 132us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.578935:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15307 00000100:00100000:0.0:1746147144.578992:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310703360:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147144.579010:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3067904->3145727] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.579020:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6c00, rc 0) 00000100:00100000:0.0:1746147144.579048:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:32377:x1830967308035456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4077us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.579054:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14732 00000100:00100000:1.0:1746147144.580745:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.580772:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.581146:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308035968 00000100:00100000:3.0:1746147144.581154:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308035968 00010000:00010000:3.0:1746147144.581182:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 13 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.581211:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036096 00000100:00100000:3.0:1746147144.581213:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036096 00010000:00010000:3.0:1746147144.581223:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 21 pid: 17600 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.581230:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6457 00000100:00100000:2.0:1746147144.581238:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308035968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147144.581248:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6458 00010000:00010000:2.0:1746147144.581248:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147144.581253:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308036096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147144.581261:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.581265:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 13 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.581269:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 21 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.581278:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 21 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.581300:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x313993942505677a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78069 expref: 21 pid: 17600 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746147144.581327:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.581357:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308036096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.581363:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6458 00010000:00010000:2.0:1746147144.581463:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 13 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.581476:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x31399394250567ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a8 expref: 13 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.581844:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.581846:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.581852:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.581860:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.581885:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.581895:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310703488:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147144.581948:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135598e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.587448:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310703488:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.587467:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.587506:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308035968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6268us (6764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.587517:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6457 00000100:00100000:3.0:1746147144.587657:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308035712:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10295us (10436us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.587664:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3561 00002000:00100000:3.0:1746147144.587673:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880094186d80 x1830967308035712/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.587682:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967308035712 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.587686:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186d80 00000100:00100000:0.0:1746147144.588420:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.588582:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.588604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.588682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.588759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.588796:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036224 00000100:00100000:2.0:1746147144.588804:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036224 00000100:00100000:3.0:1746147144.588926:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036480 00000100:00100000:1.0:1746147144.588927:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036736 00000100:00100000:3.0:1746147144.588929:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036480 00000100:00100000:1.0:1746147144.588932:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036736 00000100:00100000:3.0:1746147144.588943:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036352 00000100:00100000:3.0:1746147144.588945:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036352 00000100:00100000:3.0:1746147144.588954:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036608 00000100:00100000:3.0:1746147144.588955:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036608 00000100:00100000:1.0:1746147144.588958:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14733 00000100:00100000:1.0:1746147144.588964:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308036224:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147144.588966:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14734 00000100:00100000:3.0:1746147144.588971:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967308036480:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147144.589081:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147144.589081:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147144.589084:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.589084:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147143 -> 1746147144 00002000:00010000:3.0:1746147144.589086:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.589086:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147143 -> 1746147144 00002000:00010000:3.0:1746147144.589107:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:3.0:1746147144.589108:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746147144.589108:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147143 -> 1746147144 00002000:00010000:1.0:1746147144.589110:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:3.0:1746147144.589137:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308036480:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 166us (554us total) trans 21474841505 rc 0/0 00000100:00100000:1.0:1746147144.589137:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308036224:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 173us (719us total) trans 17179874239 rc 0/0 00000100:00100000:3.0:1746147144.589143:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14734 00000100:00100000:1.0:1746147144.589146:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14733 00000100:00100000:3.0:1746147144.589153:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14735 00000100:00100000:3.0:1746147144.589158:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308036736:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147144.589158:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14736 00000100:00100000:1.0:1746147144.589163:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2002:x1830967308036352:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147144.589194:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:3.0:1746147144.589197:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147143 -> 1746147144 00002000:00010000:3.0:1746147144.589198:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147143 -> 1746147144 00002000:00010000:3.0:1746147144.589200:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147143 -> 1746147144 00002000:00010000:3.0:1746147144.589201:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00002000:00010000:1.0:1746147144.589204:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147144.589207:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147143 -> 1746147144 00002000:00010000:1.0:1746147144.589208:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147142 -> 1746147144 00002000:00010000:1.0:1746147144.589210:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147142 -> 1746147144 00002000:00010000:1.0:1746147144.589211:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147144.589217:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308036736:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 59us (612us total) trans 17179874240 rc 0/0 00000100:00100000:3.0:1746147144.589221:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14735 00000100:00100000:1.0:1746147144.589228:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308036352:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 66us (545us total) trans 21474841506 rc 0/0 00000100:00100000:3.0:1746147144.589231:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14737 00000100:00100000:3.0:1746147144.589234:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308036608:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147144.589236:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14736 00002000:00010000:3.0:1746147144.589269:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147144.589271:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00000100:00100000:0.0:1746147144.589514:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.589561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.589591:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308036864 00000100:00100000:1.0:1746147144.589595:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308036864 00000100:00100000:1.0:1746147144.589613:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14738 00000100:00100000:1.0:1746147144.589617:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308036864:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147144.589658:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147144.589661:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.589663:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.589664:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:1.0:1746147144.589666:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147144.589685:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308036864:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 67us (171us total) trans 21474841507 rc 0/0 00000100:00100000:1.0:1746147144.589690:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14738 00000100:00100000:2.0:1746147144.589828:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308037120 00000100:00100000:2.0:1746147144.589831:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308037120 00002000:00100000:2.0:1746147144.589850:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3067904->3071999) req@ffff8800a5576a00 x1830967308037120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.589858:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576a00 with x1830967308037120 ext(3067904->3071999) 00002000:00010000:2.0:1746147144.589863:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576a00 00000100:00100000:2.0:1746147144.589886:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3562 00000100:00100000:2.0:1746147144.589891:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308037120:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147144.589993:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308037120:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 101us (430us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147144.589998:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3562 00002000:00100000:2.0:1746147144.590006:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8f:0x0] (3067904->3071999) req@ffff8800a5576a00 x1830967308037120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.590012:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576a00 with x1830967308037120 ext(3067904->3071999) 00002000:00010000:2.0:1746147144.590015:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576a00 00002000:00010000:3.0:1746147144.590049:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147144 -> 1746147144 00002000:00010000:3.0:1746147144.590051:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147144 -> 1746147144 00002000:00010000:3.0:1746147144.590053:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147144.590078:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308036608:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 837us (1313us total) trans 17179874241 rc 0/0 00000100:00100000:3.0:1746147144.590084:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14737 00000100:00100000:0.0:1746147144.596594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.596645:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.596658:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308037376 00000100:00100000:1.0:1746147144.596666:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308037376 00000100:00100000:1.0:1746147144.596709:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5489 00000100:00100000:1.0:1746147144.596716:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32371:x1830967308037376:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1746147144.596726:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308037504 00000100:00100000:3.0:1746147144.596730:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308037504 00000100:00100000:3.0:1746147144.596833:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14739 00000100:00100000:3.0:1746147144.596840:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:32377:x1830967308037504:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.597038:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.597053:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780ee expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.597074:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.597082:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.597245:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.597248:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.597252:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->2572287] (req 2097152->2572287) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.597419:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.597429:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 14 pid: 9585 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.597439:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310703616:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.597525:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.597533:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746147144.597540:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310703744:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.597555:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.597606:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32371:x1830967308037376:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 890us (1019us total) trans 8589935998 rc 0/0 00000100:00100000:1.0:1746147144.597612:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5489 00000100:00100000:0.0:1746147144.603847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.604559:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310703616:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.604570:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310703744:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.604598:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->2572287] (req 2097152->2572287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.604614:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1800, rc 0) 00000100:00100000:3.0:1746147144.604671:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:32377:x1830967308037504:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7831us (8024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.604679:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14739 00000100:00100000:0.0:1746147144.605659:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.605727:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308037888 00000100:00100000:1.0:1746147144.605734:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308037888 00000100:00100000:1.0:1746147144.605763:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5490 00000100:00100000:1.0:1746147144.605770:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32371:x1830967308037888:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147144.605851:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308037632 00000100:00100000:2.0:1746147144.605856:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308037632 00010000:00010000:2.0:1746147144.605875:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 15 pid: 9585 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.605913:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6459 00000100:00100000:2.0:1746147144.605918:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308037632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.605927:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147144.605928:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32371:x1830967308037888:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 158us (270us total) trans 8589935999 rc 0/0 00000100:00100000:1.0:1746147144.605934:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5490 00010000:00010000:2.0:1746147144.605940:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 15 pid: 9585 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.605950:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 15 pid: 9585 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.605966:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33a00/0x31399394250567c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780af expref: 15 pid: 9585 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.605979:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.606198:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308037632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 278us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.606204:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6459 00000100:00100000:0.0:1746147144.612684:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.612734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.612795:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308038144 00000100:00100000:1.0:1746147144.612804:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308038144 00002000:00100000:1.0:1746147144.612842:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8800a5575880 x1830967308038144/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147144.612843:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308038400 00000100:00100000:2.0:1746147144.612847:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308038400 00002000:00100000:1.0:1746147144.612852:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575880 with x1830967308038144 ext(2097152->4194303) 00002000:00010000:1.0:1746147144.612856:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5575880 00002000:00100000:2.0:1746147144.612864:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800a5577100 x1830967308038400/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.612871:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5577100 with x1830967308038400 ext(2097152->4194303) 00010000:00010000:2.0:1746147144.612878:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.612891:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3563 00010000:00010000:2.0:1746147144.612895:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.612909:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308038144:12345-192.168.204.25@tcp:3:cat.0 00002000:00010000:2.0:1746147144.612911:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5577100 00000100:00100000:2.0:1746147144.612923:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1121 00000100:00100000:2.0:1746147144.612928:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308038400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.620953:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.621023:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308038528 00000100:00100000:3.0:1746147144.621032:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308038528 00000100:00100000:3.0:1746147144.621305:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15308 00000100:00100000:3.0:1746147144.621317:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32379:x1830967308038528:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.621341:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.621356:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780f5 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.621403:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.621415:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.621436:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.621438:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147144.621441:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94c00, rc 0) 00000100:00100000:3.0:1746147144.621877:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32379:x1830967308038528:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 561us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.621883:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15308 00000100:00100000:1.0:1746147144.623875:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308038144:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10968us (11192us total) trans 0 rc 2019328/2019328 00000100:00100000:1.0:1746147144.623886:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3563 00002000:00100000:1.0:1746147144.623896:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8800a5575880 x1830967308038144/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2019328/2019328 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147144.623917:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575880 with x1830967308038144 ext(2097152->4194303) 00002000:00010000:1.0:1746147144.623922:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5575880 00000100:00100000:2.0:1746147144.630007:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308038400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17068us (17262us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147144.630019:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1121 00002000:00100000:2.0:1746147144.630030:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800a5577100 x1830967308038400/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.630038:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5577100 with x1830967308038400 ext(2097152->4194303) 00010000:00010000:2.0:1746147144.630047:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.630061:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 29 pid: 9584 timeout: 782 lvb_type: 1 00002000:00010000:2.0:1746147144.630068:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5577100 00000100:00100000:0.0:1746147144.633626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.633991:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308038656 00000100:00100000:3.0:1746147144.633999:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308038656 00000100:00100000:3.0:1746147144.634038:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14740 00000100:00100000:3.0:1746147144.634045:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:32375:x1830967308038656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.634061:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.634076:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e780fc expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.634121:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147144.634126:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->2572287] (req 2097152->2572287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.634132:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.634135:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.634165:0:1853:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->2572287] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.634178:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.634188:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94a00, rc 0) 00000100:00100000:3.0:1746147144.634240:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:32375:x1830967308038656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 194us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.634245:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14740 00000100:00100000:0.0:1746147144.636005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147144.636109:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147144.637139:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308038784 00000100:00100000:2.0:1746147144.637148:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308038784 00000100:00100000:2.0:1746147144.637200:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14741 00000100:00100000:2.0:1746147144.637208:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32379:x1830967308038784:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147144.637225:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.637239:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78103 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.637265:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.637273:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.637278:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.637280:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.637283:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [114688->962559] (req 114688->962559) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.637308:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.637317:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 14 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.637327:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310704000:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.637421:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.637429:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 17 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.637441:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310704128:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.637460:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.641405:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.641502:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308038912 00000100:00100000:2.0:1746147144.641514:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308038912 00010000:00010000:2.0:1746147144.641557:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 30 pid: 9584 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.641606:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6460 00000100:00100000:2.0:1746147144.641617:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308038912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.641632:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.641650:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 30 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.641660:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 30 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.641680:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425056781 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78070 expref: 30 pid: 9584 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.641707:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.641713:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.641719:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.641725:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.641757:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.641766:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.641895:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310704256:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147144.642062:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310704128:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.642365:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.644182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.644235:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.644236:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.644271:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308039424 00000100:00100000:1.0:1746147144.644279:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308039424 00000100:00100000:1.0:1746147144.644339:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15309 00000100:00100000:1.0:1746147144.644348:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32383:x1830967308039424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147144.644376:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.644395:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x31399394250568a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7810a expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.644477:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644491:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644502:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644514:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644519:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644525:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644646:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644655:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644660:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147144.644668:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147144.644754:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644763:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644768:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644773:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644779:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0ce00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147144.644783:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644790:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644801:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147144.644804:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147144.644808:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644813:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ce00/0x31399394250568ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644829:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644833:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644837:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644840:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0d800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147144.644843:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644847:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644852:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006500) 00010000:00010000:1.0:1746147144.644854:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147144.644856:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644860:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x31399394250568b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147144.644895:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x31399394250568a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.644915:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.644920:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.644922:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147144.644924:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d000, rc 0) 00000100:00100000:1.0:1746147144.644970:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32383:x1830967308039424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 623us (733us total) trans 8589936000 rc 0/0 00000100:00100000:1.0:1746147144.644976:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15309 00000100:00100000:1.0:1746147144.645000:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308039168 00000100:00100000:1.0:1746147144.645004:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308039168 00010000:00010000:1.0:1746147144.645018:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 15 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.645046:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308039040 00000100:00100000:1.0:1746147144.645048:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308039040 00010000:00010000:1.0:1746147144.645060:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 18 pid: 9586 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.645075:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6461 00000100:00100000:1.0:1746147144.645080:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308039168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.645111:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.645129:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 15 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.645138:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 15 pid: 1136 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.645154:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.645174:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308039168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.645180:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6461 00000100:00100000:1.0:1746147144.645190:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6462 00000100:00100000:1.0:1746147144.645194:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308039040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.645200:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.645206:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 18 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.645214:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 18 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.645225:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x313993942505675e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7804d expref: 18 pid: 9586 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.645235:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.645236:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.645243:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.645250:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.645278:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.645289:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310704384:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.645343:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147144.645650:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250567b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7808c expref: 14 pid: 1136 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746147144.645665:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310704000:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147144.645689:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.645697:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053a00, rc 0) 00000100:00100000:0.0:1746147144.645717:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32379:x1830967308038784:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8510us (9719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.645724:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14741 00000100:00100000:3.0:1746147144.645895:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310704256:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147144.645926:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.645962:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308038912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4347us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.645971:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6460 00000100:00100000:0.0:1746147144.649290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.649367:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308039680 00000100:00100000:2.0:1746147144.649375:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308039680 00000100:00100000:1.0:1746147144.649387:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310704384:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147144.649405:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147144.649424:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (114688->118783) req@ffff8800930ebb80 x1830967308039680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.649433:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ebb80 with x1830967308039680 ext(114688->118783) 00002000:00010000:2.0:1746147144.649438:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ebb80 00000100:00100000:1.0:1746147144.649451:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308039040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4255us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.649460:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6462 00000100:00100000:2.0:1746147144.649461:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3564 00000100:00100000:2.0:1746147144.649468:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308039680:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147144.649612:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308039680:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 143us (331us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147144.649618:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3564 00002000:00100000:2.0:1746147144.649623:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (114688->118783) req@ffff8800930ebb80 x1830967308039680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.649630:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ebb80 with x1830967308039680 ext(114688->118783) 00002000:00010000:2.0:1746147144.649633:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ebb80 00000100:00100000:0.0:1746147144.652455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.652518:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308039936 00000100:00100000:2.0:1746147144.652528:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308039936 00002000:00100000:2.0:1746147144.652572:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2568192->2572287) req@ffff8800930eb800 x1830967308039936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.652583:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb800 with x1830967308039936 ext(2568192->2572287) 00010000:00010000:2.0:1746147144.652593:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.652608:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.652615:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930eb800 00000100:00100000:2.0:1746147144.652648:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1122 00000100:00100000:2.0:1746147144.652656:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308039936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.652798:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308039936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 143us (354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147144.652804:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1122 00002000:00100000:2.0:1746147144.652809:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2568192->2572287) req@ffff8800930eb800 x1830967308039936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.652816:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb800 with x1830967308039936 ext(2568192->2572287) 00010000:00010000:2.0:1746147144.652820:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.652828:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.652838:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930eb800 00000100:00100000:0.0:1746147144.658536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.658579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.658629:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.658661:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308040704 00000100:00100000:0.0:1746147144.658669:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308040704 00000100:00100000:0.0:1746147144.658715:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5491 00000100:00100000:0.0:1746147144.658723:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32377:x1830967308040704:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147144.658828:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308040320 00000100:00100000:2.0:1746147144.658833:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308040320 00002000:00100000:2.0:1746147144.658862:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x8c:0x0] (958464->962559) req@ffff8800930e8000 x1830967308040320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.658872:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8000 with x1830967308040320 ext(958464->962559) 00002000:00010000:2.0:1746147144.658878:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e8000 00000100:00100000:2.0:1746147144.658911:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308040448 00000100:00100000:2.0:1746147144.658915:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308040448 00002000:00100000:2.0:1746147144.658927:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2572287) req@ffff8800930e8700 x1830967308040448/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.658934:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8700 with x1830967308040448 ext(2097152->2572287) 00010000:00010000:2.0:1746147144.658941:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.658955:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746147144.658955:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:32377:x1830967308040704:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 232us (325us total) trans 8589936001 rc 0/0 00002000:00010000:2.0:1746147144.658961:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e8700 00000100:00100000:0.0:1746147144.658963:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5491 00000100:00100000:2.0:1746147144.658975:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1123 00000100:00100000:2.0:1746147144.658980:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+29:2002:x1830967308040448:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147144.659003:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3565 00000100:00100000:3.0:1746147144.659021:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308040320:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147144.659257:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308040320:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 242us (730us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147144.659263:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3565 00002000:00100000:3.0:1746147144.659272:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (958464->962559) req@ffff8800930e8000 x1830967308040320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.659281:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8000 with x1830967308040320 ext(958464->962559) 00002000:00010000:3.0:1746147144.659286:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e8000 00000100:00100000:2.0:1746147144.665913:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.665941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.665985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.666212:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967308040448:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7224us (7625us total) trans 21474841508 rc 0/0 00000100:00100000:0.0:1746147144.666223:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1123 00002000:00100000:0.0:1746147144.666236:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2572287) req@ffff8800930e8700 x1830967308040448/t21474841508(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.666245:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e8700 with x1830967308040448 ext(2097152->2572287) 00010000:00010000:0.0:1746147144.666256:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.666270:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746147144.666278:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e8700 00000100:00100000:1.0:1746147144.666498:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308040832 00000100:00100000:1.0:1746147144.666506:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308040832 00000100:00100000:1.0:1746147144.666545:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308040960 00000100:00100000:1.0:1746147144.666548:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308040960 00000100:00100000:1.0:1746147144.666562:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14742 00000100:00100000:1.0:1746147144.666569:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967308040832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147144.666584:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.666600:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78111 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.666619:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.666621:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.666629:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 37 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.666644:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 37 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.666653:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:1.0:1746147144.666672:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308040832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 104us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.666677:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14742 00000100:00100000:1.0:1746147144.666688:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14743 00000100:00100000:1.0:1746147144.666692:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967308040960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147144.666698:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.666703:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78118 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.666712:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.666713:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.666716:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 37 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.666729:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 37 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.666736:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:1.0:1746147144.666751:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308040960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 59us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.666755:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14743 00000100:00100000:0.0:1746147144.667246:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308041088 00000100:00100000:0.0:1746147144.667251:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308041088 00000100:00100000:2.0:1746147144.667267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.667676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.667700:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308041216 00000100:00100000:0.0:1746147144.667704:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308041216 00000100:00100000:0.0:1746147144.667724:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308041344 00000100:00100000:0.0:1746147144.667726:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308041344 00000100:00100000:2.0:1746147144.667730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.667749:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14744 00000100:00100000:0.0:1746147144.667755:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308041088:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147144.667762:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14745 00010000:00010000:0.0:1746147144.667765:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147144.667770:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14746 00000100:00100000:2.0:1746147144.667774:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308041216:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147144.667776:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308041344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.667778:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7811f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.667783:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.667791:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x31399394250568df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7812d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.667792:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.667798:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.667799:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147144.667805:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.667810:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x31399394250568e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78126 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147144.667817:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147144.667824:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:1.0:1746147144.667833:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310704512:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.667854:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310704640:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147144.667883:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.667909:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.668166:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308041600 00000100:00100000:3.0:1746147144.668171:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308041600 00000100:00100000:3.0:1746147144.668206:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5492 00000100:00100000:3.0:1746147144.668212:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32379:x1830967308041600:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147144.668393:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308041088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147144.668404:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14744 00000100:00100000:3.0:1746147144.668532:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32379:x1830967308041600:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 319us (800us total) trans 8589936002 rc 0/0 00000100:00100000:3.0:1746147144.668538:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5492 00000100:00100000:0.0:1746147144.670173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.670425:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308041728 00000100:00100000:1.0:1746147144.670433:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308041728 00010000:00010000:1.0:1746147144.670471:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.670511:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6463 00000100:00100000:1.0:1746147144.670517:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308041728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.670532:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.670550:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.670562:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.670588:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.670590:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.670595:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.670603:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.670634:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.670645:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310704768:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.670734:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.671520:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310704640:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.671547:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x31399394250568e6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78126 expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.671560:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x31399394250568e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78126 expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.671586:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32000, rc 0) 00000100:00100000:2.0:1746147144.671622:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308041216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3851us (4356us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.671629:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14745 00010000:00010000:1.0:1746147144.671866:0:1398:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88009c30b100 x1830967310704512) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.671885:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x313993942505688b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780ee expref: 31 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.672277:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310704512:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147144.672295:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x31399394250568df lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7812d expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.672308:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x31399394250568df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7812d expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.672315:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0dc00, rc 0) 00000100:00100000:1.0:1746147144.673564:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308041344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5783us (5881us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147144.673571:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14746 00000100:00100000:1.0:1746147144.677350:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310704768:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147144.677372:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.677430:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308041728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6911us (7261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.677439:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6463 00000100:00100000:0.0:1746147144.689244:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.689269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.689285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.689295:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.689324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.689344:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308041984 00000100:00100000:0.0:1746147144.689352:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308041984 00002000:00100000:0.0:1746147144.689388:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800930eaa00 x1830967308041984/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.689396:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eaa00 with x1830967308041984 ext(2097152->4194303) 00002000:00010000:0.0:1746147144.689401:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930eaa00 00000100:00100000:0.0:1746147144.689412:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308042240 00000100:00100000:0.0:1746147144.689413:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308042240 00002000:00100000:0.0:1746147144.689423:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800930e9f80 x1830967308042240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 504/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.689429:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e9f80 with x1830967308042240 ext(0->1048575) 00002000:00010000:0.0:1746147144.689431:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e9f80 00000100:00100000:0.0:1746147144.689437:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308042624 00000100:00100000:0.0:1746147144.689438:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308042624 00002000:00100000:0.0:1746147144.689445:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800930ea680 x1830967308042624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.689450:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ea680 with x1830967308042624 ext(1048576->2097151) 00002000:00010000:0.0:1746147144.689452:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ea680 00000100:00100000:0.0:1746147144.689458:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308042752 00000100:00100000:0.0:1746147144.689459:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308042752 00002000:00100000:0.0:1746147144.689466:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800930eb100 x1830967308042752/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.689471:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb100 with x1830967308042752 ext(1048576->2097151) 00002000:00010000:0.0:1746147144.689473:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930eb100 00000100:00100000:0.0:1746147144.689478:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308042880 00000100:00100000:0.0:1746147144.689479:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308042880 00002000:00100000:0.0:1746147144.689485:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009885ad80 x1830967308042880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.689490:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885ad80 with x1830967308042880 ext(1048576->2097151) 00002000:00010000:0.0:1746147144.689492:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009885ad80 00000100:00100000:0.0:1746147144.689500:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3566 00000100:00100000:0.0:1746147144.689505:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308041984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.690075:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3567 00000100:00100000:3.0:1746147144.690082:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967308042240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.690285:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3568 00000100:00100000:3.0:1746147144.690289:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308042624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.691683:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3569 00000100:00100000:3.0:1746147144.691693:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967308042752:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.692420:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3570 00000100:00100000:3.0:1746147144.692426:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308042880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.700843:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308042240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10753us (11563us total) trans 0 rc 200704/200704 00000100:00100000:3.0:1746147144.700855:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3567 00002000:00100000:3.0:1746147144.700864:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800930e9f80 x1830967308042240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 504/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 200704/200704 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.700874:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e9f80 with x1830967308042240 ext(0->1048575) 00002000:00010000:3.0:1746147144.700879:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e9f80 00000100:00100000:2.0:1746147144.710595:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308041984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21075us (21345us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147144.710609:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3566 00002000:00100000:2.0:1746147144.710623:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800930eaa00 x1830967308041984/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.710635:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eaa00 with x1830967308041984 ext(2097152->4194303) 00002000:00010000:2.0:1746147144.710641:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930eaa00 00000100:00100000:3.0:1746147144.712157:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308042624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21858us (22862us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.712169:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3568 00002000:00100000:3.0:1746147144.712179:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800930ea680 x1830967308042624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.712188:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ea680 with x1830967308042624 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.712192:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ea680 00000100:00100000:3.0:1746147144.724469:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308042752:12345-192.168.204.25@tcp:3:cat.0 Request processed in 32765us (35158us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.724483:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3569 00002000:00100000:3.0:1746147144.724497:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800930eb100 x1830967308042752/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.724506:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930eb100 with x1830967308042752 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.724512:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930eb100 00000100:00100000:1.0:1746147144.724851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.724992:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308042880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 32566us (35665us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.725000:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3570 00002000:00100000:2.0:1746147144.725006:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009885ad80 x1830967308042880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.725013:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885ad80 with x1830967308042880 ext(1048576->2097151) 00002000:00010000:2.0:1746147144.725017:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009885ad80 00000100:00100000:0.0:1746147144.725206:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308043136 00000100:00100000:0.0:1746147144.725214:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308043136 00000100:00100000:0.0:1746147144.725246:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14747 00000100:00100000:0.0:1746147144.725252:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308043136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.725267:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.725285:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730400/0x31399394250568ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78134 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.725342:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310704896:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.725399:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.730771:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310704896:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.730816:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730400/0x31399394250568ed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78134 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.730833:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730400/0x31399394250568ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78134 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.731457:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730400, rc 0) 00000100:00100000:2.0:1746147144.731525:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308043136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6270us (6677us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.731535:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14747 00000100:00100000:0.0:1746147144.735465:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.736204:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308043392 00000100:00100000:2.0:1746147144.736214:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308043392 00002000:00100000:2.0:1746147144.736264:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f085180 x1830967308043392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.736281:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085180 with x1830967308043392 ext(4194304->4919295) 00002000:00010000:2.0:1746147144.736287:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085180 00000100:00100000:2.0:1746147144.736325:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3571 00000100:00100000:2.0:1746147144.736333:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308043392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147144.737253:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.737556:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308043520 00000100:00100000:2.0:1746147144.737562:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308043520 00000100:00100000:2.0:1746147144.737597:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14748 00000100:00100000:2.0:1746147144.737602:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308043520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.737614:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.737633:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x31399394250568f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7813b expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.737683:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310705024:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.738696:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.738822:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.738941:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308043648 00000100:00100000:2.0:1746147144.738946:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308043648 00000100:00100000:2.0:1746147144.738990:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14749 00000100:00100000:2.0:1746147144.738997:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308043648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.739009:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.739024:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78142 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.739042:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.739044:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.739052:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 38 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.739068:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 38 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.739079:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:2.0:1746147144.739125:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308043648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 128us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.739131:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14749 00000100:00100000:0.0:1746147144.745648:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310705024:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.745681:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308043392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9346us (10225us total) trans 0 rc 724992/724992 00010000:00010000:0.0:1746147144.745686:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x31399394250568f4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7813b expref: 41 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147144.745693:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3571 00010000:00010000:0.0:1746147144.745702:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x31399394250568f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7813b expref: 41 pid: 1398 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746147144.745703:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f085180 x1830967308043392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.745711:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085180 with x1830967308043392 ext(4194304->4919295) 00002000:00010000:2.0:1746147144.745716:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085180 00010000:00010000:0.0:1746147144.745731:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32800, rc 0) 00000100:00100000:0.0:1746147144.745753:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308043520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8150us (8502us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147144.745760:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14748 00000100:00100000:0.0:1746147144.748878:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.748941:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308043776 00000100:00100000:2.0:1746147144.748950:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308043776 00000100:00100000:0.0:1746147144.748988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.749395:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308043904 00000100:00100000:2.0:1746147144.749399:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308043904 00000100:00100000:2.0:1746147144.749420:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14750 00000100:00100000:2.0:1746147144.749428:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32383:x1830967308043776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.749449:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.749468:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78149 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.749499:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.749507:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147144.749509:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147144.749512:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 41 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.749543:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.749555:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 17 pid: 9584 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.749568:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310705152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.749655:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.749686:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14751 00000100:00100000:2.0:1746147144.749691:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308043904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.749698:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.749706:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x3139939425056909 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78150 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.749734:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310705280:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.749754:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.751478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.751487:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310705280:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147144.751507:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308044032 00000100:00100000:0.0:1746147144.751511:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308044032 00010000:00010000:3.0:1746147144.751515:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x3139939425056909 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78150 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.751526:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x3139939425056909 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78150 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746147144.751546:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3067904->3145727) req@ffff88013486aa00 x1830967308044032/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.751555:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486aa00 with x1830967308044032 ext(3067904->3145727) 00000100:00100000:2.0:1746147144.751559:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310705152:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147144.751561:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 18 pid: 9584 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.751572:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 18 pid: 9584 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.751575:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 41 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147144.751578:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013486aa00 00010000:00010000:2.0:1746147144.751591:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:0.0:1746147144.751596:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1124 00000100:00100000:0.0:1746147144.751601:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308044032:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147144.751621:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32383:x1830967308043776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2193us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.751628:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14750 00010000:00010000:3.0:1746147144.751755:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00000100:00100000:3.0:1746147144.751796:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308043904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2104us (2808us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.751802:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14751 00000100:00100000:2.0:1746147144.753389:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.753499:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308044160 00000100:00100000:3.0:1746147144.753506:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308044160 00000100:00100000:3.0:1746147144.753551:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14752 00000100:00100000:3.0:1746147144.753558:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:32375:x1830967308044160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.753572:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.753589:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78157 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.753611:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.753613:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.753617:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.753719:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.753729:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0000, rc 0) 00000100:00100000:3.0:1746147144.753758:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32375:x1830967308044160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 201us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.753763:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14752 00000100:00100000:0.0:1746147144.754590:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308044032:12345-192.168.204.25@tcp:4:cat.0 Request processed in 2985us (3116us total) trans 17179874242 rc 0/0 00000100:00100000:0.0:1746147144.754599:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1124 00002000:00100000:0.0:1746147144.754607:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3067904->3145727) req@ffff88013486aa00 x1830967308044032/t17179874242(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.754616:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486aa00 with x1830967308044032 ext(3067904->3145727) 00010000:00010000:0.0:1746147144.754623:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 20 pid: 9584 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746147144.754639:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 20 pid: 9584 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746147144.754646:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013486aa00 00000100:00100000:0.0:1746147144.758190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.758228:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308044288 00000100:00100000:1.0:1746147144.758237:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308044288 00010000:00010000:1.0:1746147144.758276:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 20 pid: 9584 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.758313:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6464 00000100:00100000:1.0:1746147144.758323:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308044288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.758339:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.758361:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 20 pid: 9584 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.758379:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 20 pid: 9584 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.758403:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942505687d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e0 expref: 20 pid: 9584 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.758433:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.758435:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.758443:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.758450:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.758458:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.758459:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.758462:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.758467:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.758498:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.758511:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310705408:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147144.758664:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.758673:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310705536:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.758704:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.760080:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310705408:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.760108:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310705536:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147144.760121:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.760154:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308044288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1833us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.760162:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6464 00000100:00100000:0.0:1746147144.760577:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.760634:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308044416 00000100:00100000:3.0:1746147144.760640:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308044416 00000100:00100000:3.0:1746147144.760682:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14753 00000100:00100000:3.0:1746147144.760689:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308044416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.760705:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.760723:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425056917 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7815e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147144.760770:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310705664:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147144.760841:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.761839:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310705664:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.761866:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425056917 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7815e expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.761876:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425056917 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7815e expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.761904:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0600, rc 0) 00000100:00100000:3.0:1746147144.761931:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308044416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1242us (1355us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.761938:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14753 00000100:00100000:0.0:1746147144.763648:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.763858:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308044672 00000100:00100000:2.0:1746147144.763865:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308044672 00002000:00100000:2.0:1746147144.763915:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff8801305f2a00 x1830967308044672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.763925:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2a00 with x1830967308044672 ext(4915200->4919295) 00002000:00010000:2.0:1746147144.763930:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f2a00 00000100:00100000:2.0:1746147144.763957:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3572 00000100:00100000:2.0:1746147144.763964:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308044672:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.764132:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308044672:12345-192.168.204.25@tcp:3:cat.0 Request processed in 168us (489us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147144.764138:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3572 00002000:00100000:2.0:1746147144.764143:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff8801305f2a00 x1830967308044672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.764150:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2a00 with x1830967308044672 ext(4915200->4919295) 00002000:00010000:2.0:1746147144.764153:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f2a00 00000100:00100000:0.0:1746147144.768256:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.768525:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308044928 00000100:00100000:3.0:1746147144.768534:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308044928 00000100:00100000:3.0:1746147144.768595:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5493 00000100:00100000:3.0:1746147144.768603:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:32375:x1830967308044928:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147144.769616:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:32375:x1830967308044928:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1008us (1366us total) trans 8589936003 rc 0/0 00000100:00100000:3.0:1746147144.769625:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5493 00000100:00100000:0.0:1746147144.770153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.770267:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.770669:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308045184 00000100:00100000:2.0:1746147144.770682:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308045184 00000100:00100000:3.0:1746147144.770691:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308045440 00000100:00100000:3.0:1746147144.770696:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308045440 00002000:00100000:3.0:1746147144.770731:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801305f1880 x1830967308045440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.770734:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801305f0e00 x1830967308045184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.770742:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1880 with x1830967308045440 ext(2097152->4194303) 00002000:00100000:2.0:1746147144.770744:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0e00 with x1830967308045184 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.770747:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f1880 00002000:00010000:2.0:1746147144.770749:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0e00 00000100:00100000:3.0:1746147144.770781:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3573 00000100:00100000:3.0:1746147144.770787:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308045440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.770802:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3574 00000100:00100000:2.0:1746147144.770809:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308045184:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.785927:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308045184:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15083us (15738us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147144.785941:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3574 00002000:00100000:2.0:1746147144.785953:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801305f0e00 x1830967308045184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.785962:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0e00 with x1830967308045184 ext(2097152->4194303) 00002000:00010000:2.0:1746147144.785968:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0e00 00000100:00100000:3.0:1746147144.794234:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308045440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23438us (23958us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147144.794246:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3573 00002000:00100000:3.0:1746147144.794257:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801305f1880 x1830967308045440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.794265:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1880 with x1830967308045440 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.794271:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f1880 00000100:00100000:0.0:1746147144.799829:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.799935:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308045696 00000100:00100000:3.0:1746147144.799949:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308045696 00000100:00100000:3.0:1746147144.800016:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15310 00000100:00100000:3.0:1746147144.800024:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32388:x1830967308045696:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.800058:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.800075:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x313993942505691e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78165 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.800204:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.800217:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.800225:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.800252:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.800263:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 31 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.800275:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310705792:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.800534:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.801887:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.802014:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308045952 00000100:00100000:3.0:1746147144.802019:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308045952 00002000:00100000:3.0:1746147144.802046:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8801305f0380 x1830967308045952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.802055:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0380 with x1830967308045952 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.802059:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0380 00000100:00100000:3.0:1746147144.802083:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3575 00000100:00100000:3.0:1746147144.802112:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308045952:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.802612:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310705792:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.802634:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147144.806497:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.806588:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046080 00000100:00100000:1.0:1746147144.806597:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046080 00010000:00010000:1.0:1746147144.806636:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 32 pid: 9138 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.806677:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6465 00000100:00100000:1.0:1746147144.806686:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967308046080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.806701:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.806707:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 32 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.806719:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 32 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.806742:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x31399394250568bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7810a expref: 32 pid: 9138 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.806770:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.806775:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.806785:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.806792:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.806822:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.806860:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308046080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.806868:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6465 00010000:00010000:3.0:1746147144.807134:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.807145:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147144.807164:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.807275:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x313993942505691e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.807524:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.807532:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.807535:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147144.807538:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:3.0:1746147144.807647:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32388:x1830967308045696:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7622us (7829us total) trans 8589936004 rc 0/0 00000100:00100000:3.0:1746147144.807654:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15310 00000100:00100000:3.0:1746147144.808487:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308045952:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6392us (6597us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147144.808498:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3575 00002000:00100000:3.0:1746147144.808508:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8801305f0380 x1830967308045952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.808519:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0380 with x1830967308045952 ext(4194304->4919295) 00002000:00010000:3.0:1746147144.808524:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f0380 00000100:00100000:0.0:1746147144.814805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.815410:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046336 00000100:00100000:3.0:1746147144.815419:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046336 00000100:00100000:3.0:1746147144.815479:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5494 00000100:00100000:3.0:1746147144.815486:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32383:x1830967308046336:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147144.816203:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32383:x1830967308046336:12345-192.168.204.25@tcp:35:cat.0 Request processed in 714us (1409us total) trans 8589936005 rc 0/0 00000100:00100000:3.0:1746147144.816210:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5494 00000100:00100000:0.0:1746147144.825718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.826153:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046464 00000100:00100000:3.0:1746147144.826165:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046464 00000100:00100000:3.0:1746147144.826795:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15311 00000100:00100000:3.0:1746147144.826807:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32389:x1830967308046464:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147144.826840:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.826864:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425056933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7816c expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.826950:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.826967:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.826979:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.826994:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.827001:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.827006:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.827285:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.827299:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.827306:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.827343:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.827356:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 31 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.827368:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310705920:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.827957:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.831436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.831548:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046592 00000100:00100000:2.0:1746147144.831557:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046592 00010000:00010000:2.0:1746147144.831593:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 32 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.831634:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6466 00000100:00100000:2.0:1746147144.831644:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967308046592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.831658:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.831664:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 32 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.831677:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 32 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.831701:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147144.831705:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.831716:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.831723:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147144.831740:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.831782:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967308046592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 139us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.831789:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6466 00010000:00010000:3.0:1746147144.831921:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425056925 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78165 expref: 31 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.831940:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310705920:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.831961:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.831970:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.831976:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147144.832031:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147144.832036:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147144.832054:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832559:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832693:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832702:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832708:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832713:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.832718:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832728:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832741:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147144.832744:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.832748:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832752:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x313993942505693a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832763:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832768:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832773:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832777:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.832779:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832783:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832790:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1900) 00010000:00010000:3.0:1746147144.832792:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.832794:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832798:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.832840:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425056933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.832854:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.832860:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.832861:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147144.832863:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33800, rc 0) 00000100:00100000:3.0:1746147144.832934:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32389:x1830967308046464:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 6128us (7227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.832942:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15311 00000100:00100000:0.0:1746147144.836757:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.836791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.836863:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.836968:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046720 00000100:00100000:1.0:1746147144.836978:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046720 00000100:00100000:1.0:1746147144.837018:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046976 00000100:00100000:1.0:1746147144.837020:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046976 00000100:00100000:1.0:1746147144.837033:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308046848 00000100:00100000:1.0:1746147144.837034:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308046848 00000100:00100000:1.0:1746147144.837050:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14754 00000100:00100000:1.0:1746147144.837058:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308046720:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147144.837077:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.837112:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x313993942505694f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78173 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.837170:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c308700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310706048:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147144.837250:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.837271:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14755 00000100:00100000:1.0:1746147144.837276:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308046976:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147144.837284:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.837293:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78181 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.837305:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.837307:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.837316:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.837331:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.837340:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa800, rc 0) 00000100:00100000:1.0:1746147144.837362:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308046976:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 85us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.837368:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14755 00000100:00100000:1.0:1746147144.837385:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14756 00000100:00100000:1.0:1746147144.837390:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308046848:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147144.837395:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.837402:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7817a expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.837411:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.837413:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.837417:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.837426:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.837433:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb800, rc 0) 00000100:00100000:1.0:1746147144.837448:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308046848:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 58us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.837452:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14756 00000100:00100000:1.0:1746147144.838688:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c308700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310706048:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147144.838715:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x313993942505694f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78173 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.838725:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x313993942505694f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78173 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.838748:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbe00, rc 0) 00000100:00100000:1.0:1746147144.839729:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308046720:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 2664us (2975us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147144.839737:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14754 00000100:00100000:0.0:1746147144.842269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.842494:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308047232 00000100:00100000:3.0:1746147144.842505:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308047232 00000100:00100000:3.0:1746147144.842634:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15312 00000100:00100000:3.0:1746147144.842646:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32389:x1830967308047232:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147144.842672:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.842695:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425056964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78188 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.842820:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.842836:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.842844:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.842885:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.842910:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 13 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.842924:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310706176:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.843047:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.845350:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310706176:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.845383:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147144.845873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.845997:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308047360 00000100:00100000:1.0:1746147144.846005:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308047360 00010000:00010000:1.0:1746147144.846041:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.846085:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6467 00000100:00100000:1.0:1746147144.846135:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308047360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.846153:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.846160:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.846179:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.846204:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056948 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7816c expref: 14 pid: 6215 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.846220:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.846224:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.846234:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.846241:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147144.846281:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.846353:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308047360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 211us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.846360:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6467 00010000:00010000:3.0:1746147144.846518:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.846524:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147144.846549:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.846671:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425056964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78188 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.846693:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78188 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.846699:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.846701:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147144.846703:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:3.0:1746147144.846729:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32389:x1830967308047232:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4087us (4472us total) trans 8589936006 rc 0/0 00000100:00100000:3.0:1746147144.846734:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15312 00000100:00100000:0.0:1746147144.850024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.850604:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308047616 00000100:00100000:3.0:1746147144.850613:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308047616 00000100:00100000:3.0:1746147144.850666:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15313 00000100:00100000:3.0:1746147144.850674:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32389:x1830967308047616:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147144.850697:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.850700:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147144.850721:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942505696b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78188 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.850734:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.850738:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147144.850748:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056979 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7818f expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.850821:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850834:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850842:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850851:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850856:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850862:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850866:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.850869:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850874:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850880:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.850882:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147144.850884:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850888:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056980 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.850918:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056979 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7818f expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.850924:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056979 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7818f expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.850930:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33400, rc 0) 00000100:00100000:3.0:1746147144.852354:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32389:x1830967308047616:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 1675us (2332us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.852361:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15313 00000100:00100000:0.0:1746147144.855697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.855811:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308047872 00000100:00100000:3.0:1746147144.855819:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308047872 00000100:00100000:3.0:1746147144.856006:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5495 00000100:00100000:3.0:1746147144.856014:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f88850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32389:x1830967308047872:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147144.856218:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f88850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32389:x1830967308047872:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 204us (527us total) trans 8589936007 rc 0/0 00000100:00100000:3.0:1746147144.856225:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5495 00000100:00100000:1.0:1746147144.862567:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.863137:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308048000 00000100:00100000:2.0:1746147144.863145:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308048000 00000100:00100000:2.0:1746147144.863200:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14757 00000100:00100000:2.0:1746147144.863208:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32388:x1830967308048000:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147144.863221:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.863236:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78196 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.863260:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.863273:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 14 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.863279:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.863285:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.863286:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.863290:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 39 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.863314:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.863323:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.863333:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310706304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.863872:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 14 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.863881:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 14 pid: 12201 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.863889:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310706432:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.863926:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.863934:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 29 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.863941:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310706560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.863954:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.866756:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310706304:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.866768:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310706432:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.866776:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310706560:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.866802:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 39 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.866818:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:2.0:1746147144.867423:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32388:x1830967308048000:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4215us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.867432:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14757 00000100:00100000:0.0:1746147144.867893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.868316:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308048128 00000100:00100000:2.0:1746147144.868323:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308048128 00010000:00010000:2.0:1746147144.868345:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.868365:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6468 00000100:00100000:2.0:1746147144.868370:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2003:x1830967308048128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.868381:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.868394:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.868402:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.868418:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425056956 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78181 expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00010000:00010000:2.0:1746147144.868443:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.868463:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967308048128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.868468:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6468 00000100:00100000:0.0:1746147144.870613:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.870735:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308048256 00000100:00100000:1.0:1746147144.870743:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308048256 00010000:00010000:1.0:1746147144.870772:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 30 pid: 1853 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.870814:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6469 00000100:00100000:1.0:1746147144.870820:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308048256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.870832:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.870848:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 30 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.870857:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 30 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.870874:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x3139939425056899 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780fc expref: 30 pid: 1853 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.870889:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.870941:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308048256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.870948:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6469 00000100:00100000:0.0:1746147144.874424:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.875128:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308048384 00000100:00100000:1.0:1746147144.875137:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308048384 00010000:00010000:1.0:1746147144.875373:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.875413:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6470 00000100:00100000:1.0:1746147144.875421:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308048384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.875433:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.875450:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.875461:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.875480:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250568fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78142 expref: 39 pid: 1854 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.875492:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.875494:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147144.875499:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.875506:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.875533:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147144.875545:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310706688:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147144.875633:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.880082:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.880162:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308048640 00000100:00100000:3.0:1746147144.880170:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308048640 00002000:00100000:3.0:1746147144.880207:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3813376->3817471) req@ffff880098e10e00 x1830967308048640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.880216:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10e00 with x1830967308048640 ext(3813376->3817471) 00002000:00010000:3.0:1746147144.880221:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e10e00 00000100:00100000:3.0:1746147144.880238:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3576 00000100:00100000:3.0:1746147144.880245:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308048640:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147144.880368:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308048640:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 122us (292us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147144.880374:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3576 00002000:00100000:3.0:1746147144.880380:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3813376->3817471) req@ffff880098e10e00 x1830967308048640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.880387:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10e00 with x1830967308048640 ext(3813376->3817471) 00002000:00010000:3.0:1746147144.880389:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098e10e00 00000100:00100000:1.0:1746147144.880551:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310706688:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147144.880565:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.880591:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308048384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5172us (6176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.880598:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6470 00000100:00100000:0.0:1746147144.884992:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.886968:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308048768 00000100:00100000:2.0:1746147144.886979:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308048768 00000100:00100000:2.0:1746147144.887021:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14758 00000100:00100000:2.0:1746147144.887028:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32388:x1830967308048768:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147144.887045:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.887060:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7819d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.887086:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.887121:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 14 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.887128:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.887134:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.887136:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.887139:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->4407295] (req 4194304->4407295) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.887167:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.887178:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 18 pid: 9586 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.887188:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310706816:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.887283:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 14 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.887291:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 14 pid: 12201 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746147144.887299:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310706944:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.887322:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.887334:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.887342:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707072:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.887356:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.887747:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.887795:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308049024 00000100:00100000:3.0:1746147144.887800:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308049024 00000100:00100000:3.0:1746147144.887825:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15314 00000100:00100000:3.0:1746147144.887830:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:32393:x1830967308049024:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.887845:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.887855:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781a4 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.887916:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.887926:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.887935:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.887946:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.887951:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.887956:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888033:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888041:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888047:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147144.888054:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147144.888141:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888151:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888155:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888160:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.888163:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888168:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888177:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147144.888179:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.888182:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888186:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x313993942505699c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888203:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888207:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888211:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888214:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147144.888216:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888224:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888228:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1c00) 00010000:00010000:3.0:1746147144.888230:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147144.888232:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888235:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250569a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147144.888264:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33800/0x3139939425056995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.888274:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.888279:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147144.888281:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147144.888283:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:3.0:1746147144.888310:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:32393:x1830967308049024:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 479us (563us total) trans 8589936008 rc 0/0 00000100:00100000:3.0:1746147144.888316:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15314 00000100:00100000:0.0:1746147144.889233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.889318:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310706816:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.889327:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310706944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.889333:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707072:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.889351:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->4407295] (req 4194304->4407295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.889362:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32000, rc 0) 00000100:00100000:2.0:1746147144.889398:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32388:x1830967308048768:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2371us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.889405:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14758 00000100:00100000:1.0:1746147144.889559:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308049152 00000100:00100000:1.0:1746147144.889564:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308049152 00010000:00010000:1.0:1746147144.889583:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746147144.889601:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6471 00000100:00100000:1.0:1746147144.889607:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308049152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.889616:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.889629:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.889638:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.889652:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x3139939425056910 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78157 expref: 19 pid: 9586 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746147144.889853:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.889872:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308049152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 264us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.889877:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6471 00000100:00100000:0.0:1746147144.892904:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.893046:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308049280 00000100:00100000:1.0:1746147144.893054:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308049280 00010000:00010000:1.0:1746147144.893081:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746147144.893144:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6472 00000100:00100000:1.0:1746147144.893152:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308049280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147144.893166:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147144.893184:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.893194:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.893212:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb800/0x313993942505695d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7817a expref: 15 pid: 12201 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746147144.893225:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.893263:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308049280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147144.893270:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6472 00000100:00100000:0.0:1746147144.893818:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.894470:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308049408 00000100:00100000:2.0:1746147144.894476:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308049408 00010000:00010000:2.0:1746147144.894494:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.894514:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6473 00000100:00100000:2.0:1746147144.894519:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308049408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.894529:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.894540:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.894549:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.894562:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32c00/0x3139939425056902 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78149 expref: 42 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.894574:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.894576:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.894582:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.894589:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.894615:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.894625:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310707200:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147144.894677:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.899459:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.899489:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.899515:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308049920 00000100:00100000:2.0:1746147144.899522:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308049920 00000100:00100000:3.0:1746147144.899548:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310707200:192.168.204.25@tcp:105: 00002000:00100000:2.0:1746147144.899558:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4403200->4407295) req@ffff880134ab0a80 x1830967308049920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147144.899562:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308049664 00010000:00010000:3.0:1746147144.899567:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147144.899567:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308049664 00002000:00100000:2.0:1746147144.899568:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0a80 with x1830967308049920 ext(4403200->4407295) 00002000:00010000:2.0:1746147144.899573:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0a80 00000100:00100000:2.0:1746147144.899592:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3577 00000100:00100000:1.0:1746147144.899594:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15315 00000100:00100000:2.0:1746147144.899601:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308049920:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147144.899601:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:32396:x1830967308049664:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147144.899606:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308049408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5085us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.899615:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6473 00010000:00010000:1.0:1746147144.899618:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147144.899633:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffaa00/0x31399394250569b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781ab expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.899703:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308049920:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 103us (220us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147144.899709:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3577 00010000:00010000:1.0:1746147144.899711:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00002000:00100000:2.0:1746147144.899714:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4403200->4407295) req@ffff880134ab0a80 x1830967308049920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.899722:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0a80 with x1830967308049920 ext(4403200->4407295) 00010000:00010000:1.0:1746147144.899723:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00002000:00010000:2.0:1746147144.899725:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0a80 00010000:00010000:1.0:1746147144.899735:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147144.899744:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147144.900478:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffaa00/0x31399394250569b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.900491:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147144.900498:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147144.900500:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147144.900503:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffac00, rc 0) 00000100:00100000:1.0:1746147144.900767:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:32396:x1830967308049664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1166us (1319us total) trans 8589936009 rc 0/0 00000100:00100000:1.0:1746147144.900773:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15315 00000100:00100000:0.0:1746147144.903728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.903830:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050176 00000100:00100000:3.0:1746147144.903838:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050176 00000100:00100000:3.0:1746147144.903882:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5496 00000100:00100000:3.0:1746147144.903888:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32388:x1830967308050176:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147144.904076:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32388:x1830967308050176:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 188us (357us total) trans 8589936010 rc 0/0 00000100:00100000:3.0:1746147144.904082:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5496 00000100:00100000:0.0:1746147144.906391:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.906425:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.906456:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050432 00000100:00100000:2.0:1746147144.906464:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050432 00000100:00100000:0.0:1746147144.906780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.906846:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050304 00000100:00100000:2.0:1746147144.906848:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050304 00000100:00100000:2.0:1746147144.906863:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050560 00000100:00100000:2.0:1746147144.906865:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050560 00000100:00100000:0.0:1746147144.906881:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14759 00000100:00100000:0.0:1746147144.906909:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308050432:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147144.906918:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14760 00000100:00100000:2.0:1746147144.906927:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308050304:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147144.906932:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.906940:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147144.906952:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731400/0x31399394250569cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781b9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.906960:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x31399394250569d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781b2 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147144.907006:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310707328:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.907008:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707456:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.907082:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14761 00000100:00100000:2.0:1746147144.907192:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308050560:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.907201:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.907209:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250569db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781c0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.907233:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310707584:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147144.907283:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.907296:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147144.907912:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.909418:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310707584:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.909445:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250569db lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c0 expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147144.909449:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310707328:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147144.909457:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250569db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c0 expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147144.909469:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00010000:00010000:1.0:1746147144.909476:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731400/0x31399394250569cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781b9 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.909487:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731400/0x31399394250569cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781b9 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147144.909497:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731400, rc 0) 00000100:00100000:3.0:1746147144.909518:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308050560:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2428us (2736us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147144.909526:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14761 00000100:00100000:1.0:1746147144.909528:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308050432:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2634us (3148us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147144.909538:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14759 00000100:00100000:2.0:1746147144.909584:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707456:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147144.909600:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x31399394250569d4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781b2 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.909608:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x31399394250569d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781b2 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147144.909620:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00000100:00100000:2.0:1746147144.909639:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308050304:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2714us (3213us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147144.909644:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14760 00000100:00100000:0.0:1746147144.911662:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.911934:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050688 00000100:00100000:2.0:1746147144.911941:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050688 00000100:00100000:2.0:1746147144.911983:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14762 00000100:00100000:2.0:1746147144.911990:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:32396:x1830967308050688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147144.912006:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147144.912022:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781c7 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.912046:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.912054:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147144.912056:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147144.912059:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.912082:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.912178:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 40 pid: 1398 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.912189:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147144.912283:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.913803:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707712:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147144.913822:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.913835:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a3800, rc 0) 00000100:00100000:2.0:1746147144.913873:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:32396:x1830967308050688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1883us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.913879:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14762 00000100:00100000:0.0:1746147144.915041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.915109:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050816 00000100:00100000:2.0:1746147144.915114:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050816 00002000:00100000:2.0:1746147144.915142:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (114688->962559) req@ffff880134ab1500 x1830967308050816/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.915151:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab1500 with x1830967308050816 ext(114688->962559) 00010000:00010000:2.0:1746147144.915157:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 41 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.915169:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 41 pid: 1398 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.915175:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ab1500 00000100:00100000:2.0:1746147144.915322:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1125 00000100:00100000:2.0:1746147144.915330:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967308050816:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147144.922058:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308050816:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6720us (7011us total) trans 17179874243 rc 0/0 00000100:00100000:2.0:1746147144.922069:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1125 00002000:00100000:2.0:1746147144.922079:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (114688->962559) req@ffff880134ab1500 x1830967308050816/t17179874243(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.922106:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab1500 with x1830967308050816 ext(114688->962559) 00010000:00010000:2.0:1746147144.922115:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 43 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.922129:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 43 pid: 1398 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.922140:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134ab1500 00000100:00100000:0.0:1746147144.922359:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.922698:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308050944 00000100:00100000:3.0:1746147144.922705:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308050944 00000100:00100000:3.0:1746147144.922803:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14763 00000100:00100000:3.0:1746147144.922809:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:32393:x1830967308050944:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147144.922822:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.922837:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781ce expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.922865:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.922872:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.922873:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.922876:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3600384->4014079] (req 3600384->4014079) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.922912:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.922921:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 42 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.922931:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707840:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.923307:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.924613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.924667:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308051072 00000100:00100000:2.0:1746147144.924673:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308051072 00000100:00100000:0.0:1746147144.924678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147144.924697:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 43 pid: 1398 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.924758:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310707840:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.924776:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3600384->4014079] (req 3600384->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.924789:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db32e00, rc 0) 00000100:00100000:3.0:1746147144.924815:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:32393:x1830967308050944:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2005us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.924820:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14763 00000100:00100000:3.0:1746147144.924847:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308051200 00000100:00100000:3.0:1746147144.924850:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308051200 00002000:00100000:3.0:1746147144.924867:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4407295) req@ffff880099150a80 x1830967308051200/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.924875:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150a80 with x1830967308051200 ext(4194304->4407295) 00010000:00010000:3.0:1746147144.924880:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 44 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.924888:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 44 pid: 12225 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746147144.924905:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099150a80 00000100:00100000:3.0:1746147144.924916:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1126 00000100:00100000:3.0:1746147144.924921:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308051200:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147144.925202:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6474 00000100:00100000:2.0:1746147144.925209:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308051072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.925217:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.925229:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 45 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.925238:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 45 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.925255:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095053a00/0x31399394250568a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->962559) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78103 expref: 45 pid: 1398 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.925280:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.925281:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.925287:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.925294:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.925322:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.925332:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310707968:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147144.925454:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147144.927672:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308051200:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 2743us (2986us total) trans 17179874244 rc 0/0 00000100:00100000:3.0:1746147144.927838:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1126 00002000:00100000:3.0:1746147144.927852:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4407295) req@ffff880099150a80 x1830967308051200/t17179874244(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.927861:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150a80 with x1830967308051200 ext(4194304->4407295) 00010000:00010000:3.0:1746147144.927869:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 45 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746147144.927883:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 45 pid: 12225 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746147144.927908:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099150a80 00000100:00100000:2.0:1746147144.927965:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310707968:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.927988:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.928249:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308051072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3038us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.928259:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6474 00000100:00100000:0.0:1746147144.928771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.928825:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308051328 00000100:00100000:2.0:1746147144.928832:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308051328 00010000:00010000:2.0:1746147144.928855:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 44 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.928961:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6475 00000100:00100000:2.0:1746147144.928968:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967308051328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.928981:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.929000:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 44 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.929274:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 44 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.929302:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x313993942505698e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4407295) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7819d expref: 44 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.929316:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.929318:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.929324:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.929332:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.929363:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.929376:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310708096:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147144.929443:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147144.931012:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310708096:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147144.931030:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147144.931077:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308051328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2108us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147144.931086:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6475 00000100:00100000:0.0:1746147144.931216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.931541:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308051584 00000100:00100000:3.0:1746147144.931547:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308051584 00002000:00100000:3.0:1746147144.931581:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3600384->3604479) req@ffff880094534a80 x1830967308051584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.931591:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534a80 with x1830967308051584 ext(3600384->3604479) 00002000:00010000:3.0:1746147144.931595:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094534a80 00000100:00100000:3.0:1746147144.931624:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3578 00000100:00100000:3.0:1746147144.931631:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308051584:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147144.931762:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308051584:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 130us (545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147144.931767:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3578 00002000:00100000:3.0:1746147144.931772:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3600384->3604479) req@ffff880094534a80 x1830967308051584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.931778:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534a80 with x1830967308051584 ext(3600384->3604479) 00002000:00010000:3.0:1746147144.931780:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094534a80 00000100:00100000:1.0:1746147144.931905:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.931938:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308051968 00000100:00100000:0.0:1746147144.931942:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308051968 00002000:00100000:0.0:1746147144.931960:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009c30aa00 x1830967308051968/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147144.931966:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30aa00 with x1830967308051968 ext(0->1048575) 00002000:00010000:0.0:1746147144.931970:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30aa00 00000100:00100000:0.0:1746147144.931990:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3579 00000100:00100000:0.0:1746147144.931995:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308051968:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147144.932260:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.932283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.932335:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308052224 00000100:00100000:3.0:1746147144.932338:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308052224 00002000:00100000:3.0:1746147144.932352:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009c308000 x1830967308052224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.932360:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308000 with x1830967308052224 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.932364:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308000 00000100:00100000:3.0:1746147144.932380:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308052096 00000100:00100000:3.0:1746147144.932384:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308052096 00002000:00100000:3.0:1746147144.932396:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c30b100 x1830967308052096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.932403:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b100 with x1830967308052096 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.932406:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30b100 00000100:00100000:3.0:1746147144.932417:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3580 00000100:00100000:3.0:1746147144.932423:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308052224:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147144.932785:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3581 00000100:00100000:0.0:1746147144.932792:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308052096:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147144.937706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147144.938005:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308052608 00000100:00100000:1.0:1746147144.938015:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308052608 00002000:00100000:1.0:1746147144.938057:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4009984->4014079) req@ffff880094537480 x1830967308052608/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147144.938068:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537480 with x1830967308052608 ext(4009984->4014079) 00002000:00010000:1.0:1746147144.938073:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094537480 00000100:00100000:1.0:1746147144.938124:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3582 00000100:00100000:1.0:1746147144.938132:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967308052608:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147144.938272:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967308052608:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 140us (577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147144.938278:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3582 00002000:00100000:1.0:1746147144.938284:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4009984->4014079) req@ffff880094537480 x1830967308052608/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147144.938290:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537480 with x1830967308052608 ext(4009984->4014079) 00002000:00010000:1.0:1746147144.938293:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094537480 00000100:00100000:2.0:1746147144.940656:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308051968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8651us (8742us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.940668:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3579 00002000:00100000:2.0:1746147144.940679:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009c30aa00 x1830967308051968/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.940688:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30aa00 with x1830967308051968 ext(0->1048575) 00002000:00010000:2.0:1746147144.940695:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30aa00 00000100:00100000:3.0:1746147144.943753:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308052224:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11319us (11482us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147144.943766:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3580 00002000:00100000:3.0:1746147144.943778:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009c308000 x1830967308052224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.943787:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308000 with x1830967308052224 ext(1048576->2097151) 00002000:00010000:3.0:1746147144.943793:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308000 00000100:00100000:2.0:1746147144.944663:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308052096:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11869us (12377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.944671:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3581 00002000:00100000:2.0:1746147144.944676:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c30b100 x1830967308052096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.944684:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b100 with x1830967308052096 ext(1048576->2097151) 00002000:00010000:2.0:1746147144.944687:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30b100 00000100:00100000:0.0:1746147144.945729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.945817:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308052864 00000100:00100000:3.0:1746147144.945824:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308052864 00000100:00100000:3.0:1746147144.945981:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5497 00000100:00100000:3.0:1746147144.945989:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:32393:x1830967308052864:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147144.946593:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:32393:x1830967308052864:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 603us (866us total) trans 8589936011 rc 0/0 00000100:00100000:3.0:1746147144.946599:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5497 00000100:00100000:0.0:1746147144.954193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.954676:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308053120 00000100:00100000:2.0:1746147144.954684:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308053120 00002000:00100000:2.0:1746147144.954719:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880094536300 x1830967308053120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.954728:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536300 with x1830967308053120 ext(2097152->3145727) 00002000:00010000:2.0:1746147144.954733:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094536300 00000100:00100000:2.0:1746147144.954764:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3583 00000100:00100000:2.0:1746147144.954772:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308053120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147144.965366:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308053120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10586us (11172us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147144.965376:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3583 00002000:00100000:2.0:1746147144.965385:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880094536300 x1830967308053120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.965394:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536300 with x1830967308053120 ext(2097152->3145727) 00002000:00010000:2.0:1746147144.965399:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094536300 00000100:00100000:0.0:1746147144.970205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.970320:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308053248 00000100:00100000:3.0:1746147144.970329:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308053248 00000100:00100000:3.0:1746147144.970447:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14764 00000100:00100000:3.0:1746147144.970457:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+29:32396:x1830967308053248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147144.970482:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147144.970503:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781d5 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.970534:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.970541:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.970543:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147144.970546:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.970577:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.970589:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 37 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746147144.970600:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310708224:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147144.971364:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.973929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.974029:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310708224:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147144.974058:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147144.974074:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715e00, rc 0) 00000100:00100000:3.0:1746147144.974146:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+30:32396:x1830967308053248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3690us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.974156:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14764 00000100:00100000:2.0:1746147144.975235:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308053376 00000100:00100000:2.0:1746147144.975245:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308053376 00002000:00100000:2.0:1746147144.975291:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3813376->4194303) req@ffff880094536d80 x1830967308053376/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.975302:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536d80 with x1830967308053376 ext(3813376->4194303) 00010000:00010000:2.0:1746147144.975310:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 38 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.975325:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 38 pid: 12225 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.975333:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094536d80 00000100:00100000:2.0:1746147144.975370:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1127 00000100:00100000:2.0:1746147144.975379:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308053376:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147144.981903:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308053376:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6503us (7967us total) trans 21474841509 rc 0/0 00000100:00100000:2.0:1746147144.981917:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1127 00002000:00100000:2.0:1746147144.981930:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3813376->4194303) req@ffff880094536d80 x1830967308053376/t21474841509(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:520/0 lens 488/448 e 0 to 0 dl 1746147155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147144.982209:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094536d80 with x1830967308053376 ext(3813376->4194303) 00010000:00010000:2.0:1746147144.982221:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 40 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.982236:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 40 pid: 12225 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746147144.982244:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094536d80 00000100:00100000:0.0:1746147144.985214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147144.985958:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308053504 00000100:00100000:2.0:1746147144.985968:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308053504 00010000:00010000:2.0:1746147144.986009:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 40 pid: 12225 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746147144.986055:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6476 00000100:00100000:2.0:1746147144.986065:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308053504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147144.986151:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147144.986173:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 40 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.986186:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 40 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.986219:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056987 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78196 expref: 40 pid: 12225 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746147144.986250:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.986253:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147144.986261:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.986269:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147144.986308:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147144.986321:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310708352:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147144.986501:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147144.992206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147144.992249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147144.992275:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308053760 00000100:00100000:3.0:1746147144.992283:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308053760 00002000:00100000:3.0:1746147144.992327:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880094537800 x1830967308053760/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147144.992337:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537800 with x1830967308053760 ext(2097152->4194303) 00002000:00010000:3.0:1746147144.992343:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094537800 00000100:00100000:3.0:1746147144.992360:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308054016 00000100:00100000:3.0:1746147144.992362:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308054016 00002000:00100000:3.0:1746147144.992374:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880094535500 x1830967308054016/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/0 e 0 to 0 dl 1746147155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147144.992377:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3584 00002000:00100000:3.0:1746147144.992380:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535500 with x1830967308054016 ext(3145728->4194303) 00002000:00010000:3.0:1746147144.992383:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535500 00000100:00100000:2.0:1746147144.992388:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308053760:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.992396:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3585 00000100:00100000:3.0:1746147144.992400:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308054016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147144.992963:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310708352:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147144.992992:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147144.994390:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308053504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8320us (9178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147144.994403:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6476 00000100:00100000:3.0:1746147145.001211:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308054016:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8796us (8947us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746147145.001223:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3585 00002000:00100000:3.0:1746147145.001235:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880094535500 x1830967308054016/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 504/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.001245:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535500 with x1830967308054016 ext(3145728->4194303) 00002000:00010000:3.0:1746147145.001252:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535500 00000100:00100000:2.0:1746147145.005016:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308053760:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12618us (12807us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147145.005028:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3584 00002000:00100000:2.0:1746147145.005040:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880094537800 x1830967308053760/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:520/0 lens 488/440 e 0 to 0 dl 1746147155 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.005049:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537800 with x1830967308053760 ext(2097152->4194303) 00002000:00010000:2.0:1746147145.005056:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094537800 00000100:00100000:0.0:1746147145.017707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.017841:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308054272 00000100:00100000:2.0:1746147145.017851:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308054272 00002000:00100000:2.0:1746147145.017914:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094535880 x1830967308054272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.017925:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535880 with x1830967308054272 ext(4194304->4919295) 00002000:00010000:2.0:1746147145.017931:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535880 00000100:00100000:2.0:1746147145.017969:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3586 00000100:00100000:2.0:1746147145.017977:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308054272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147145.022667:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308054272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4680us (4961us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147145.022677:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3586 00002000:00100000:2.0:1746147145.022687:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094535880 x1830967308054272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.022694:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094535880 with x1830967308054272 ext(4194304->4919295) 00002000:00010000:2.0:1746147145.022700:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094535880 00000100:00100000:0.0:1746147145.042558:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.043150:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308054528 00000100:00100000:1.0:1746147145.043160:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308054528 00000100:00100000:1.0:1746147145.043215:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15316 00000100:00100000:1.0:1746147145.043223:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32403:x1830967308054528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147145.043255:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.043277:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x31399394250569f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781dc expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.043356:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.043370:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.043383:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.043394:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.043399:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.043403:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044597:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044616:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044623:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147145.044633:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147145.044726:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044732:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044738:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044743:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044748:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.044752:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044757:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044767:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147145.044770:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.044774:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044778:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x31399394250569fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044801:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044805:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044810:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044814:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.044816:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044824:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044829:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006200) 00010000:00010000:1.0:1746147145.044831:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.044833:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044838:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425056a05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.044883:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x31399394250569f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 35 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.044903:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 34 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.044909:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.044910:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147145.044913:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9000, rc 0) 00000100:00100000:1.0:1746147145.044988:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32403:x1830967308054528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1765us (2440us total) trans 8589936012 rc 0/0 00000100:00100000:1.0:1746147145.044995:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15316 00000100:00100000:0.0:1746147145.048126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.048189:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308054656 00000100:00100000:1.0:1746147145.048197:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.048198:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308054656 00000100:00100000:1.0:1746147145.048240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.048324:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308054784 00000100:00100000:1.0:1746147145.048324:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308054912 00000100:00100000:3.0:1746147145.048326:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308054784 00000100:00100000:1.0:1746147145.048328:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308054912 00000100:00100000:1.0:1746147145.048361:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14765 00000100:00100000:2.0:1746147145.048369:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14766 00000100:00100000:1.0:1746147145.048369:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308054656:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147145.048378:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308054784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.048388:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.048388:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.048407:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32e00/0x3139939425056a1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781ea expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.048407:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781e3 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.048430:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.048432:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.048441:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 46 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.048457:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 46 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147145.048461:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310708480:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147145.048467:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8000, rc 0) 00000100:00100000:1.0:1746147145.048511:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308054656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.048517:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14765 00000100:00100000:2.0:1746147145.048531:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.048533:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14767 00000100:00100000:1.0:1746147145.048538:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308054912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147145.048545:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.048555:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781f1 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.048565:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.048567:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.048570:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 40 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.048580:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 40 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.048587:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9e00, rc 0) 00000100:00100000:1.0:1746147145.048601:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308054912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 63us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.048606:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14767 00000100:00100000:2.0:1746147145.051848:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310708480:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147145.051884:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32e00/0x3139939425056a1a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ea expref: 45 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.051907:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32e00/0x3139939425056a1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ea expref: 45 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.051921:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32e00, rc 0) 00000100:00100000:2.0:1746147145.052377:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308054784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3999us (4178us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147145.052387:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14766 00000100:00100000:0.0:1746147145.058785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.058902:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308055168 00000100:00100000:2.0:1746147145.058911:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308055168 00002000:00100000:2.0:1746147145.058959:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4998380 x1830967308055168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.058969:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998380 with x1830967308055168 ext(0->1048575) 00002000:00010000:2.0:1746147145.058976:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998380 00000100:00100000:2.0:1746147145.059014:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3587 00000100:00100000:2.0:1746147145.059023:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967308055168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147145.069247:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967308055168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10213us (10461us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147145.069259:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3587 00002000:00100000:3.0:1746147145.069271:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4998380 x1830967308055168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.069282:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998380 with x1830967308055168 ext(0->1048575) 00002000:00010000:3.0:1746147145.069288:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998380 00000100:00100000:0.0:1746147145.069984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.070415:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308055424 00000100:00100000:1.0:1746147145.070424:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308055424 00000100:00100000:1.0:1746147145.070472:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15317 00000100:00100000:1.0:1746147145.070481:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:32405:x1830967308055424:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147145.070503:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.070524:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8a00/0x3139939425056a2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781f8 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.070627:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.070642:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.070650:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 33 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.070657:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.070689:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 33 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.070701:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 33 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.070715:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310708608:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147145.070806:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.070813:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 17 pid: 6215 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.070826:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310708736:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.070845:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.076772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.076921:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310708608:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.076934:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310708736:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147145.076959:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147145.077046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.077134:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308055552 00000100:00100000:3.0:1746147145.077142:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308055552 00010000:00010000:3.0:1746147145.077174:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 34 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.077209:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308055680 00000100:00100000:3.0:1746147145.077211:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308055680 00010000:00010000:3.0:1746147145.077222:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 18 pid: 6215 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.077238:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6477 00000100:00100000:3.0:1746147145.077245:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308055552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.077258:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.077265:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 34 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.077274:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 34 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.077296:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9000/0x3139939425056a0c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781dc expref: 34 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.077312:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.077316:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.077323:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.077328:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.077368:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308055552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 122us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.077375:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6477 00000100:00100000:3.0:1746147145.077392:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6478 00000100:00100000:3.0:1746147145.077397:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308055680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.077403:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.077407:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 18 pid: 6215 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.077416:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 18 pid: 6215 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.077431:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x31399394250569aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781a4 expref: 18 pid: 6215 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.077438:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.077441:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.077447:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.077452:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.077466:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.077479:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308055680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.077483:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6478 00010000:00010000:1.0:1746147145.077799:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147145.077806:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147145.077824:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147145.077959:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8a00/0x3139939425056a2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 18 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.077974:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 17 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.077985:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.077987:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147145.077989:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8400, rc 0) 00000100:00100000:1.0:1746147145.078302:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:32405:x1830967308055424:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7821us (8318us total) trans 8589936013 rc 0/0 00000100:00100000:1.0:1746147145.078309:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15317 00000100:00100000:0.0:1746147145.083421:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.083662:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308055808 00000100:00100000:2.0:1746147145.083672:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308055808 00000100:00100000:2.0:1746147145.083862:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14768 00000100:00100000:2.0:1746147145.083871:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32403:x1830967308055808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.083900:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.083919:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e781ff expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.083951:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.083959:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.083961:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.083964:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.083994:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.084007:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 19 pid: 12225 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.084019:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310708864:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.084655:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.091369:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.091495:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310708864:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.091530:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.091555:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33200, rc 0) 00000100:00100000:2.0:1746147145.091601:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32403:x1830967308055808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7731us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.091611:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14768 00000100:00100000:3.0:1746147145.091773:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308055936 00000100:00100000:3.0:1746147145.091782:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308055936 00002000:00100000:3.0:1746147145.091825:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3600384->4014079) req@ffff88009988b480 x1830967308055936/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.091833:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b480 with x1830967308055936 ext(3600384->4014079) 00010000:00010000:3.0:1746147145.091840:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 20 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.091853:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 20 pid: 12225 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.091864:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009988b480 00000100:00100000:3.0:1746147145.091882:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1128 00000100:00100000:3.0:1746147145.091889:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308055936:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147145.099498:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308055936:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7596us (8128us total) trans 17179874245 rc 0/0 00000100:00100000:3.0:1746147145.099512:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1128 00002000:00100000:3.0:1746147145.099525:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3600384->4014079) req@ffff88009988b480 x1830967308055936/t17179874245(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.099534:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b480 with x1830967308055936 ext(3600384->4014079) 00010000:00010000:3.0:1746147145.099545:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 22 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.099561:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 22 pid: 12225 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.099568:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009988b480 00000100:00100000:0.0:1746147145.106396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.107655:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308056064 00000100:00100000:2.0:1746147145.107666:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308056064 00010000:00010000:2.0:1746147145.107709:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 22 pid: 12225 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.107750:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6479 00000100:00100000:2.0:1746147145.108023:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308056064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.108042:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.108064:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 22 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.108081:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 22 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.108118:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db32e00/0x31399394250569e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4014079) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ce expref: 22 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.108138:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.108140:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.108146:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.108154:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.108187:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.108200:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310708992:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147145.108296:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.112486:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310708992:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147145.112510:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.112565:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308056064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4806us (6178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.112576:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6479 00000100:00100000:0.0:1746147145.122495:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.122797:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308056320 00000100:00100000:3.0:1746147145.122808:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308056320 00002000:00100000:3.0:1746147145.122858:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880099889180 x1830967308056320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.122869:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889180 with x1830967308056320 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.122876:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889180 00000100:00100000:3.0:1746147145.122911:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3588 00000100:00100000:3.0:1746147145.122921:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308056320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147145.126625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.126765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.126803:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308056576 00000100:00100000:0.0:1746147145.126811:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308056576 00002000:00100000:0.0:1746147145.126854:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e487b80 x1830967308056576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147145.126866:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487b80 with x1830967308056576 ext(2097152->4194303) 00002000:00010000:0.0:1746147145.126871:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487b80 00000100:00100000:0.0:1746147145.126916:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3589 00000100:00100000:0.0:1746147145.126928:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308056576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147145.126942:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308056832 00000100:00100000:2.0:1746147145.126946:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308056832 00000100:00100000:2.0:1746147145.126981:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15318 00000100:00100000:2.0:1746147145.126986:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32407:x1830967308056832:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.127004:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.127022:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33a00/0x3139939425056a4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78206 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.127106:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127119:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127129:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127141:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127145:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127150:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127247:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127256:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127261:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147145.127272:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147145.127350:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127356:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127361:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127366:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.127369:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127374:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127384:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147145.127386:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.127389:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127393:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425056a52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127407:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127412:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127416:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127422:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.127424:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127428:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127433:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553b00) 00010000:00010000:2.0:1746147145.127434:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.127436:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127440:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425056a59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147145.127472:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33a00/0x3139939425056a4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 36 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.127484:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.127490:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.127492:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147145.127494:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32800, rc 0) 00000100:00100000:2.0:1746147145.127531:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32407:x1830967308056832:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 544us (766us total) trans 8589936014 rc 0/0 00000100:00100000:2.0:1746147145.127536:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15318 00000100:00100000:0.0:1746147145.141148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.141291:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308056960 00000100:00100000:2.0:1746147145.141300:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308056960 00000100:00100000:2.0:1746147145.141344:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14769 00000100:00100000:2.0:1746147145.141351:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:32405:x1830967308056960:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.141369:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.141385:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7820d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.141410:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.141419:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.141425:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.141427:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.141429:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2547712->3129343] (req 2547712->3129343) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.141457:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.141467:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.141479:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310709120:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.141569:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.141580:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.141588:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310709248:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.141604:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.144875:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308056320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21946us (22385us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147145.144887:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3588 00002000:00100000:3.0:1746147145.144908:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880099889180 x1830967308056320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.144916:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889180 with x1830967308056320 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.144921:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889180 00000100:00100000:0.0:1746147145.159283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.159327:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310709120:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.159338:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310709248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.159366:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2547712->3129343] (req 2547712->3129343) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.159384:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:3.0:1746147145.159434:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+31:32405:x1830967308056960:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 18082us (18293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.159442:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14769 00000100:00100000:2.0:1746147145.159518:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308056576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 32590us (32902us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147145.159527:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3589 00002000:00100000:2.0:1746147145.159536:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e487b80 x1830967308056576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.159544:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487b80 with x1830967308056576 ext(2097152->4194303) 00010000:00010000:2.0:1746147145.159553:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 40 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.159563:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 40 pid: 12201 timeout: 783 lvb_type: 1 00002000:00010000:2.0:1746147145.159570:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e487b80 00000100:00100000:2.0:1746147145.159795:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308057216 00000100:00100000:2.0:1746147145.159801:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308057216 00010000:00010000:2.0:1746147145.159826:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.159857:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6480 00000100:00100000:2.0:1746147145.159864:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967308057216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.159876:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.159898:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.159906:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.159928:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715e00/0x31399394250569f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781d5 expref: 31 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.160133:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.160156:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308057216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 292us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.160162:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6480 00000100:00100000:1.0:1746147145.160275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.162455:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308057088 00000100:00100000:2.0:1746147145.162468:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308057088 00000100:00100000:2.0:1746147145.162521:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14770 00000100:00100000:2.0:1746147145.162527:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32403:x1830967308057088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.162542:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.162565:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78214 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.162587:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.162594:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2547712->3129343] (req 2547712->3129343) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.162603:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.162607:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.162636:0:1853:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2547712->3129343] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.162647:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.162655:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd2600, rc 0) 00000100:00100000:2.0:1746147145.162695:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32403:x1830967308057088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 169us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.162700:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14770 00000100:00100000:0.0:1746147145.165429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.165488:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308057344 00000100:00100000:2.0:1746147145.165495:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308057344 00000100:00100000:2.0:1746147145.165552:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15319 00000100:00100000:2.0:1746147145.165559:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32409:x1830967308057344:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147145.165581:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.165598:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425056a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7821b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.165650:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165661:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165670:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165682:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165687:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165691:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165744:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165754:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.165759:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.165782:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.165790:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 16 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.165800:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310709504:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.166456:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.171898:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.172171:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310709504:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.172190:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147145.172256:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308057472 00000100:00100000:2.0:1746147145.172262:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308057472 00010000:00010000:2.0:1746147145.172292:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.172314:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6481 00000100:00100000:2.0:1746147145.172320:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308057472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.172332:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.172348:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.172357:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.172374:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x3139939425056a28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f1 expref: 41 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.172732:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.172734:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.172741:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.172748:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.172773:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.172781:0:8909:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 29 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.172791:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310709632:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147145.172856:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.174469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.174524:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308057600 00000100:00100000:2.0:1746147145.174529:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308057600 00000100:00100000:0.0:1746147145.174542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147145.174553:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 17 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.174573:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6482 00000100:00100000:0.0:1746147145.174577:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308057856 00000100:00100000:2.0:1746147145.174579:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308057600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147145.174580:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308057856 00010000:00010000:2.0:1746147145.174589:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.174594:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 17 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.174603:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 17 pid: 9138 timeout: 783 lvb_type: 0 00002000:00100000:0.0:1746147145.174607:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2547712->2551807) req@ffff880099888e00 x1830967308057856/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147145.174615:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888e00 with x1830967308057856 ext(2547712->2551807) 00010000:00010000:2.0:1746147145.174619:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x3139939425056a36 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781f8 expref: 17 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.174622:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.174630:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147145.174631:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.174634:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00002000:00010000:0.0:1746147145.174637:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099888e00 00010000:00010000:2.0:1746147145.174643:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174649:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147145.174650:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1129 00000100:00100000:0.0:1746147145.174655:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308057856:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147145.174663:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.174704:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308057600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 124us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.174709:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6482 00010000:00010000:2.0:1746147145.174729:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174735:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147145.174750:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308057856:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 94us (208us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147145.174755:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1129 00002000:00100000:0.0:1746147145.174761:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2547712->2551807) req@ffff880099888e00 x1830967308057856/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147145.174767:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888e00 with x1830967308057856 ext(2547712->2551807) 00010000:00010000:0.0:1746147145.174771:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00000004:00200000:2.0:1746147145.174773:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147145.174777:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1746147145.174778:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746147145.174783:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099888e00 00000004:00010000:2.0:1746147145.174790:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174797:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174807:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174812:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174817:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174822:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174826:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.174829:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174835:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174843:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147145.174845:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.174848:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174852:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x3139939425056a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174859:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174863:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174867:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174871:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.174872:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174876:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.174880:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553e00) 00010000:00010000:2.0:1746147145.176553:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.176560:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.176567:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260400/0x3139939425056a8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.176609:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260600/0x3139939425056a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.176620:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.176627:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.176628:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147145.176630:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261c00, rc 0) 00000100:00100000:2.0:1746147145.176675:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32409:x1830967308057344:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 11117us (11252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.176682:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15319 00000100:00100000:3.0:1746147145.176812:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310709632:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.176826:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.176848:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308057472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4527us (4967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.176856:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6481 00000100:00100000:0.0:1746147145.181726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.181820:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308058112 00000100:00100000:2.0:1746147145.181827:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308058112 00002000:00100000:2.0:1746147145.181865:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3125248->3129343) req@ffff880099888380 x1830967308058112/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.181875:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967308058112 ext(3125248->3129343) 00010000:00010000:2.0:1746147145.181883:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.181906:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.181912:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099888380 00000100:00100000:2.0:1746147145.181942:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1130 00000100:00100000:2.0:1746147145.181949:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967308058112:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147145.182073:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2003:x1830967308058112:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 124us (356us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147145.182085:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1130 00002000:00100000:2.0:1746147145.182601:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3125248->3129343) req@ffff880099888380 x1830967308058112/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.182608:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967308058112 ext(3125248->3129343) 00010000:00010000:2.0:1746147145.182613:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.182621:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.182626:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099888380 00000100:00100000:0.0:1746147145.182886:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.182934:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.182949:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308058240 00000100:00100000:1.0:1746147145.182954:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308058240 00000100:00100000:2.0:1746147145.183000:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308058368 00000100:00100000:2.0:1746147145.183003:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308058368 00000100:00100000:2.0:1746147145.183035:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14771 00000100:00100000:2.0:1746147145.183044:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308058240:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147145.183044:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14772 00000100:00100000:1.0:1746147145.183051:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2002:x1830967308058368:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147145.183053:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.183059:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.183067:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78222 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.183067:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78229 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.183083:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.183083:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.183085:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.183085:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.183108:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.183108:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.183122:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.183122:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.183131:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260000, rc 0) 00010000:00010000:1.0:1746147145.183131:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9200, rc 0) 00000100:00100000:1.0:1746147145.183154:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967308058368:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.183155:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2002:x1830967308058240:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.183160:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14771 00000100:00100000:1.0:1746147145.183163:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14772 00000100:00100000:0.0:1746147145.186652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.186704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.186760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.186905:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308058496 00000100:00100000:1.0:1746147145.186916:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308058496 00000100:00100000:1.0:1746147145.186958:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14773 00000100:00100000:1.0:1746147145.186968:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308058496:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147145.186987:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.187006:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8200/0x3139939425056aa6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78230 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147145.187059:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310709760:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147145.187171:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.187451:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308059008 00000100:00100000:3.0:1746147145.187456:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308059008 00000100:00100000:3.0:1746147145.187494:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5498 00000100:00100000:3.0:1746147145.187500:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:32405:x1830967308059008:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147145.187707:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:32405:x1830967308059008:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 205us (1001us total) trans 8589936015 rc 0/0 00000100:00100000:3.0:1746147145.187713:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5498 00000100:00100000:2.0:1746147145.188558:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308058752 00000100:00100000:2.0:1746147145.188568:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308058752 00002000:00100000:2.0:1746147145.188606:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2547712->3129343) req@ffff88011db14a80 x1830967308058752/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.188616:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967308058752 ext(2547712->3129343) 00010000:00010000:2.0:1746147145.188624:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.188639:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 30 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.188645:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011db14a80 00000100:00100000:2.0:1746147145.188696:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1131 00000100:00100000:2.0:1746147145.188706:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308058752:12345-192.168.204.25@tcp:4:multiop.0 00002000:00010000:2.0:1746147145.191874:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147144 -> 1746147145 00002000:00010000:2.0:1746147145.191882:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147144 -> 1746147145 00000100:00100000:2.0:1746147145.191930:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310709760:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147145.191964:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8200/0x3139939425056aa6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78230 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.191977:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8200/0x3139939425056aa6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78230 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.191995:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8200, rc 0) 00000100:00100000:2.0:1746147145.192058:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2002:x1830967308058496:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 5088us (5413us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147145.192068:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14773 00000100:00100000:0.0:1746147145.195176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.195977:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967308058752:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7272us (9215us total) trans 21474841510 rc 0/0 00000100:00100000:0.0:1746147145.195988:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1131 00002000:00100000:0.0:1746147145.196001:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2547712->3129343) req@ffff88011db14a80 x1830967308058752/t21474841510(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147145.196010:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967308058752 ext(2547712->3129343) 00010000:00010000:0.0:1746147145.196020:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 32 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.196040:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 32 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746147145.196046:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011db14a80 00000100:00100000:2.0:1746147145.196255:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308059136 00000100:00100000:2.0:1746147145.196263:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308059136 00000100:00100000:2.0:1746147145.196299:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14774 00000100:00100000:2.0:1746147145.196308:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32407:x1830967308059136:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.196324:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.196341:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78237 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.196368:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.196376:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.196384:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.196393:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.196395:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.196399:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.196427:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.196437:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 13 pid: 9586 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.196449:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310709888:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.196758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.197166:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308059392 00000100:00100000:3.0:1746147145.197171:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308059392 00000100:00100000:3.0:1746147145.197207:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15320 00000100:00100000:3.0:1746147145.197212:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32409:x1830967308059392:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147145.197222:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.197235:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425056ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7823e expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.197416:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.197424:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.197432:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710016:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.197456:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.197464:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 31 pid: 1136 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.197478:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710144:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.198224:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147145.198528:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.198548:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.198556:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.198576:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.198589:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 15 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.198598:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310710272:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.198643:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.198987:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.199140:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308059520 00000100:00100000:3.0:1746147145.199146:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308059520 00010000:00010000:3.0:1746147145.199170:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 32 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.199600:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6483 00000100:00100000:3.0:1746147145.199608:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967308059520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.199618:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.199638:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 32 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.199649:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 32 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.199674:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425056a6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->3129343) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7820d expref: 32 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.199703:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.199705:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.199712:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.199723:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.199746:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.199756:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310710400:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.200318:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.201527:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310709888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.201538:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710016:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.201545:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710144:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.201572:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.201585:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260600, rc 0) 00000100:00100000:2.0:1746147145.201633:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32407:x1830967308059136:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5325us (6466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.201642:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14774 00000100:00100000:0.0:1746147145.201745:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.201763:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308059776 00000100:00100000:0.0:1746147145.201773:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308059776 00010000:00010000:0.0:1746147145.201797:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 14 pid: 9586 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.201817:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6484 00000100:00100000:0.0:1746147145.201823:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2003:x1830967308059776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.201833:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.201850:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 14 pid: 9586 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.201861:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 14 pid: 9586 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.201879:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x31399394250567ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78093 expref: 14 pid: 9586 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.201906:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.201923:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967308059776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.201929:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6484 00000100:00100000:0.0:1746147145.201971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.201983:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308059904 00000100:00100000:0.0:1746147145.201986:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308059904 00010000:00010000:0.0:1746147145.201999:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 16 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.202299:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310710272:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.202316:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147145.203317:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6485 00000100:00100000:0.0:1746147145.203328:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308059904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.203340:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.203347:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 16 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.203356:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 16 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.203372:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261c00/0x3139939425056a91 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7821b expref: 16 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.203382:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147145.203387:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147145.203395:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147145.203402:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147145.203799:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.203828:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308059904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 503us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.203834:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6485 00000100:00100000:0.0:1746147145.203946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.203955:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308060032 00000100:00100000:0.0:1746147145.203959:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308060032 00010000:00010000:0.0:1746147145.203973:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 32 pid: 1136 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.203986:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6486 00000100:00100000:0.0:1746147145.203990:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+32:2001:x1830967308060032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.203998:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.204014:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 32 pid: 1136 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.204021:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 32 pid: 1136 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.204033:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425056765 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78054 expref: 32 pid: 1136 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.204042:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.204058:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308060032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.204063:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6486 00000100:00100000:0.0:1746147145.204115:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.204126:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308060160 00000100:00100000:0.0:1746147145.204128:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308060160 00010000:00010000:0.0:1746147145.204140:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.204154:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6487 00000100:00100000:0.0:1746147145.204158:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967308060160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.204165:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.204171:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.204180:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.204191:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250568ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78111 expref: 41 pid: 1398 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.204201:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147145.204203:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147145.204208:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.204215:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.204239:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.204255:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310710528:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147145.204303:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.204417:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310710400:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147145.204433:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.204451:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308059520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4844us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.204458:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6483 00010000:00010000:2.0:1746147145.204499:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147145.204505:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147145.204524:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147145.204652:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425056ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7823e expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.204668:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7823e expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.204674:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.204677:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147145.204679:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715e00, rc 0) 00000100:00100000:2.0:1746147145.204698:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32409:x1830967308059392:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 7486us (7941us total) trans 8589936016 rc 0/0 00000100:00100000:2.0:1746147145.204704:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15320 00000100:00100000:0.0:1746147145.209316:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.209429:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.209501:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.209526:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308060672 00000100:00100000:1.0:1746147145.209535:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308060672 00002000:00100000:1.0:1746147145.209582:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (2076672->2080767) req@ffff88011e486d80 x1830967308060672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.209597:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486d80 with x1830967308060672 ext(2076672->2080767) 00002000:00010000:1.0:1746147145.209603:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e486d80 00000100:00100000:1.0:1746147145.209633:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308060928 00000100:00100000:1.0:1746147145.209635:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308060928 00002000:00100000:1.0:1746147145.209647:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e487480 x1830967308060928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.209654:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487480 with x1830967308060928 ext(2097152->4194303) 00002000:00010000:1.0:1746147145.209659:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487480 00000100:00100000:1.0:1746147145.210353:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3590 00000100:00100000:1.0:1746147145.210362:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308060672:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147145.210395:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310710528:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147145.210414:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.210453:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308060160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6294us (6338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.210462:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6487 00000100:00100000:1.0:1746147145.210481:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308060672:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 120us (1118us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147145.210486:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3590 00002000:00100000:1.0:1746147145.210490:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (2076672->2080767) req@ffff88011e486d80 x1830967308060672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.210496:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486d80 with x1830967308060672 ext(2076672->2080767) 00002000:00010000:1.0:1746147145.210499:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e486d80 00000100:00100000:1.0:1746147145.210507:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3591 00000100:00100000:1.0:1746147145.210511:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308060928:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147145.210558:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308060416 00000100:00100000:3.0:1746147145.210563:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308060416 00000100:00100000:3.0:1746147145.211117:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15321 00000100:00100000:3.0:1746147145.211123:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32409:x1830967308060416:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147145.211140:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.211143:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147145.211167:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056abb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7823e expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.211673:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.211678:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147145.211706:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ac9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78245 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.211802:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211816:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211824:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211835:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211841:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211846:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211852:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147145.211856:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211863:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211870:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.211873:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147145.211875:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211880:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056ad0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.211915:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ac9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78245 expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.211921:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ac9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78245 expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.211927:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:3.0:1746147145.211960:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32409:x1830967308060416:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 837us (2656us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147145.211966:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15321 00000100:00100000:0.0:1746147145.218724:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.219016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.219604:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308061056 00000100:00100000:2.0:1746147145.219613:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308061056 00000100:00100000:3.0:1746147145.220458:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308061312 00000100:00100000:3.0:1746147145.220464:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308061312 00000100:00100000:3.0:1746147145.220501:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5499 00000100:00100000:3.0:1746147145.220509:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32409:x1830967308061312:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147145.220723:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32409:x1830967308061312:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 214us (1705us total) trans 8589936017 rc 0/0 00000100:00100000:3.0:1746147145.220730:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5499 00000100:00100000:2.0:1746147145.221155:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14775 00000100:00100000:2.0:1746147145.221165:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32407:x1830967308061056:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.221177:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.221196:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7824c expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.221224:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.221232:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.221239:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.221250:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.221252:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.221255:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->1564671] (req 1048576->1564671) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.221284:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.221295:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 29 pid: 10340 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.221306:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710656:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.221367:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.221375:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.221383:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710784:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.221405:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.221413:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 12 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.221425:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710912:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.221441:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.229413:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.229491:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.229496:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710656:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.229508:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710784:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.229519:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310710912:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.229550:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->1564671] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.229654:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260e00, rc 0) 00000100:00100000:2.0:1746147145.229696:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32407:x1830967308061056:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8533us (10982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.229704:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14775 00000100:00100000:0.0:1746147145.229762:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308061440 00000100:00100000:0.0:1746147145.229768:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308061440 00010000:00010000:0.0:1746147145.229795:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.229821:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308061696 00000100:00100000:0.0:1746147145.229823:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308061696 00010000:00010000:0.0:1746147145.229835:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 13 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.229849:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6488 00000100:00100000:0.0:1746147145.229856:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967308061440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.229868:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.229896:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.229912:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147145.229935:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x31399394250568d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78118 expref: 43 pid: 1398 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147145.229950:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6489 00010000:00010000:0.0:1746147145.229950:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.229956:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308061696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.229964:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147145.229969:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308061440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 114us (568us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147145.229973:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 13 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.229975:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6488 00010000:00010000:1.0:1746147145.229980:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 13 pid: 9585 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.229992:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250567b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7809a expref: 13 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147145.230132:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.230495:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308061568 00000100:00100000:2.0:1746147145.230499:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308061568 00010000:00010000:2.0:1746147145.230512:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 30 pid: 10340 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.230529:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6490 00000100:00100000:2.0:1746147145.230534:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308061568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.230542:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.230549:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 30 pid: 10340 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.230563:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 30 pid: 10340 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.230575:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x31399394250567f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780bd expref: 30 pid: 10340 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.230594:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.230596:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.230603:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.230611:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.230637:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.230649:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310711040:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147145.230798:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308060928:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 20284us (21295us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147145.230806:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3591 00010000:00010000:1.0:1746147145.230811:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746147145.230815:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011e487480 x1830967308060928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147145.230823:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487480 with x1830967308060928 ext(2097152->4194303) 00002000:00010000:0.0:1746147145.230827:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487480 00000100:00100000:2.0:1746147145.230862:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.230992:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308061696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1036us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.230999:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6489 00000100:00100000:2.0:1746147145.233647:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310711040:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147145.233670:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.233719:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308061568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3182us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.233730:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6490 00000100:00100000:0.0:1746147145.236780:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.236839:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308061952 00000100:00100000:2.0:1746147145.236849:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308061952 00002000:00100000:2.0:1746147145.236907:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1560576->1564671) req@ffff88011db15880 x1830967308061952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.236918:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15880 with x1830967308061952 ext(1560576->1564671) 00002000:00010000:2.0:1746147145.236923:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15880 00000100:00100000:2.0:1746147145.236956:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3592 00000100:00100000:2.0:1746147145.236964:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308061952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147145.237140:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308061952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 175us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147145.237147:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3592 00002000:00100000:2.0:1746147145.237152:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1560576->1564671) req@ffff88011db15880 x1830967308061952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.237158:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15880 with x1830967308061952 ext(1560576->1564671) 00002000:00010000:2.0:1746147145.237160:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15880 00000100:00100000:0.0:1746147145.242941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.243194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.243258:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308062464 00000100:00100000:3.0:1746147145.243268:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308062464 00000100:00100000:2.0:1746147145.243283:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308062208 00000100:00100000:2.0:1746147145.243287:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308062208 00000100:00100000:3.0:1746147145.243317:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5500 00002000:00100000:2.0:1746147145.243319:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88011db14700 x1830967308062208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147145.243325:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32407:x1830967308062464:12345-192.168.204.25@tcp:35:multiop.0 00002000:00100000:2.0:1746147145.243329:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967308062208 ext(4194304->4919295) 00002000:00010000:2.0:1746147145.243335:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14700 00000100:00100000:2.0:1746147145.243347:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3593 00000100:00100000:2.0:1746147145.243351:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308062208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147145.243538:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32407:x1830967308062464:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 213us (345us total) trans 8589936018 rc 0/0 00000100:00100000:3.0:1746147145.243546:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5500 00000100:00100000:0.0:1746147145.252072:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.252161:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308062720 00000100:00100000:3.0:1746147145.252171:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308062720 00000100:00100000:2.0:1746147145.252226:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308062208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8871us (9294us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147145.252240:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3593 00002000:00100000:2.0:1746147145.252251:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88011db14700 x1830967308062208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.252260:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967308062208 ext(4194304->4919295) 00002000:00010000:2.0:1746147145.252265:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14700 00000100:00100000:3.0:1746147145.252336:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15322 00000100:00100000:3.0:1746147145.252345:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:32414:x1830967308062720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.252367:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.252385:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425056ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78253 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.252466:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252479:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252490:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252508:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252513:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252518:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252623:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252633:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252639:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147145.252678:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147145.252763:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252769:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252774:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252779:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252783:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147145.252786:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252791:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252800:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147145.252803:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147145.252806:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252810:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425056ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252831:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252836:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252844:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252848:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147145.252850:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252854:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252860:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1900) 00010000:00010000:3.0:1746147145.252862:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147145.252864:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252872:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714a00/0x3139939425056aec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147145.252917:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425056ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 20 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.252928:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 19 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.252934:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.252935:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147145.252937:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715e00, rc 0) 00000100:00100000:3.0:1746147145.253154:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:32414:x1830967308062720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 809us (1093us total) trans 8589936019 rc 0/0 00000100:00100000:3.0:1746147145.253159:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15322 00000100:00100000:0.0:1746147145.256520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.256571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.256639:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308062976 00000100:00100000:3.0:1746147145.256649:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308062976 00000100:00100000:2.0:1746147145.256651:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308063232 00000100:00100000:2.0:1746147145.256655:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308063232 00000100:00100000:2.0:1746147145.256703:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5501 00000100:00100000:3.0:1746147145.256708:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5502 00000100:00100000:2.0:1746147145.256711:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32403:x1830967308063232:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147145.256712:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:32414:x1830967308062976:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147145.257459:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32414:x1830967308062976:12345-192.168.204.25@tcp:35:cat.0 Request processed in 744us (948us total) trans 8589936021 rc 0/0 00000100:00100000:3.0:1746147145.257467:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5502 00000100:00100000:2.0:1746147145.257601:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32403:x1830967308063232:12345-192.168.204.25@tcp:35:cat.0 Request processed in 890us (1027us total) trans 8589936020 rc 0/0 00000100:00100000:2.0:1746147145.257607:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5501 00000100:00100000:0.0:1746147145.260738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.261950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.261966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.262071:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.262128:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308063360 00000100:00100000:0.0:1746147145.262137:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308063360 00000100:00100000:0.0:1746147145.262192:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308063488 00000100:00100000:0.0:1746147145.262195:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308063488 00000100:00100000:0.0:1746147145.262207:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308063744 00000100:00100000:0.0:1746147145.262209:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308063744 00000100:00100000:2.0:1746147145.262213:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308063616 00000100:00100000:2.0:1746147145.262219:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308063616 00000100:00100000:0.0:1746147145.262224:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14776 00000100:00100000:0.0:1746147145.262232:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308063360:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147145.262244:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14777 00000100:00100000:2.0:1746147145.262249:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308063488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147145.262251:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.262256:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147145.262269:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425056b08 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7825a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.262270:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425056b01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78261 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.262318:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310711168:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147145.262318:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310711296:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147145.262408:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.262431:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14778 00000100:00100000:2.0:1746147145.262437:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308063744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.262443:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.262450:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7826f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.262462:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.262464:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.262472:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 34 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.262488:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 34 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.262498:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261400, rc 0) 00000100:00100000:2.0:1746147145.262522:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+34:2001:x1830967308063744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 85us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.262528:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14778 00000100:00100000:2.0:1746147145.262544:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14779 00000100:00100000:2.0:1746147145.262549:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308063616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.262557:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.262567:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78268 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.262579:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.262580:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.262584:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.262593:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.262601:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260200, rc 0) 00000100:00100000:2.0:1746147145.262614:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308063616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.262619:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14779 00000100:00100000:0.0:1746147145.263732:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2300 going to sleep for 11 seconds 00002000:00010000:3.0:1746147145.265238:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147144 -> 1746147145 00002000:00010000:3.0:1746147145.265243:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147144 -> 1746147145 00002000:00010000:3.0:1746147145.265245:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147144 -> 1746147145 00002000:00010000:0.0:1746147145.265261:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746147144 -> 1746147145 00002000:00010000:0.0:1746147145.265265:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147144 -> 1746147145 00002000:00010000:0.0:1746147145.265267:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746147144 -> 1746147145 00000100:00100000:3.0:1746147145.265268:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310711168:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147145.265276:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310711296:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147145.265296:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425056b01 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78261 expref: 33 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.265296:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425056b08 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7825a expref: 33 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.265310:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425056b01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78261 expref: 33 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.265310:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097035400/0x3139939425056b08 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7825a expref: 33 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.265319:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261200, rc 0) 00010000:00010000:0.0:1746147145.265326:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097035400, rc 0) 00000100:00100000:3.0:1746147145.265350:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308063488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3100us (3402us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147145.265350:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308063360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3117us (4620us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147145.265357:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14776 00000100:00100000:3.0:1746147145.265631:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14777 00000100:00100000:0.0:1746147145.269025:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.269274:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308063872 00000100:00100000:3.0:1746147145.269284:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308063872 00000100:00100000:3.0:1746147145.269344:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14780 00000100:00100000:3.0:1746147145.269353:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+30:32414:x1830967308063872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.269373:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.269396:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78276 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.269427:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 39 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.269435:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.269437:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.269440:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.269478:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 39 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.269491:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 39 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.269503:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310711424:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.269603:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.271644:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310711424:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.271681:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.271697:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714200, rc 0) 00000100:00100000:3.0:1746147145.273248:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+31:32414:x1830967308063872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3890us (4230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.273259:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14780 00000100:00100000:0.0:1746147145.273503:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.273634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.273665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.273686:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064256 00000100:00100000:0.0:1746147145.273692:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064256 00000100:00100000:0.0:1746147145.273745:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064128 00000100:00100000:0.0:1746147145.273747:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064128 00000100:00100000:0.0:1746147145.273766:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 864 00000100:00100000:0.0:1746147145.273773:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967308064256:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147145.273825:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967308064256:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.273831:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 864 00000100:00100000:0.0:1746147145.273843:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 865 00000100:00100000:0.0:1746147145.273848:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2000:x1830967308064128:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147145.273871:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2000:x1830967308064128:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 22us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.273876:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 865 00000100:00100000:0.0:1746147145.273926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.273939:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064384 00000100:00100000:0.0:1746147145.273943:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064384 00000100:00100000:0.0:1746147145.273961:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 866 00000100:00100000:0.0:1746147145.273965:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2000:x1830967308064384:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147145.273986:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2000:x1830967308064384:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 20us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.273991:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 866 00000100:00080000:3.0:1746147145.274141:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147145.274268:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064000 00000100:00100000:2.0:1746147145.274272:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064000 00000100:00100000:2.0:1746147145.274299:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 184 00000100:00100000:2.0:1746147145.274304:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2000:x1830967308064000:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147145.274332:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2000:x1830967308064000:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 28us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.274337:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 184 00000100:00100000:0.0:1746147145.274834:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.274900:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064512 00000100:00100000:2.0:1746147145.274903:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064512 00002000:00100000:2.0:1746147145.274930:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (2076672->2097151) req@ffff880094187100 x1830967308064512/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.274941:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187100 with x1830967308064512 ext(2076672->2097151) 00010000:00010000:2.0:1746147145.274949:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 40 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.274963:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 40 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.274970:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094187100 00000100:00100000:2.0:1746147145.274981:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1132 00000100:00100000:2.0:1746147145.274986:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308064512:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147145.278339:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308064512:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3342us (3496us total) trans 21474841511 rc 0/0 00000100:00100000:2.0:1746147145.278351:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1132 00002000:00100000:2.0:1746147145.278361:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (2076672->2097151) req@ffff880094187100 x1830967308064512/t21474841511(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.278370:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187100 with x1830967308064512 ext(2076672->2097151) 00010000:00010000:2.0:1746147145.278378:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.278394:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.278401:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094187100 00000100:00100000:0.0:1746147145.282349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.285038:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064640 00000100:00100000:2.0:1746147145.285055:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064640 00010000:00010000:2.0:1746147145.285146:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.285201:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6491 00000100:00100000:2.0:1746147145.285212:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308064640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.285228:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.285252:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.285271:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.285295:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260600/0x3139939425056aad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78237 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.285318:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.285320:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.285328:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.285335:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.285372:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.285383:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310711552:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147145.285487:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.289309:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.289385:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308064896 00000100:00100000:3.0:1746147145.289398:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308064896 00002000:00100000:3.0:1746147145.289451:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094184380 x1830967308064896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147145.289457:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310711552:192.168.204.25@tcp:105: 00002000:00100000:3.0:1746147145.289461:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184380 with x1830967308064896 ext(1048576->2097151) 00002000:00010000:3.0:1746147145.289466:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184380 00010000:00010000:2.0:1746147145.289478:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.289503:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3594 00000100:00100000:3.0:1746147145.289513:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308064896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147145.289523:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308064640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4312us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.289532:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6491 00000100:00100000:3.0:1746147145.297785:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308064896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8260us (8474us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147145.297798:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3594 00002000:00100000:3.0:1746147145.297811:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880094184380 x1830967308064896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.297821:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184380 with x1830967308064896 ext(1048576->2097151) 00002000:00010000:3.0:1746147145.297827:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184380 00000100:00100000:0.0:1746147145.317272:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.317386:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308065024 00000100:00100000:3.0:1746147145.317397:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308065024 00000100:00100000:3.0:1746147145.317447:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14781 00000100:00100000:3.0:1746147145.317456:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+31:32414:x1830967308065024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.317477:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.317500:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7827d expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.317531:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.317539:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.317541:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.317544:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.317574:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.317587:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 40 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.317598:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310711680:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.317705:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.319545:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310711680:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.319579:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.319595:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714c00, rc 0) 00000100:00100000:3.0:1746147145.319635:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+32:32414:x1830967308065024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2179us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.319644:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14781 00000100:00100000:0.0:1746147145.321839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.322316:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308065152 00000100:00100000:3.0:1746147145.322325:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308065152 00002000:00100000:3.0:1746147145.322370:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1564671) req@ffff880094184000 x1830967308065152/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.322385:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184000 with x1830967308065152 ext(1048576->1564671) 00010000:00010000:3.0:1746147145.322395:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 41 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.322409:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 41 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.322416:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094184000 00000100:00100000:3.0:1746147145.322808:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1133 00000100:00100000:3.0:1746147145.322816:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308065152:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147145.323131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.323200:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308065408 00000100:00100000:2.0:1746147145.323205:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308065408 00000100:00100000:2.0:1746147145.323243:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15323 00000100:00100000:2.0:1746147145.323250:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32418:x1830967308065408:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.323272:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.323291:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261200/0x3139939425056b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78284 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.323390:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.323405:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 21 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.323413:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.323443:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 21 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.323453:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 21 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.323465:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310711808:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.323557:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.329071:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.329143:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308065536 00000100:00100000:2.0:1746147145.329150:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308065536 00010000:00010000:2.0:1746147145.329182:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 22 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.329225:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6492 00000100:00100000:2.0:1746147145.329231:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308065536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.329242:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.329247:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 22 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.329255:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 22 pid: 9138 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.329272:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.329276:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.329284:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.329290:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.329303:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.329341:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308065536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.329346:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6492 00010000:00010000:3.0:1746147145.331067:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425056af3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78253 expref: 21 pid: 9138 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.331115:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310711808:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.331136:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147145.331145:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147145.331151:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147145.331171:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147145.331304:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261200/0x3139939425056b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 22 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.331321:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 21 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.331329:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.331332:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147145.331335:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260a00, rc 0) 00000100:00100000:3.0:1746147145.331381:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:32418:x1830967308065408:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8130us (8249us total) trans 8589936022 rc 0/0 00000100:00100000:3.0:1746147145.331389:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15323 00000100:00100000:2.0:1746147145.333416:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308065152:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10590us (11574us total) trans 21474841512 rc 0/0 00000100:00100000:2.0:1746147145.333428:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1133 00002000:00100000:2.0:1746147145.333438:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1564671) req@ffff880094184000 x1830967308065152/t21474841512(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.333447:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184000 with x1830967308065152 ext(1048576->1564671) 00010000:00010000:2.0:1746147145.333456:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.333468:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.333474:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094184000 00000100:00100000:0.0:1746147145.336709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.336806:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308065664 00000100:00100000:2.0:1746147145.336814:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308065664 00010000:00010000:2.0:1746147145.336847:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.336880:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6493 00000100:00100000:2.0:1746147145.336899:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308065664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.336912:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.337216:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.337228:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.337840:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260e00/0x3139939425056ad7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7824c expref: 43 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.337872:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.337874:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.337881:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.337899:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.338263:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 31 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.338274:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310711936:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147145.338356:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.346835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.346916:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308065920 00000100:00100000:3.0:1746147145.346929:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308065920 00002000:00100000:3.0:1746147145.346978:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801349a1c00 x1830967308065920/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.346989:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1c00 with x1830967308065920 ext(1048576->2097151) 00002000:00010000:3.0:1746147145.346995:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a1c00 00000100:00100000:3.0:1746147145.347026:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3595 00000100:00100000:3.0:1746147145.347035:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2001:x1830967308065920:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147145.347681:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310711936:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147145.347697:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.347733:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308065664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10847us (11029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.347741:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6493 00000100:00100000:3.0:1746147145.353391:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310712064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746147145.353464:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147145.353551:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310712064 00000100:00100000:2.0:1746147145.353560:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310712064 00000100:00100000:2.0:1746147145.353620:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1746147145.353628:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310712064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746147145.353654:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1173300288 pending 6230016 free 3904991232 avail 3673468928 00000100:00100000:2.0:1746147145.353698:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310712064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.353705:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1746147145.353746:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310712064:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1746147145.353815:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147145.360440:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2001:x1830967308065920:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13267us (13473us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147145.360450:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3595 00002000:00100000:3.0:1746147145.360462:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801349a1c00 x1830967308065920/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.360472:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1c00 with x1830967308065920 ext(1048576->2097151) 00002000:00010000:3.0:1746147145.360478:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a1c00 00000100:00100000:2.0:1746147145.383074:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.383197:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308066432 00000100:00100000:3.0:1746147145.383206:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308066432 00002000:00100000:3.0:1746147145.383253:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098c72680 x1830967308066432/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.383264:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72680 with x1830967308066432 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.383270:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c72680 00000100:00100000:0.0:1746147145.383315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.384113:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.384144:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308066688 00000100:00100000:0.0:1746147145.384147:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308066688 00000100:00100000:3.0:1746147145.384167:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3596 00002000:00100000:0.0:1746147145.384170:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a1180 x1830967308066688/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147145.384176:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308066432:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:0.0:1746147145.384178:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1180 with x1830967308066688 ext(2097152->4194303) 00002000:00010000:0.0:1746147145.384181:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a1180 00000100:00100000:2.0:1746147145.384407:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308066176 00000100:00100000:2.0:1746147145.384419:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308066176 00000100:00100000:2.0:1746147145.384480:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15324 00000100:00100000:2.0:1746147145.384488:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32420:x1830967308066176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.384508:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.384525:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425056b40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7828b expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.384600:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384612:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384620:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384631:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384636:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384640:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384716:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425056b55 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384726:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425056b55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384734:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425056b55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147145.384741:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:0.0:1746147145.384784:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3597 00000100:00100000:0.0:1746147145.384791:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967308066688:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:2.0:1746147145.384805:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384811:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384815:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384820:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384825:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974a6000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.384828:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384833:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384841:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147145.384844:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.384847:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384851:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x3139939425056b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384869:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384876:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384879:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384882:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974a7c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.384896:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384901:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384906:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553100) 00010000:00010000:2.0:1746147145.384908:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.384909:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384913:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425056b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.384942:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425056b40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7828b expref: 40 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.384951:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425056b55 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7828b expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.384957:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.384959:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147145.384961:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6800, rc 0) 00000100:00100000:2.0:1746147145.385012:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32420:x1830967308066176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 525us (2021us total) trans 8589936023 rc 0/0 00000100:00100000:2.0:1746147145.385019:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15324 00000100:00100000:0.0:1746147145.392252:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.392295:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308066816 00000100:00100000:0.0:1746147145.392306:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308066816 00000100:00100000:3.0:1746147145.393016:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 817 00000100:00100000:3.0:1746147145.393028:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308066816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.393043:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.393072:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425056b55 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7828b expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.393110:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.393115:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.393158:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967308066816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 132us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.393165:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 817 00000100:00100000:0.0:1746147145.396666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.397442:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308066944 00000100:00100000:3.0:1746147145.397452:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308066944 00000100:00100000:3.0:1746147145.397496:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14782 00000100:00100000:3.0:1746147145.397506:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32420:x1830967308066944:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147145.397526:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.397545:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78292 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.397573:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.397582:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 33 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.397588:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.397590:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.397594:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->3547135] (req 3436544->3547135) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 43 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.397626:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 33 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.397637:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 33 pid: 9584 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746147145.397650:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310712192:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.397752:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.398867:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 43 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.398879:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310712320:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.398940:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.400036:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308066432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15857us (16959us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147145.400046:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3596 00002000:00100000:3.0:1746147145.400057:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098c72680 x1830967308066432/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.400066:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72680 with x1830967308066432 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.400071:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c72680 00000100:00100000:3.0:1746147145.407387:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310712192:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.408738:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967308066688:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23941us (24619us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147145.408751:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3597 00002000:00100000:1.0:1746147145.408764:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801349a1180 x1830967308066688/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.408774:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1180 with x1830967308066688 ext(2097152->4194303) 00010000:00010000:1.0:1746147145.408786:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 32 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.408800:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 32 pid: 9584 timeout: 783 lvb_type: 1 00002000:00010000:1.0:1746147145.408807:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a1180 00000100:00100000:0.0:1746147145.409917:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.409958:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310712320:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.410020:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308067072 00000100:00100000:1.0:1746147145.410027:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308067072 00000100:00100000:0.0:1746147145.410030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.410061:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308067200 00000100:00100000:1.0:1746147145.410063:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14783 00000100:00100000:0.0:1746147145.410063:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308067200 00000100:00100000:1.0:1746147145.410069:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+32:32414:x1830967308067072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147145.410081:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 44 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.410086:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147145.410123:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6494 00010000:00010000:1.0:1746147145.410126:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78299 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.410128:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967308067200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.410139:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.410150:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.410151:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.410226:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.410243:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 44 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.410244:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.410249:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [3436544->3547135] (req 3436544->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.410253:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 44 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.410268:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x3139939425056a75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78214 expref: 44 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.410270:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00010000:00010000:1.0:1746147145.410271:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563400, rc 0) 00010000:00010000:0.0:1746147145.410282:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.410308:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+33:32414:x1830967308067072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 238us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.410308:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308067200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 180us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.410312:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32420:x1830967308066944:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12805us (13653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.410313:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14783 00000100:00100000:0.0:1746147145.410313:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6494 00000100:00100000:3.0:1746147145.410320:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14782 00000100:00100000:0.0:1746147145.418741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.419039:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308067456 00000100:00100000:1.0:1746147145.419049:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308067456 00002000:00100000:1.0:1746147145.419116:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8801349a3800 x1830967308067456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.419126:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3800 with x1830967308067456 ext(2097152->3145727) 00002000:00010000:1.0:1746147145.419131:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a3800 00000100:00100000:1.0:1746147145.419166:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3598 00000100:00100000:1.0:1746147145.419174:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308067456:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147145.422607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.423290:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308067584 00000100:00100000:2.0:1746147145.423300:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308067584 00010000:00010000:2.0:1746147145.423338:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 35 pid: 9584 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.423384:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6495 00000100:00100000:2.0:1746147145.423393:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+35:2001:x1830967308067584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.423406:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.423424:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 35 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.423437:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 35 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.423461:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x3139939425056b0f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7826f expref: 35 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.423496:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.423499:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.423507:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.423515:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.423556:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.423569:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310712448:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147145.423677:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.426540:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308067456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7351us (7797us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147145.426555:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3598 00002000:00100000:1.0:1746147145.426571:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8801349a3800 x1830967308067456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.426588:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3800 with x1830967308067456 ext(2097152->3145727) 00002000:00010000:1.0:1746147145.426594:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a3800 00000100:00100000:0.0:1746147145.427375:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.427502:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310712448:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147145.427525:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.427553:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308067840 00000100:00100000:1.0:1746147145.427560:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308067840 00000100:00100000:2.0:1746147145.427570:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+32:2001:x1830967308067584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4178us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.427580:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6495 00002000:00100000:1.0:1746147145.427603:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3436544->3440639) req@ffff8801349a0380 x1830967308067840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.427611:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0380 with x1830967308067840 ext(3436544->3440639) 00002000:00010000:1.0:1746147145.427614:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0380 00000100:00100000:1.0:1746147145.427642:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3599 00000100:00100000:1.0:1746147145.427649:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308067840:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147145.427747:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308067840:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 100us (376us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147145.427753:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3599 00002000:00100000:1.0:1746147145.427757:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3436544->3440639) req@ffff8801349a0380 x1830967308067840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.427763:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0380 with x1830967308067840 ext(3436544->3440639) 00002000:00010000:1.0:1746147145.427765:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0380 00000100:00100000:0.0:1746147145.430628:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.430732:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308068096 00000100:00100000:1.0:1746147145.430742:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308068096 00002000:00100000:1.0:1746147145.430790:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3543040->3547135) req@ffff88009f086d80 x1830967308068096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.430799:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086d80 with x1830967308068096 ext(3543040->3547135) 00002000:00010000:1.0:1746147145.430805:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f086d80 00000100:00100000:1.0:1746147145.430843:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3600 00000100:00100000:1.0:1746147145.430851:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308068096:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147145.431032:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308068096:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 182us (414us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147145.431038:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3600 00002000:00100000:1.0:1746147145.431044:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3543040->3547135) req@ffff88009f086d80 x1830967308068096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.431050:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086d80 with x1830967308068096 ext(3543040->3547135) 00002000:00010000:1.0:1746147145.431053:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f086d80 00000100:00100000:0.0:1746147145.437186:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.437260:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.437388:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308068224 00000100:00100000:3.0:1746147145.437398:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308068224 00000100:00100000:3.0:1746147145.437451:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14784 00000100:00100000:3.0:1746147145.437460:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+32:32414:x1830967308068224:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147145.437511:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308068480 00000100:00100000:2.0:1746147145.437516:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308068480 00000100:00100000:2.0:1746147145.437549:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5503 00000100:00100000:2.0:1746147145.437554:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32420:x1830967308068480:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147145.437769:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32420:x1830967308068480:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 213us (507us total) trans 8589936024 rc 0/0 00000100:00100000:2.0:1746147145.437776:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5503 00010000:00010000:3.0:1746147145.437865:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.437896:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782a0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.437925:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.437934:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.437936:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.437939:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 33 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.437968:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 41 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.437980:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 41 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.437992:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310712576:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.438052:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.445032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.445139:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308068608 00000100:00100000:1.0:1746147145.445149:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308068608 00002000:00100000:1.0:1746147145.445200:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3436544->3547135) req@ffff880098e13480 x1830967308068608/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.445209:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e13480 with x1830967308068608 ext(3436544->3547135) 00010000:00010000:1.0:1746147145.445220:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.445236:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 42 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746147145.445242:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098e13480 00000100:00100000:1.0:1746147145.445275:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1134 00000100:00100000:1.0:1746147145.445284:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308068608:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147145.446064:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310712576:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.446119:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 33 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.446135:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447400, rc 0) 00000100:00100000:3.0:1746147145.446165:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+33:32414:x1830967308068224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8705us (8990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.446174:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14784 00000100:00100000:1.0:1746147145.451944:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308068608:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6646us (6910us total) trans 21474841513 rc 0/0 00000100:00100000:1.0:1746147145.451961:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1134 00002000:00100000:1.0:1746147145.451976:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3436544->3547135) req@ffff880098e13480 x1830967308068608/t21474841513(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.451986:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e13480 with x1830967308068608 ext(3436544->3547135) 00010000:00010000:1.0:1746147145.451999:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.452018:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746147145.452026:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098e13480 00000100:00100000:0.0:1746147145.458742:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.458847:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308068736 00000100:00100000:2.0:1746147145.458857:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308068736 00010000:00010000:2.0:1746147145.458909:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.458945:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6496 00000100:00100000:2.0:1746147145.458955:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308068736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.458973:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.458998:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.459012:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.459039:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425056b63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3436544->18446744073709551615] (req 3436544->3547135) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78292 expref: 44 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.459078:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.459080:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.459109:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.459118:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.459153:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.459167:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310712704:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147145.459256:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.462913:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310712704:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147145.462938:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.464247:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308068736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5289us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.464260:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6496 00000100:00100000:0.0:1746147145.465588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.466013:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308068992 00000100:00100000:1.0:1746147145.466021:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308068992 00002000:00100000:1.0:1746147145.466071:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880094528700 x1830967308068992/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.466081:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528700 with x1830967308068992 ext(3145728->4194303) 00002000:00010000:1.0:1746147145.466116:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094528700 00000100:00100000:1.0:1746147145.466276:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3601 00000100:00100000:1.0:1746147145.466285:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308068992:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147145.474985:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308068992:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8686us (9387us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147145.474999:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3601 00002000:00100000:1.0:1746147145.475012:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880094528700 x1830967308068992/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.475028:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094528700 with x1830967308068992 ext(3145728->4194303) 00002000:00010000:1.0:1746147145.475047:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094528700 00000100:00100000:0.0:1746147145.476522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.478820:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308069248 00000100:00100000:2.0:1746147145.478836:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308069248 00000100:00100000:2.0:1746147145.478913:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15325 00000100:00100000:2.0:1746147145.478924:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32424:x1830967308069248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.478952:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.478977:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425056b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782a7 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.479057:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479071:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479082:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479108:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479114:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479120:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479209:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x3139939425056b8d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479218:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x3139939425056b8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479224:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x3139939425056b8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147145.479232:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147145.479297:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479302:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479308:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479313:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479318:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.479863:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479871:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479882:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147145.479897:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.479900:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479905:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x3139939425056b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479926:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479933:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479937:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479940:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.479941:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479944:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479949:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553300) 00010000:00010000:2.0:1746147145.479950:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.479952:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479955:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x3139939425056b86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.479990:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425056b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a7 expref: 42 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.480000:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x3139939425056b8d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a7 expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.480006:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.480007:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147145.480009:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57400, rc 0) 00000100:00100000:2.0:1746147145.480077:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32424:x1830967308069248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1155us (3563us total) trans 8589936025 rc 0/0 00000100:00100000:2.0:1746147145.480083:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15325 00000100:00100000:0.0:1746147145.484139:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.484241:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.484535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.484788:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308069888 00000100:00100000:2.0:1746147145.484798:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308069888 00000100:00100000:2.0:1746147145.484926:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 818 00000100:00100000:2.0:1746147145.484936:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308069888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147145.484940:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308069504 00000100:00100000:1.0:1746147145.484945:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308069504 00010000:00010000:2.0:1746147145.484952:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746147145.484979:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88013486ad80 x1830967308069504/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147145.484980:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x3139939425056b8d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a7 expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147145.484989:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486ad80 with x1830967308069504 ext(4194304->4919295) 00002000:00010000:1.0:1746147145.484993:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013486ad80 00010000:00010000:2.0:1746147145.484996:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.485001:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.485010:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3602 00000100:00100000:1.0:1746147145.485015:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308069504:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147145.485144:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308069632 00000100:00100000:3.0:1746147145.485149:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308069632 00000100:00100000:3.0:1746147145.485183:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14785 00000100:00100000:3.0:1746147145.485188:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308069632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.485198:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.485214:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782ae expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.485233:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.485235:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.485244:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 44 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.485257:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 44 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.485266:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447200, rc 0) 00000100:00100000:2.0:1746147145.485588:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308069888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 651us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.485590:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967308069632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 400us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.485595:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 818 00000100:00100000:3.0:1746147145.485596:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14785 00000100:00100000:0.0:1746147145.485920:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.486362:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070016 00000100:00100000:2.0:1746147145.486366:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070016 00000100:00100000:2.0:1746147145.486394:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14786 00000100:00100000:2.0:1746147145.486400:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308070016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.486410:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.486422:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782c3 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.486437:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.486439:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.486444:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 45 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.486461:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 45 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.486471:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56c00, rc 0) 00000100:00100000:2.0:1746147145.486497:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308070016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 96us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.486502:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14786 00000100:00100000:0.0:1746147145.486707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.486743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.486753:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308069760 00000100:00100000:3.0:1746147145.486757:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308069760 00000100:00100000:3.0:1746147145.486774:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070144 00000100:00100000:3.0:1746147145.486776:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070144 00000100:00100000:3.0:1746147145.486789:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14787 00000100:00100000:3.0:1746147145.486794:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967308069760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.486802:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.486809:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782b5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.486820:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.486822:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.486826:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 46 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.486836:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 46 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.486843:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447a00, rc 0) 00000100:00100000:2.0:1746147145.486911:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14788 00000100:00100000:2.0:1746147145.486918:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+24:32418:x1830967308070144:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.486927:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.486937:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782bc expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.486954:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.486964:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.486971:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 44 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.486976:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.486978:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.486981:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.487010:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 44 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.487023:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 44 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.487035:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310712832:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.487246:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308069760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 451us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.487252:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14787 00010000:00010000:2.0:1746147145.488251:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.488262:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 15 pid: 1853 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.488273:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310712960:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.488314:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.488322:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 25 pid: 12225 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.488329:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310713088:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.489442:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.494431:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967308069504:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9402us (10176us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147145.494445:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3602 00002000:00100000:1.0:1746147145.494457:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88013486ad80 x1830967308069504/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.494466:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486ad80 with x1830967308069504 ext(4194304->4919295) 00002000:00010000:1.0:1746147145.494472:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013486ad80 00000100:00100000:0.0:1746147145.498351:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.498383:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.498402:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.498407:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310712832:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.498430:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070528 00000100:00100000:3.0:1746147145.498436:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070528 00000100:00100000:0.0:1746147145.498462:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070272 00000100:00100000:0.0:1746147145.498465:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070272 00000100:00100000:3.0:1746147145.498473:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14789 00000100:00100000:3.0:1746147145.498479:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32424:x1830967308070528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147145.498489:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 16 pid: 1853 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.498496:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.498512:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782ca expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.498514:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070400 00000100:00100000:0.0:1746147145.498517:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070400 00010000:00010000:0.0:1746147145.498527:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 47 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.498535:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.498541:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.498543:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6497 00010000:00010000:3.0:1746147145.498547:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746147145.498548:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308070272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.498550:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.498560:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.498583:0:1853:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x60000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.498586:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 16 pid: 1853 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.498594:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.498596:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 16 pid: 1853 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.498834:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6498 00000100:00100000:2.0:1746147145.498842:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967308070400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.498850:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.500307:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446200, rc 0) 00000100:00100000:3.0:1746147145.500368:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32424:x1830967308070528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1886us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.500376:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14789 00010000:00010000:3.0:1746147145.500422:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x3139939425056a98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78222 expref: 16 pid: 1853 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.500480:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.500497:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.500520:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425056a21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781e3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.500536:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.500564:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308070400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1722us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.500570:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6498 00000100:00100000:2.0:1746147145.500659:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.500677:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070656 00000100:00100000:2.0:1746147145.500682:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070656 00010000:00010000:2.0:1746147145.500704:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 24 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.500769:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.500789:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308070272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2240us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.500795:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6497 00000100:00100000:3.0:1746147145.500921:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310712960:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.500936:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310713088:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.500963:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.500974:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56e00, rc 0) 00000100:00100000:3.0:1746147145.500990:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+24:32418:x1830967308070144:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 14073us (14247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.500996:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14788 00000100:00100000:1.0:1746147145.501318:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6499 00000100:00100000:1.0:1746147145.501329:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967308070656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.501340:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.501355:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 23 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.501370:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 23 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.501382:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a3800/0x31399394250569e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781c7 expref: 23 pid: 12225 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.501395:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.501397:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.501403:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.501411:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.501441:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.501452:0:7226:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.501463:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310713344:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147145.501510:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.503307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.505346:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308070784 00000100:00100000:3.0:1746147145.505360:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308070784 00000100:00100000:3.0:1746147145.505416:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14790 00000100:00100000:3.0:1746147145.505425:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308070784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.505446:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.505465:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098446c00/0x3139939425056bbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782d1 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.505522:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310713472:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147145.505628:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.509115:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:3.0:1746147145.509161:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147144 -> 1746147145 00000100:00100000:0.0:1746147145.509163:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308071040 00002000:00010000:3.0:1746147145.509166:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147144 -> 1746147145 00002000:00010000:3.0:1746147145.509168:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147144 -> 1746147145 00000100:00100000:0.0:1746147145.509170:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308071040 00000100:00100000:3.0:1746147145.509191:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310713472:192.168.204.25@tcp:106: 00002000:00100000:0.0:1746147145.509218:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (1015808->1019903) req@ffff8800a5575500 x1830967308071040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147145.509227:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098446c00/0x3139939425056bbe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d1 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746147145.509229:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575500 with x1830967308071040 ext(1015808->1019903) 00010000:00010000:0.0:1746147145.509236:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 25 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.509241:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098446c00/0x3139939425056bbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d1 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.509250:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 24 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.509253:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446c00, rc 0) 00002000:00010000:0.0:1746147145.509257:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5575500 00000100:00100000:0.0:1746147145.509288:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1135 00000100:00100000:0.0:1746147145.509295:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308071040:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147145.509302:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308070784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3878us (6004us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147145.509310:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14790 00000100:00100000:1.0:1746147145.509564:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310713344:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147145.509577:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.509608:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967308070656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8283us (8949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.509616:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6499 00000100:00100000:3.0:1746147145.511127:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967308071040:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1825us (2047us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147145.511136:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1135 00002000:00100000:3.0:1746147145.511144:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (1015808->1019903) req@ffff8800a5575500 x1830967308071040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.511153:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575500 with x1830967308071040 ext(1015808->1019903) 00010000:00010000:3.0:1746147145.511160:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.511173:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.511180:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5575500 00000100:00100000:0.0:1746147145.514513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.515819:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308071296 00000100:00100000:3.0:1746147145.515831:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308071296 00000100:00100000:3.0:1746147145.515902:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14791 00000100:00100000:3.0:1746147145.515910:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+33:32418:x1830967308071296:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147145.515933:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.515959:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782d8 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.515990:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.515998:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 45 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.516009:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.516011:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.516014:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.516046:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 45 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.516061:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 45 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746147145.516074:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310713600:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.516212:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.516220:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 34 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.516227:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310713728:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.516247:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.517305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.517365:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308071424 00000100:00100000:3.0:1746147145.517371:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308071424 00002000:00100000:3.0:1746147145.517417:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (1015808->1048575) req@ffff880098c73b80 x1830967308071424/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.517426:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73b80 with x1830967308071424 ext(1015808->1048575) 00010000:00010000:3.0:1746147145.517435:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.517448:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 22 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.517458:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098c73b80 00000100:00100000:3.0:1746147145.517490:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1136 00000100:00100000:3.0:1746147145.517497:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2002:x1830967308071424:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147145.518415:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310713600:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.521726:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.521765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.521789:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308071552 00000100:00100000:1.0:1746147145.521795:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308071552 00000100:00100000:3.0:1746147145.521798:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310713728:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147145.521830:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.521831:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147145.521864:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308071680 00000100:00100000:1.0:1746147145.521866:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308071680 00010000:00010000:1.0:1746147145.521953:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.521971:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6500 00000100:00100000:1.0:1746147145.521978:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308071552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.521991:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.521996:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446000, rc 0) 00010000:00010000:1.0:1746147145.522009:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.522019:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746147145.522025:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6501 00000100:00100000:3.0:1746147145.522032:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2001:x1830967308071680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.522040:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.522041:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447200/0x3139939425056b9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ae expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.522049:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.522058:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.522072:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425056b1d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78276 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.522105:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.522107:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.522114:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.522122:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.522151:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.522162:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310713856:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.522224:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.522243:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+34:32418:x1830967308071296:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6333us (7742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.522249:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14791 00010000:00010000:1.0:1746147145.522610:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.522633:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308071552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 655us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.522638:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6500 00000100:00100000:1.0:1746147145.524930:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308071424:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7422us (7618us total) trans 17179874246 rc 0/0 00000100:00100000:1.0:1746147145.524942:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1136 00002000:00100000:1.0:1746147145.524954:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (1015808->1048575) req@ffff880098c73b80 x1830967308071424/t17179874246(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.524963:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73b80 with x1830967308071424 ext(1015808->1048575) 00010000:00010000:1.0:1746147145.524972:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 24 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.524987:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 24 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746147145.524994:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098c73b80 00000001:00080000:1.0:1746147145.526082:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874245 is committed 00000001:00080000:1.0:1746147145.526112:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874244 is committed 00000001:00080000:1.0:1746147145.526132:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874241 is committed 00000001:00080000:1.0:1746147145.526142:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874238 is committed 00000100:00100000:3.0:1746147145.526657:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310713856:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.526678:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.526728:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308071680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4695us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.526738:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6501 00000100:00100000:0.0:1746147145.530231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.530302:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308071808 00000100:00100000:3.0:1746147145.530311:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308071808 00010000:00010000:3.0:1746147145.530354:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 10 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.530399:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6502 00000100:00100000:3.0:1746147145.530407:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308071808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.530421:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.530441:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 10 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.530453:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 10 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.530476:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425056bb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782bc expref: 10 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.530501:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.530503:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.530510:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.530518:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.530550:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.530562:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310713984:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.530659:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.537322:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310713984:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.537346:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.537408:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967308071808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7000us (7187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.537419:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6502 00000100:00100000:0.0:1746147145.538748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.540954:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308072064 00000100:00100000:1.0:1746147145.540968:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308072064 00002000:00100000:1.0:1746147145.541015:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a5574700 x1830967308072064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.541024:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967308072064 ext(0->1048575) 00002000:00010000:1.0:1746147145.541029:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574700 00000100:00100000:1.0:1746147145.541061:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3603 00000100:00100000:1.0:1746147145.541069:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308072064:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147145.548241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.548559:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308072064:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7488us (9814us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147145.548572:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3603 00002000:00100000:1.0:1746147145.548587:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a5574700 x1830967308072064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.548597:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967308072064 ext(0->1048575) 00002000:00010000:1.0:1746147145.548604:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574700 00000100:00100000:1.0:1746147145.548634:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308072320 00000100:00100000:1.0:1746147145.548642:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308072320 00002000:00100000:1.0:1746147145.548674:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1921024->1925119) req@ffff8800930e9500 x1830967308072320/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.548681:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e9500 with x1830967308072320 ext(1921024->1925119) 00002000:00010000:1.0:1746147145.548684:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e9500 00000100:00100000:1.0:1746147145.548710:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3604 00000100:00100000:1.0:1746147145.548716:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2000:x1830967308072320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147145.548852:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2000:x1830967308072320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 135us (621us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147145.548858:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3604 00002000:00100000:1.0:1746147145.548863:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1921024->1925119) req@ffff8800930e9500 x1830967308072320/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.548869:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e9500 with x1830967308072320 ext(1921024->1925119) 00002000:00010000:1.0:1746147145.548872:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e9500 00000100:00100000:0.0:1746147145.560877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.561761:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308072448 00000100:00100000:3.0:1746147145.561770:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308072448 00000100:00100000:3.0:1746147145.561831:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14792 00000100:00100000:3.0:1746147145.561842:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32424:x1830967308072448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.561863:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.561891:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782df expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.561919:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.561927:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.561929:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.561932:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 46 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.561960:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.561970:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 32 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.561981:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310714112:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.562083:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.567383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.568198:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308072576 00000100:00100000:2.0:1746147145.568208:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308072576 00002000:00100000:2.0:1746147145.568255:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1925119) req@ffff88011da9c380 x1830967308072576/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.568265:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c380 with x1830967308072576 ext(1048576->1925119) 00010000:00010000:2.0:1746147145.568274:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 33 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.568288:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 33 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.568295:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011da9c380 00000100:00100000:2.0:1746147145.568326:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1137 00000100:00100000:2.0:1746147145.568332:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+33:2000:x1830967308072576:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147145.569229:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310714112:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.569259:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 46 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.569276:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6800, rc 0) 00000100:00100000:3.0:1746147145.571394:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32424:x1830967308072448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9540us (10515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.571407:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14792 00000100:00100000:2.0:1746147145.583414:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308072576:12345-192.168.204.25@tcp:4:cat.0 Request processed in 15067us (16029us total) trans 21474841514 rc 0/0 00000100:00100000:2.0:1746147145.583429:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1137 00002000:00100000:2.0:1746147145.583443:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1925119) req@ffff88011da9c380 x1830967308072576/t21474841514(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.583453:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c380 with x1830967308072576 ext(1048576->1925119) 00010000:00010000:2.0:1746147145.583465:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.583481:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.583489:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011da9c380 00000100:00100000:0.0:1746147145.587824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.589498:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308072704 00000100:00100000:3.0:1746147145.589511:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308072704 00010000:00010000:3.0:1746147145.589559:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.589614:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6503 00000100:00100000:3.0:1746147145.589623:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2001:x1830967308072704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.589638:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.589661:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.589675:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.589700:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098446000/0x3139939425056bc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782d8 expref: 35 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.589740:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.589743:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.589751:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 45 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.589759:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 45 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.589794:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 45 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.589814:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310714240:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.589952:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.596567:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310714240:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.596592:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.596734:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:2001:x1830967308072704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7111us (8922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.596746:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6503 00000100:00100000:0.0:1746147145.601199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.601256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.601269:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308072960 00000100:00100000:2.0:1746147145.601278:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308072960 00002000:00100000:2.0:1746147145.601319:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011da9c000 x1830967308072960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.601327:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c000 with x1830967308072960 ext(1048576->2097151) 00002000:00010000:2.0:1746147145.601333:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9c000 00000100:00100000:2.0:1746147145.601348:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308073216 00000100:00100000:2.0:1746147145.601350:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308073216 00002000:00100000:2.0:1746147145.601356:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880099157100 x1830967308073216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.601360:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157100 with x1830967308073216 ext(1048576->2097151) 00002000:00010000:2.0:1746147145.601366:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099157100 00000100:00100000:2.0:1746147145.601408:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3605 00000100:00100000:2.0:1746147145.601414:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967308072960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147145.601598:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3606 00000100:00100000:3.0:1746147145.601606:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967308073216:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147145.615904:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308072960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14465us (14692us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147145.615916:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3605 00002000:00100000:2.0:1746147145.615927:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011da9c000 x1830967308072960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.615938:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c000 with x1830967308072960 ext(1048576->2097151) 00002000:00010000:2.0:1746147145.615945:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9c000 00000100:00100000:3.0:1746147145.617321:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308073216:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15711us (16060us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147145.617330:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3606 00002000:00100000:3.0:1746147145.617337:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880099157100 x1830967308073216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.617346:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157100 with x1830967308073216 ext(1048576->2097151) 00002000:00010000:3.0:1746147145.617350:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099157100 00000100:00100000:0.0:1746147145.638750:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.638836:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308073472 00000100:00100000:3.0:1746147145.638847:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308073472 00000100:00100000:0.0:1746147145.638852:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:3.0:1746147145.638900:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880099155f80 x1830967308073472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147145.638904:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308073728 00000100:00100000:0.0:1746147145.638907:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308073728 00002000:00100000:3.0:1746147145.638910:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155f80 with x1830967308073472 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.638916:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155f80 00000100:00100000:3.0:1746147145.638936:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3607 00000100:00100000:3.0:1746147145.638943:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967308073472:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147145.638950:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15326 00000100:00100000:0.0:1746147145.638956:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:32429:x1830967308073728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147145.638974:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147145.638996:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x3139939425056bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782e6 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.639070:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639082:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639118:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639130:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639137:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639142:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147145.639194:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147145.639244:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639254:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639259:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:0.0:1746147145.639267:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147145.639358:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639364:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639370:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639375:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639380:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147145.639383:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639390:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639404:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147145.639407:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147145.639669:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639676:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1e00/0x3139939425056bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639704:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639708:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639713:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639718:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b0a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147145.639724:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639729:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639736:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801369dd600) 00010000:00010000:0.0:1746147145.639738:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147145.639741:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639745:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x3139939425056be1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147145.639783:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x3139939425056bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 24 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.639794:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 23 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.639801:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147145.639803:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147145.639805:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1200, rc 0) 00000100:00100000:0.0:1746147145.640238:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:32429:x1830967308073728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1281us (1384us total) trans 8589936026 rc 0/0 00000100:00100000:0.0:1746147145.640245:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15326 00000100:00100000:0.0:1746147145.642392:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.642525:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308073984 00000100:00100000:1.0:1746147145.642534:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308073984 00000100:00100000:1.0:1746147145.642583:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5504 00000100:00100000:1.0:1746147145.642594:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:32429:x1830967308073984:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147145.643848:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:32429:x1830967308073984:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1252us (1456us total) trans 8589936027 rc 0/0 00000100:00100000:1.0:1746147145.643856:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5504 00000100:00100000:0.0:1746147145.650203:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.651273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.651630:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308074112 00000100:00100000:3.0:1746147145.651645:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308074112 00000100:00100000:3.0:1746147145.651703:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308074240 00000100:00100000:3.0:1746147145.651705:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308074240 00000100:00100000:3.0:1746147145.651730:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14793 00000100:00100000:3.0:1746147145.651739:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308074112:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147145.651739:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14794 00000100:00100000:2.0:1746147145.651749:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967308074240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147145.651760:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.651760:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.651779:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782ed expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.651780:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782f4 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.651802:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.651802:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.651804:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.651804:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.651812:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.651812:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.651828:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.651828:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.651840:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6a00, rc 0) 00010000:00010000:2.0:1746147145.651840:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542400, rc 0) 00000100:00100000:3.0:1746147145.651901:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308074112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 163us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.651906:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14793 00000100:00100000:2.0:1746147145.652084:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308074240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 336us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.652116:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14794 00000100:00100000:3.0:1746147145.654862:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967308073472:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15908us (16113us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147145.654875:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3607 00002000:00100000:3.0:1746147145.654898:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880099155f80 x1830967308073472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.654907:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155f80 with x1830967308073472 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.654913:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155f80 00000100:00100000:0.0:1746147145.659827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.659950:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308074496 00000100:00100000:3.0:1746147145.659960:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308074496 00002000:00100000:3.0:1746147145.660008:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800984d5180 x1830967308074496/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.660019:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5180 with x1830967308074496 ext(0->1048575) 00002000:00010000:3.0:1746147145.660024:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d5180 00000100:00100000:3.0:1746147145.660291:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3608 00000100:00100000:3.0:1746147145.660301:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967308074496:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147145.660910:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.661268:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308074752 00000100:00100000:2.0:1746147145.661273:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308074752 00002000:00100000:2.0:1746147145.661297:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097094380 x1830967308074752/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.661305:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094380 with x1830967308074752 ext(1048576->2097151) 00002000:00010000:2.0:1746147145.661309:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097094380 00000100:00100000:2.0:1746147145.661337:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3609 00000100:00100000:2.0:1746147145.661342:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308074752:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147145.669265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.669290:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967308074496:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8988us (9471us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147145.669303:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3608 00002000:00100000:3.0:1746147145.669318:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800984d5180 x1830967308074496/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147145.669321:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308075264 00002000:00100000:3.0:1746147145.669329:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5180 with x1830967308074496 ext(0->1048575) 00000100:00100000:1.0:1746147145.669331:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308075264 00002000:00010000:3.0:1746147145.669334:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d5180 00000100:00100000:1.0:1746147145.669373:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5505 00000100:00100000:1.0:1746147145.669380:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32424:x1830967308075264:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147145.669417:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.669525:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308075008 00000100:00100000:0.0:1746147145.669532:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308075008 00000100:00100000:0.0:1746147145.669558:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15327 00000100:00100000:0.0:1746147145.669563:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32431:x1830967308075008:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:1.0:1746147145.669571:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32424:x1830967308075264:12345-192.168.204.25@tcp:35:cat.0 Request processed in 190us (319us total) trans 8589936028 rc 0/0 00000100:00100000:1.0:1746147145.669577:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5505 00010000:00010000:1.0:1746147145.669786:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.669806:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e782fb expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.669863:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.669875:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.669897:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.669908:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.669917:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.669922:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.669994:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64b000/0x3139939425056c19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.670923:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64b000/0x3139939425056c19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.670934:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64b000/0x3139939425056c19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147145.670944:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147145.671001:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671007:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671011:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671017:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671021:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b64aa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.671025:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671031:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671044:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147145.671047:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.671050:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671055:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64aa00/0x3139939425056c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671065:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671070:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671074:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671078:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b64ae00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.671079:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671083:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671104:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006400) 00010000:00010000:1.0:1746147145.671106:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.671109:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671113:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ae00/0x3139939425056c12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.671151:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782fb expref: 44 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.671163:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64b000/0x3139939425056c19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782fb expref: 43 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.671169:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.671171:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147145.671173:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64b000, rc 0) 00000100:00100000:1.0:1746147145.671215:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32431:x1830967308075008:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1650us (1797us total) trans 8589936029 rc 0/0 00000100:00100000:1.0:1746147145.671221:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15327 00000100:00100000:2.0:1746147145.672449:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308074752:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11101us (11533us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147145.672459:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3609 00002000:00100000:2.0:1746147145.672468:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097094380 x1830967308074752/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.672477:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094380 with x1830967308074752 ext(1048576->2097151) 00002000:00010000:2.0:1746147145.672483:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097094380 00000100:00100000:0.0:1746147145.677028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.677071:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.677187:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308075648 00000100:00100000:3.0:1746147145.677197:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308075648 00000100:00100000:1.0:1746147145.677517:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308075520 00000100:00100000:1.0:1746147145.677521:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308075520 00000100:00100000:1.0:1746147145.677555:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15328 00000100:00100000:1.0:1746147145.677563:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:32433:x1830967308075520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147145.677587:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.677608:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78302 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.677701:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677714:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677724:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677737:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677746:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677751:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677849:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425056c3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677859:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425056c3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677865:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425056c3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147145.677873:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147145.677963:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677969:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677973:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677978:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677984:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013128c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.677988:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.677993:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678006:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147145.678009:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.678012:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678017:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013128c000/0x3139939425056c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678028:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678033:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678037:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678041:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a73600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.678044:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678047:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678053:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006d00) 00010000:00010000:1.0:1746147145.678054:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.678056:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678060:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.678304:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78302 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.678319:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425056c3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78302 expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.678326:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.678327:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147145.678329:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c43400, rc 0) 00000100:00100000:3.0:1746147145.678420:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 819 00000100:00100000:3.0:1746147145.678429:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308075648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.678438:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.678451:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64b000/0x3139939425056c19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782fb expref: 43 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.678816:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:1.0:1746147145.678818:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+26:32433:x1830967308075520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1254us (1801us total) trans 8589936030 rc 0/0 00010000:00010000:3.0:1746147145.678819:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.678824:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15328 00000100:00100000:3.0:1746147145.678853:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308075648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 425us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.678859:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 819 00000100:00100000:2.0:1746147145.685428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.685487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.685570:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308075776 00000100:00100000:0.0:1746147145.685570:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076032 00000100:00100000:1.0:1746147145.685579:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308075776 00000100:00100000:0.0:1746147145.685579:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076032 00000100:00100000:1.0:1746147145.685630:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 820 00000100:00100000:0.0:1746147145.685631:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5506 00000100:00100000:1.0:1746147145.685638:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967308075776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147145.685638:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:32433:x1830967308076032:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:1.0:1746147145.685656:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.685682:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425056c3c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78302 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.685700:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.685704:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.686004:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967308075776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 365us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.686010:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:32433:x1830967308076032:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 366us (515us total) trans 8589936031 rc 0/0 00000100:00100000:1.0:1746147145.686013:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 820 00000100:00100000:3.0:1746147145.686018:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5506 00000100:00100000:0.0:1746147145.722611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.723430:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076160 00000100:00100000:0.0:1746147145.723440:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076160 00000100:00100000:0.0:1746147145.723489:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14795 00000100:00100000:0.0:1746147145.723502:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+10:32433:x1830967308076160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147145.723521:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147145.723541:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78309 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.723587:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.723601:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.723608:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.724233:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.724235:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.724241:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2883584->3145727] (req 2883584->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.724275:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.724288:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 9 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147145.724300:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310714368:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147145.724477:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.724486:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147145.724493:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310714496:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147145.725703:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.725716:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 24 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.725724:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310714624:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.725855:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.727143:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310714368:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147145.728130:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.728215:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076288 00000100:00100000:1.0:1746147145.728223:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076288 00010000:00010000:1.0:1746147145.728255:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 10 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147145.728298:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6504 00000100:00100000:1.0:1746147145.728308:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308076288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.728322:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147145.728749:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310714496:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.728758:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310714624:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147145.728805:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 10 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147145.728846:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2883584->3145727] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.728861:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f390c00, rc 0) 00000100:00100000:2.0:1746147145.728924:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+11:32433:x1830967308076160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5427us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.728931:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14795 00010000:00010000:1.0:1746147145.729291:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 10 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.729314:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x3139939425056a9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78229 expref: 10 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.729486:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.729508:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308076288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1202us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.729515:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6504 00000100:00100000:0.0:1746147145.731760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.731846:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076416 00000100:00100000:1.0:1746147145.731854:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076416 00010000:00010000:1.0:1746147145.731899:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 25 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.731956:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6505 00000100:00100000:1.0:1746147145.731967:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308076416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.731984:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.732007:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 25 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.732019:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 25 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.732043:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x3139939425056a44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ff expref: 25 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.732062:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.732187:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308076416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 220us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.732194:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6505 00000100:00100000:0.0:1746147145.734183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.734408:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076544 00000100:00100000:1.0:1746147145.734416:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076544 00010000:00010000:1.0:1746147145.734449:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147145.734492:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6506 00000100:00100000:1.0:1746147145.734500:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967308076544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.734512:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.734531:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.734544:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.734566:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425056b16 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78268 expref: 11 pid: 9584 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746147145.734581:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.734583:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.734590:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.734599:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.734635:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147145.734653:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310714752:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147145.735187:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9626c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.738030:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310714752:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147145.738031:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147145.738053:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.738137:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308076544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3637us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.738140:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076800 00000100:00100000:2.0:1746147145.738148:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076800 00000100:00100000:1.0:1746147145.738148:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6506 00002000:00100000:2.0:1746147145.738196:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2883584->2887679) req@ffff880094524380 x1830967308076800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.738205:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524380 with x1830967308076800 ext(2883584->2887679) 00002000:00010000:2.0:1746147145.738210:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524380 00000100:00100000:2.0:1746147145.738228:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3610 00000100:00100000:2.0:1746147145.738235:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308076800:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147145.738357:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308076800:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 122us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147145.738363:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3610 00002000:00100000:2.0:1746147145.738368:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2883584->2887679) req@ffff880094524380 x1830967308076800/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.738376:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524380 with x1830967308076800 ext(2883584->2887679) 00002000:00010000:2.0:1746147145.738379:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524380 00000100:00100000:0.0:1746147145.744574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.745397:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308076928 00000100:00100000:2.0:1746147145.745409:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308076928 00000100:00100000:2.0:1746147145.745469:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14796 00000100:00100000:2.0:1746147145.745479:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+35:32433:x1830967308076928:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.745502:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.745525:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78310 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.745558:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.745566:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.745572:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 45 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.745579:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.745580:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.745583:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.745620:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 45 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.745638:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 45 pid: 12201 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147145.745652:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310714880:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.746532:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.746542:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 36 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.746552:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310715008:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.746603:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.746610:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.746618:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310715136:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.746637:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.751398:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310714880:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147145.751819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.751853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.751924:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310715008:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.751931:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310715136:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.751968:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.751987:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543c00, rc 0) 00000100:00100000:2.0:1746147145.752031:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+36:32433:x1830967308076928:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6554us (7473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.752041:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14796 00000100:00100000:1.0:1746147145.752125:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308077184 00000100:00100000:1.0:1746147145.752132:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308077184 00010000:00010000:1.0:1746147145.752158:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.752178:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308077056 00000100:00100000:1.0:1746147145.752180:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308077056 00010000:00010000:1.0:1746147145.752187:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 37 pid: 12201 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147145.752199:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6507 00000100:00100000:1.0:1746147145.752205:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+37:2002:x1830967308077184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147145.752208:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6508 00000100:00100000:3.0:1746147145.752216:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2002:x1830967308077056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147145.752219:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.752224:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147145.752236:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 37 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.752238:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 37 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.752246:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 37 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.752261:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 37 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.752598:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x3139939425056b6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78299 expref: 37 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.752605:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447400/0x3139939425056b71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782a0 expref: 37 pid: 12201 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147145.753142:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147145.753311:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308077184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1103us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147145.753322:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6507 00000100:00100000:0.0:1746147145.754257:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.754354:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308077312 00000100:00100000:1.0:1746147145.754361:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308077312 00010000:00010000:1.0:1746147145.754389:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.754481:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.754517:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:2002:x1830967308077056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2301us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.754525:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6508 00000100:00100000:3.0:1746147145.754543:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6509 00000100:00100000:3.0:1746147145.754550:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308077312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.754560:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.754578:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.754590:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.754609:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56c00/0x3139939425056ba2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782c3 expref: 46 pid: 12201 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746147145.754620:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.754622:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.754628:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.754638:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.754671:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.754683:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310715264:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.754743:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.764159:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310715264:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.764183:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.764236:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308077312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9685us (9979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.764246:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6509 00000100:00100000:0.0:1746147145.770835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.771361:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308077440 00000100:00100000:2.0:1746147145.771371:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308077440 00000100:00100000:2.0:1746147145.771417:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14797 00000100:00100000:2.0:1746147145.771424:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32431:x1830967308077440:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147145.771443:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.771461:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78317 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.771493:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.771501:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.771502:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147145.771505:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3969024->4194303] (req 3969024->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 46 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.771532:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.771543:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 33 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.771555:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310715392:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.771636:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.771749:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.772592:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308077696 00000100:00100000:3.0:1746147145.772597:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308077696 00002000:00100000:3.0:1746147145.772631:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2338816->2342911) req@ffff88012e321180 x1830967308077696/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.772640:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321180 with x1830967308077696 ext(2338816->2342911) 00010000:00010000:3.0:1746147145.772647:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 34 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.772659:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 34 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.772671:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e321180 00000100:00100000:3.0:1746147145.772687:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1138 00000100:00100000:3.0:1746147145.772693:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+34:2003:x1830967308077696:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147145.772961:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+34:2003:x1830967308077696:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 267us (1211us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147145.772967:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1138 00002000:00100000:3.0:1746147145.772973:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2338816->2342911) req@ffff88012e321180 x1830967308077696/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.772981:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321180 with x1830967308077696 ext(2338816->2342911) 00010000:00010000:3.0:1746147145.772985:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 34 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.772994:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 34 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746147145.773000:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e321180 00000100:00100000:3.0:1746147145.774199:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310715392:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.774226:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3969024->4194303] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 46 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.774242:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542600, rc 0) 00000100:00100000:3.0:1746147145.774295:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32431:x1830967308077440:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2870us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.774305:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14797 00000100:00100000:0.0:1746147145.775865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.776578:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308077952 00000100:00100000:2.0:1746147145.776585:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308077952 00002000:00100000:2.0:1746147145.776624:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2342911) req@ffff8801323d5180 x1830967308077952/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.776633:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5180 with x1830967308077952 ext(2097152->2342911) 00010000:00010000:2.0:1746147145.776641:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 34 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.776653:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 34 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.776659:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801323d5180 00000100:00100000:2.0:1746147145.776689:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1139 00000100:00100000:2.0:1746147145.776695:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967308077952:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147145.783697:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+36:2000:x1830967308077952:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6988us (7822us total) trans 21474841515 rc 0/0 00000100:00100000:2.0:1746147145.783711:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1139 00002000:00100000:2.0:1746147145.783725:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2342911) req@ffff8801323d5180 x1830967308077952/t21474841515(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.783735:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5180 with x1830967308077952 ext(2097152->2342911) 00010000:00010000:2.0:1746147145.783747:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 36 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.783765:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 36 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.783774:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801323d5180 00000001:00080000:0.0:1746147145.784563:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841515 is committed 00000001:00080000:0.0:1746147145.784577:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841513 is committed 00000001:00080000:0.0:1746147145.784598:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841507 is committed 00000001:00080000:0.0:1746147145.784606:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841504 is committed 00000100:00100000:0.0:1746147145.786331:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.786442:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308078080 00000100:00100000:3.0:1746147145.786453:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308078080 00010000:00010000:3.0:1746147145.786490:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 8 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.786530:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6510 00000100:00100000:3.0:1746147145.786541:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967308078080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.786555:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147145.786575:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 8 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.786588:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 8 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.786671:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092543c00/0x3139939425056c51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2342911) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78310 expref: 8 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.786697:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.786700:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.786707:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.786715:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.786760:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.786772:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310715520:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.786922:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.788914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.789007:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310715520:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.789026:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.789059:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967308078080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2519us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.789069:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6510 00000100:00100000:2.0:1746147145.789199:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308078336 00000100:00100000:2.0:1746147145.789205:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308078336 00002000:00100000:2.0:1746147145.789243:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (3969024->3973119) req@ffff8801323d6a00 x1830967308078336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.789252:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6a00 with x1830967308078336 ext(3969024->3973119) 00002000:00010000:2.0:1746147145.789257:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d6a00 00000100:00100000:2.0:1746147145.789283:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3611 00000100:00100000:2.0:1746147145.789289:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308078336:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147145.789763:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308078336:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 472us (855us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147145.789770:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3611 00002000:00100000:2.0:1746147145.789776:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (3969024->3973119) req@ffff8801323d6a00 x1830967308078336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.789783:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6a00 with x1830967308078336 ext(3969024->3973119) 00002000:00010000:2.0:1746147145.789786:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d6a00 00000100:00100000:0.0:1746147145.797855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.797997:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308078464 00000100:00100000:3.0:1746147145.798007:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308078464 00000100:00100000:3.0:1746147145.798069:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14798 00000100:00100000:3.0:1746147145.798078:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32431:x1830967308078464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147145.798315:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.798339:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7831e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.798373:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.798380:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.798381:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147145.798385:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [4194304->4759551] (req 4194304->4759551) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.798419:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.798753:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 9 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.798768:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310715648:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.798874:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.804827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.804954:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310715648:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.804989:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [4194304->4759551] (req 4194304->4759551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.805009:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013128c000, rc 0) 00000100:00100000:3.0:1746147145.805057:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32431:x1830967308078464:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6980us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.805067:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14798 00000100:00100000:2.0:1746147145.805125:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308078592 00000100:00100000:2.0:1746147145.805134:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308078592 00002000:00100000:2.0:1746147145.805180:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2883584->3145727) req@ffff8801323d4a80 x1830967308078592/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.805196:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4a80 with x1830967308078592 ext(2883584->3145727) 00010000:00010000:2.0:1746147145.805204:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 10 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.805221:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 10 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.805228:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d4a80 00000100:00100000:2.0:1746147145.805255:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1140 00000100:00100000:2.0:1746147145.805263:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308078592:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147145.809831:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967308078592:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4558us (5006us total) trans 17179874247 rc 0/0 00000100:00100000:2.0:1746147145.809845:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1140 00002000:00100000:2.0:1746147145.809858:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2883584->3145727) req@ffff8801323d4a80 x1830967308078592/t17179874247(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.809868:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4a80 with x1830967308078592 ext(2883584->3145727) 00010000:00010000:2.0:1746147145.809888:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 12 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.809904:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 12 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.809911:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d4a80 00000100:00100000:0.0:1746147145.812985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.813592:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308078720 00000100:00100000:3.0:1746147145.813601:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308078720 00010000:00010000:3.0:1746147145.813642:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 12 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.813686:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6511 00000100:00100000:3.0:1746147145.813694:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308078720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147145.813706:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147145.813722:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147144 -> 1746147145 00002000:00010000:3.0:1746147145.813725:0:7227:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147144 -> 1746147145 00010000:00010000:3.0:1746147145.813731:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 12 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.813744:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 12 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.813767:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f390c00/0x3139939425056c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78309 expref: 12 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746147145.813795:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.813798:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147145.813805:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.813814:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.813848:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147145.813859:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310715776:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147145.813953:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.818378:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310715776:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147145.818403:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147145.819957:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308078720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6254us (6973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.819970:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6511 00000100:00100000:0.0:1746147145.820741:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.821941:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308078976 00000100:00100000:2.0:1746147145.821953:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308078976 00002000:00100000:2.0:1746147145.822006:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4755456->4759551) req@ffff8801323d6d80 x1830967308078976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.822015:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6d80 with x1830967308078976 ext(4755456->4759551) 00002000:00010000:2.0:1746147145.822021:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d6d80 00000100:00100000:3.0:1746147145.822318:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3612 00000100:00100000:3.0:1746147145.822328:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308078976:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147145.822501:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308078976:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 174us (1761us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147145.822507:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3612 00002000:00100000:3.0:1746147145.822513:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4755456->4759551) req@ffff8801323d6d80 x1830967308078976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.822520:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6d80 with x1830967308078976 ext(4755456->4759551) 00002000:00010000:3.0:1746147145.822523:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d6d80 00000100:00100000:0.0:1746147145.822904:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.822943:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308079232 00000100:00100000:1.0:1746147145.822947:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308079232 00000100:00100000:1.0:1746147145.822988:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15329 00000100:00100000:1.0:1746147145.822993:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32439:x1830967308079232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147145.823012:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.823031:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64a200/0x3139939425056c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78325 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.823122:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823136:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823146:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823164:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823169:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823174:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823275:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c7b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823286:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823293:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147145.823300:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147145.823376:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823382:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823388:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823393:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823399:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b64ac00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.823402:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823409:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823421:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147145.823423:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.823427:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823432:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64ac00/0x3139939425056c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823562:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823569:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823574:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823578:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b64bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.823580:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823585:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823592:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006700) 00010000:00010000:1.0:1746147145.823594:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.823596:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823600:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64bc00/0x3139939425056c74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.823640:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64a200/0x3139939425056c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78325 expref: 45 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.823652:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78325 expref: 44 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.823658:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.823660:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147145.823662:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73600, rc 0) 00000100:00100000:1.0:1746147145.823700:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32439:x1830967308079232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 705us (824us total) trans 8589936032 rc 0/0 00000100:00100000:1.0:1746147145.823706:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15329 00000100:00100000:0.0:1746147145.827813:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.827873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.827934:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308079616 00000100:00100000:2.0:1746147145.827945:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308079616 00000100:00100000:2.0:1746147145.828014:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 821 00000100:00100000:2.0:1746147145.828023:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967308079616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.828039:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.828071:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425056c7b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78325 expref: 44 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.828111:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.828120:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.828166:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308079616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 144us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.828173:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 821 00000100:00100000:3.0:1746147145.828238:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308079488 00000100:00100000:3.0:1746147145.828243:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308079488 00000100:00100000:3.0:1746147145.828280:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5507 00000100:00100000:3.0:1746147145.828286:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f88050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32431:x1830967308079488:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147145.828475:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f88050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32431:x1830967308079488:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 188us (675us total) trans 8589936033 rc 0/0 00000100:00100000:3.0:1746147145.828482:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5507 00000100:00100000:0.0:1746147145.842825:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.842904:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308080000 00000100:00100000:3.0:1746147145.842914:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308080000 00000100:00100000:0.0:1746147145.842922:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:3.0:1746147145.842965:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d4700 x1830967308080000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.842975:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4700 with x1830967308080000 ext(2097152->4194303) 00002000:00010000:3.0:1746147145.842981:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d4700 00000100:00100000:3.0:1746147145.843014:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308080128 00000100:00100000:3.0:1746147145.843017:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308080128 00002000:00100000:3.0:1746147145.843031:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3969023) req@ffff8801323d7100 x1830967308080128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147145.843040:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3613 00002000:00100000:3.0:1746147145.843042:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7100 with x1830967308080128 ext(2097152->3969023) 00002000:00010000:3.0:1746147145.843046:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7100 00000100:00100000:2.0:1746147145.843049:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308080000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147145.843057:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3614 00000100:00100000:3.0:1746147145.843062:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308080128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147145.867945:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308080128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 24867us (25008us total) trans 0 rc 1871872/1871872 00000100:00100000:3.0:1746147145.867959:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3614 00002000:00100000:3.0:1746147145.867971:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3969023) req@ffff8801323d7100 x1830967308080128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1871872/1871872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147145.867980:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7100 with x1830967308080128 ext(2097152->3969023) 00002000:00010000:3.0:1746147145.867986:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7100 00000100:00100000:2.0:1746147145.871788:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308080000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28728us (28962us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147145.871801:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3613 00002000:00100000:2.0:1746147145.871812:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d4700 x1830967308080000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.871827:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4700 with x1830967308080000 ext(2097152->4194303) 00002000:00010000:2.0:1746147145.871832:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d4700 00000100:00100000:0.0:1746147145.878002:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.879505:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308080384 00000100:00100000:2.0:1746147145.879518:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308080384 00002000:00100000:2.0:1746147145.879576:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4759552->4919295) req@ffff880099012300 x1830967308080384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.879587:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012300 with x1830967308080384 ext(4759552->4919295) 00002000:00010000:2.0:1746147145.879593:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099012300 00000100:00100000:2.0:1746147145.879635:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3615 00000100:00100000:2.0:1746147145.879644:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308080384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147145.883727:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308080384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4070us (5724us total) trans 0 rc 159744/159744 00000100:00100000:2.0:1746147145.883740:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3615 00002000:00100000:2.0:1746147145.883751:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4759552->4919295) req@ffff880099012300 x1830967308080384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 159744/159744 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.883761:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012300 with x1830967308080384 ext(4759552->4919295) 00002000:00010000:2.0:1746147145.883766:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099012300 00000100:00100000:0.0:1746147145.887508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.887619:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308080640 00000100:00100000:2.0:1746147145.887630:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308080640 00000100:00100000:2.0:1746147145.888460:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5508 00000100:00100000:2.0:1746147145.888469:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32439:x1830967308080640:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147145.888679:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32439:x1830967308080640:12345-192.168.204.25@tcp:35:cat.0 Request processed in 211us (1181us total) trans 8589936034 rc 0/0 00000100:00100000:2.0:1746147145.888688:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5508 00000100:00100000:0.0:1746147145.917005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.917435:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308080896 00000100:00100000:1.0:1746147145.917445:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308080896 00000100:00100000:1.0:1746147145.917493:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15330 00000100:00100000:1.0:1746147145.917500:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ccf8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+26:32444:x1830967308080896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147145.917526:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.917545:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425056c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7832c expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.917622:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917636:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917647:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917661:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917665:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917669:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917767:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425056c9e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917777:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425056c9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917783:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425056c9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147145.917790:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147145.917864:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917869:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917884:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917890:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917895:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822a000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.917899:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917906:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917916:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147145.917919:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.917923:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917927:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x3139939425056c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917953:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917958:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917962:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917966:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147145.917968:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917972:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917976:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006c00) 00010000:00010000:1.0:1746147145.917978:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147145.917980:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.917984:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425056c97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147145.918018:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425056c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7832c expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.918028:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425056c9e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7832c expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.918034:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147145.918035:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147145.918038:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b400, rc 0) 00000100:00100000:1.0:1746147145.918086:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ccf8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:32444:x1830967308080896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 586us (1090us total) trans 8589936035 rc 0/0 00000100:00100000:1.0:1746147145.918109:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15330 00000100:00100000:0.0:1746147145.923004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.925350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.925593:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308081024 00000100:00100000:2.0:1746147145.925603:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308081024 00000100:00100000:2.0:1746147145.925657:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 822 00000100:00100000:2.0:1746147145.925664:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308081024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147145.925679:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147145.925704:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425056c9e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7832c expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.925724:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.925728:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147145.925768:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308081024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.925774:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 822 00000100:00100000:3.0:1746147145.926150:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308081280 00000100:00100000:3.0:1746147145.926155:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308081280 00000100:00100000:3.0:1746147145.926184:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5509 00000100:00100000:3.0:1746147145.926189:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:32444:x1830967308081280:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147145.926354:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:32444:x1830967308081280:12345-192.168.204.25@tcp:35:cat.0 Request processed in 164us (1012us total) trans 8589936036 rc 0/0 00000100:00100000:3.0:1746147145.926360:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5509 00000100:00100000:0.0:1746147145.929979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.930034:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.930255:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308081536 00000100:00100000:2.0:1746147145.930264:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308081536 00000100:00100000:2.0:1746147145.930301:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308081408 00000100:00100000:2.0:1746147145.930303:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308081408 00000100:00100000:2.0:1746147145.930319:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14799 00000100:00100000:2.0:1746147145.930326:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967308081536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.930344:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.930362:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092543e00/0x3139939425056cac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7833a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.930414:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310715904:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147145.930508:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.930544:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14800 00000100:00100000:2.0:1746147145.930550:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967308081408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.930558:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.930568:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x3139939425056cb3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78333 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.930594:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310716032:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147145.930615:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00002000:00010000:3.0:1746147145.934080:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147144 -> 1746147145 00000100:00100000:3.0:1746147145.934135:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310716032:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147145.934172:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x3139939425056cb3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78333 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.934192:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x3139939425056cb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78333 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.934203:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542a00, rc 0) 00000100:00100000:3.0:1746147145.934250:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967308081408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3698us (4214us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147145.934258:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14800 00002000:00010000:2.0:1746147145.934497:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147144 -> 1746147145 00000100:00100000:2.0:1746147145.934511:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310715904:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147145.934527:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092543e00/0x3139939425056cac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7833a expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.934536:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092543e00/0x3139939425056cac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7833a expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.934544:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543e00, rc 0) 00000100:00100000:2.0:1746147145.934562:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967308081536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4237us (4594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147145.934568:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14799 00000100:00100000:0.0:1746147145.945064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.945383:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308081664 00000100:00100000:2.0:1746147145.945395:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308081664 00000100:00100000:2.0:1746147145.945452:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15331 00000100:00100000:2.0:1746147145.945461:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32445:x1830967308081664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147145.945485:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147145.945791:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310716544:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.945933:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310716288:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.945975:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147145.946001:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967310716800:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.946019:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147145.946033:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310717312:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.946053:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147145.946075:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746147145.946080:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3765:1830967310716160:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.946129:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147145.946149:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967310716672:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.946172:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147145.946182:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147145.946185:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310717184:0@lo:400:kworker.0 00010000:00010000:2.0:1746147145.946236:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x3139939425056cba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78341 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.946303:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946316:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946326:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946338:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946343:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946347:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946421:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946432:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.946438:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.946462:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.946474:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 27 pid: 7239 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.946488:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310717696:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147145.946536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147145.946563:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967310717056:0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946592:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716160 00000100:00100000:3.0:1746147145.946594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147145.946597:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716160 00000100:00100000:3.0:1746147145.946611:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830967310717568:0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946623:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1746147145.946625:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147145.946629:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3765:x1830967310716160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.946644:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1746147145.946650:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830967310716416:0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.946672:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147145.946673:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3765:x1830967310716160:12345-0@lo:400:kworker.0 Request processed in 43us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.946680:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1746147145.946683:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967310716928:0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.946697:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147145.946705:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310717440:0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946714:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716800 00000100:00100000:0.0:1746147145.946716:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716800 00000100:00100000:3.0:1746147145.946737:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147145.946740:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716672 00000100:00100000:0.0:1746147145.946741:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716672 00000100:00100000:0.0:1746147145.946751:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310717056 00000100:00100000:0.0:1746147145.946753:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310717056 00000100:00100000:0.0:1746147145.946761:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310717568 00000100:00100000:0.0:1746147145.946763:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310717568 00000100:00100000:3.0:1746147145.946766:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716288 00000100:00100000:3.0:1746147145.946771:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716288 00000100:00100000:0.0:1746147145.946771:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716416 00000100:00100000:0.0:1746147145.946774:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716416 00000100:00100000:0.0:1746147145.946782:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716928 00000100:00100000:0.0:1746147145.946783:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716928 00000100:00100000:0.0:1746147145.946794:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:0.0:1746147145.946799:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967310716800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.946805:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310717184 00000100:00100000:3.0:1746147145.946808:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310717184 00000100:00100000:3.0:1746147145.946821:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1746147145.946825:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967310716800:12345-0@lo:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.946828:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310716288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946831:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:0.0:1746147145.946840:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1746147145.946844:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967310716672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946872:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967310716672:12345-0@lo:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.946887:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310716288:12345-0@lo:400:kworker.0 Request processed in 46us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.946887:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1746147145.946893:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1746147145.946897:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1746147145.946901:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967310717056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.946905:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1746147145.946909:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310717184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946931:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967310717056:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.946935:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1746147145.946937:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310717184:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.946941:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1746147145.946945:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1746147145.946949:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830967310717568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.946958:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1746147145.946963:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830967310716416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.946970:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830967310717568:12345-0@lo:400:kworker.0 Request processed in 20us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.946975:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1746147145.946983:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1746147145.946987:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830967310716928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.947283:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830967310716416:12345-0@lo:400:kworker.0 Request processed in 319us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.947289:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1746147145.947316:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310717312 00000100:00100000:3.0:1746147145.947319:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310717312 00000100:00100000:3.0:1746147145.947339:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310716544 00000100:00100000:3.0:1746147145.947341:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310716544 00000100:00100000:3.0:1746147145.947357:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310717440 00000100:00100000:3.0:1746147145.947359:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310717440 00000100:00100000:3.0:1746147145.947374:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1746147145.947378:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310717312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.947405:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310717312:12345-0@lo:400:kworker.0 Request processed in 26us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.947410:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1746147145.947417:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1746147145.947422:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310716544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.947442:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967310716544:12345-0@lo:400:kworker.0 Request processed in 21us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.947447:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1746147145.947454:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1746147145.947458:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310717440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.947480:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310717440:12345-0@lo:400:kworker.0 Request processed in 21us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.947484:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1746147145.947516:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830967310716416:0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.947525:0:3767:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874238 gen 2 00000004:00080000:3.0:1746147145.947529:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76a00, transno 17179874191 00000004:00080000:3.0:1746147145.947534:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77800, transno 17179874192 00000004:00080000:3.0:1746147145.947537:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8e00, transno 17179874193 00000004:00080000:3.0:1746147145.947539:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75880, transno 17179874194 00000004:00080000:3.0:1746147145.947541:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ead80, transno 17179874195 00000004:00080000:3.0:1746147145.947543:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75500, transno 17179874196 00000004:00080000:3.0:1746147145.947545:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75c00, transno 17179874197 00000004:00080000:3.0:1746147145.947546:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8700, transno 17179874198 00000004:00080000:3.0:1746147145.947548:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312e8a80, transno 17179874199 00000004:00080000:3.0:1746147145.947550:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095235500, transno 17179874201 00000004:00080000:3.0:1746147145.947551:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095234700, transno 17179874202 00000004:00080000:3.0:1746147145.947553:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095237800, transno 17179874203 00000004:00080000:3.0:1746147145.947555:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095235f80, transno 17179874204 00000004:00080000:3.0:1746147145.947557:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094524e00, transno 17179874205 00000004:00080000:3.0:1746147145.947559:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095236300, transno 17179874206 00000004:00080000:3.0:1746147145.947561:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095236a00, transno 17179874207 00000004:00080000:3.0:1746147145.947563:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095236d80, transno 17179874208 00000004:00080000:3.0:1746147145.947566:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156a00, transno 17179874209 00000004:00080000:3.0:1746147145.947568:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098822a00, transno 17179874220 00000004:00080000:3.0:1746147145.947570:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e501180, transno 17179874221 00000004:00080000:3.0:1746147145.947572:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72d80, transno 17179874222 00000004:00080000:3.0:1746147145.947574:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e500a80, transno 17179874223 00000004:00080000:3.0:1746147145.947576:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73800, transno 17179874224 00000004:00080000:3.0:1746147145.947578:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062300, transno 17179874225 00000004:00080000:3.0:1746147145.947580:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70380, transno 17179874226 00000004:00080000:3.0:1746147145.947582:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063100, transno 17179874227 00000004:00080000:3.0:1746147145.947584:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd45f80, transno 17179874228 00000004:00080000:3.0:1746147145.947586:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099013480, transno 17179874230 00000004:00080000:3.0:1746147145.947588:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099011880, transno 17179874231 00000004:00080000:3.0:1746147145.947590:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095234a80, transno 17179874232 00000004:00080000:3.0:1746147145.947597:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94700, transno 17179874233 00000004:00080000:3.0:1746147145.947599:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94a80, transno 17179874234 00000004:00080000:3.0:1746147145.947600:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d94380, transno 17179874235 00000004:00080000:3.0:1746147145.947602:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095234380, transno 17179874236 00000004:00080000:3.0:1746147145.947604:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394000, transno 17179874237 00000004:00080000:3.0:1746147145.947606:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099010700, transno 17179874238 00000100:00100000:3.0:1746147145.947609:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310717440:0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.948405:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967310716544:0@lo:400:kworker.0 00000100:00100000:3.0:1746147145.948424:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967310717056:0@lo:400:kworker.0 00000100:00100000:2.0:1746147145.948432:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.948434:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830967310717568:0@lo:400:kworker.0 00000004:00080000:3.0:1746147145.948653:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 36 done 00000100:00100000:1.0:1746147145.948695:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310717184:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.948708:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310716288:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.948720:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967310716800:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.948731:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841504 gen 2 00000004:00080000:1.0:1746147145.948736:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094524000, transno 21474841458 00000004:00080000:1.0:1746147145.948755:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094525880, transno 21474841459 00000004:00080000:1.0:1746147145.948758:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094526a00, transno 21474841460 00000004:00080000:1.0:1746147145.948760:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094526300, transno 21474841461 00000004:00080000:1.0:1746147145.948762:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094527480, transno 21474841462 00000004:00080000:1.0:1746147145.948765:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094524700, transno 21474841463 00000004:00080000:1.0:1746147145.948767:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094525500, transno 21474841464 00000004:00080000:1.0:1746147145.948770:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094526680, transno 21474841465 00000004:00080000:1.0:1746147145.948772:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134869c00, transno 21474841467 00000004:00080000:1.0:1746147145.948775:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013486bb80, transno 21474841468 00000004:00080000:1.0:1746147145.948778:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098859f80, transno 21474841469 00000004:00080000:1.0:1746147145.948780:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098859c00, transno 21474841470 00000004:00080000:1.0:1746147145.948782:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009885b480, transno 21474841471 00000004:00080000:1.0:1746147145.948785:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013486a680, transno 21474841472 00000004:00080000:1.0:1746147145.948788:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009885aa00, transno 21474841473 00000004:00080000:1.0:1746147145.948790:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013486b480, transno 21474841474 00000004:00080000:1.0:1746147145.948793:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca12680, transno 21474841488 00000004:00080000:1.0:1746147145.948795:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10a80, transno 21474841489 00000004:00080000:1.0:1746147145.948797:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca12300, transno 21474841490 00000004:00080000:1.0:1746147145.948799:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca13100, transno 21474841491 00000004:00080000:1.0:1746147145.948802:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10000, transno 21474841492 00000004:00080000:1.0:1746147145.948804:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11f80, transno 21474841493 00000004:00080000:1.0:1746147145.948807:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11880, transno 21474841494 00000004:00080000:1.0:1746147145.948809:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca13480, transno 21474841495 00000004:00080000:1.0:1746147145.948811:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77480, transno 21474841497 00000004:00080000:1.0:1746147145.948814:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093147800, transno 21474841498 00000004:00080000:1.0:1746147145.948816:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74a80, transno 21474841499 00000004:00080000:1.0:1746147145.948818:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093145180, transno 21474841500 00000004:00080000:1.0:1746147145.948820:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093144700, transno 21474841501 00000004:00080000:1.0:1746147145.948823:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093144e00, transno 21474841502 00000004:00080000:1.0:1746147145.948824:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74380, transno 21474841503 00000004:00080000:1.0:1746147145.948826:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093146300, transno 21474841504 00000100:00100000:1.0:1746147145.948830:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310717312:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.948859:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3765:1830967310716160:0@lo:400:kworker.0 00000100:00100000:1.0:1746147145.948870:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967310716672:0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.948994:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830967310716928:12345-0@lo:400:kworker.0 Request processed in 2005us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.949004:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:0.0:1746147145.949031:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147145.949037:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746147145.949040:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1746147145.949462:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000100:00100000:3.0:1746147145.949920:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967310716928:0@lo:400:kworker.0 00000100:00100000:0.0:1746147145.953494:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.954343:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310717696:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.954370:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147145.955235:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082048 00000100:00100000:3.0:1746147145.955243:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082048 00000100:00100000:3.0:1746147145.955301:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5510 00000100:00100000:3.0:1746147145.955310:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:30601:x1830967308082048:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147145.955687:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+29:30601:x1830967308082048:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 378us (2203us total) trans 8589936037 rc 0/0 00000100:00100000:3.0:1746147145.955693:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5510 00000100:00100000:0.0:1746147145.955860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.956027:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308081792 00000100:00100000:2.0:1746147145.956030:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308081792 00000100:00100000:2.0:1746147145.956061:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14801 00000100:00100000:2.0:1746147145.956066:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308081792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147145.956076:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.956107:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425056cd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78348 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147145.956588:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310717824:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147145.956664:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.956959:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.957030:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082176 00000100:00100000:0.0:1746147145.957034:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082176 00000100:00100000:0.0:1746147145.957233:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14802 00000100:00100000:0.0:1746147145.957239:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967308082176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147145.957247:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147145.957259:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x3139939425056cdd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7834f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.957364:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310717952:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147145.957412:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.957602:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.957694:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082304 00000100:00100000:0.0:1746147145.957698:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082304 00010000:00010000:0.0:1746147145.957716:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 29 pid: 7239 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746147145.957982:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6512 00000100:00100000:0.0:1746147145.957990:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+29:2003:x1830967308082304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.958000:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.958005:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 29 pid: 7239 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.958021:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 29 pid: 7239 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.958040:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260a00/0x3139939425056b32 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78284 expref: 29 pid: 7239 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.958065:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147145.958070:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.958080:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.958103:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147145.958216:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310717824:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147145.958248:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425056cd6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78348 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.958258:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425056cd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78348 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.958263:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147145.958267:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fa00, rc 0) 00010000:00010000:2.0:1746147145.958285:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958293:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147145.958346:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147145.958350:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147145.958367:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958380:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958390:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958396:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958402:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958407:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958413:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0f400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147145.958416:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958770:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147145.958783:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:2003:x1830967308082304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 792us (1180us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147145.958785:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147145.958788:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147145.958790:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6512 00010000:00010000:2.0:1746147145.958791:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958795:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425056cc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958810:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958815:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147145.958820:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308081792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2752us (2959us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147145.958820:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958824:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0fc00 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:3.0:1746147145.958826:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14801 00010000:00010000:2.0:1746147145.958826:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958830:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958836:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553d00) 00010000:00010000:2.0:1746147145.958838:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147145.958839:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958844:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056cc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.958885:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x3139939425056cba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.958896:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.958902:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147145.958904:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147145.958906:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:2.0:1746147145.959071:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32445:x1830967308081664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 13611us (14020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.959078:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15331 00000100:00100000:0.0:1746147145.959547:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310717952:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147145.959566:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x3139939425056cdd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7834f expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.959576:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x3139939425056cdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7834f expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.959584:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48c00, rc 0) 00000100:00100000:0.0:1746147145.959622:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967308082176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2382us (2661us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147145.959628:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14802 00000100:00100000:0.0:1746147145.961549:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147145.961568:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310718080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746147145.961624:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147145.961758:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147145.961767:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310718208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746147145.961847:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310718080 00000100:00100000:3.0:1746147145.961855:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310718080 00000100:00100000:3.0:1746147145.961914:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1746147145.961922:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310718080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746147145.961957:0:7243:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445654528 avail 1316192256 00000100:00100000:3.0:1746147145.961998:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310718080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.962004:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1746147145.962071:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147145.962107:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310718208 00000100:00100000:2.0:1746147145.962110:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310718208 00000100:00100000:2.0:1746147145.962139:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1746147145.962144:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310718208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746147145.962163:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:2.0:1746147145.962208:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967310718208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.962213:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1746147145.962290:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310718080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746147145.962396:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310718208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746147145.962463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.962562:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082560 00000100:00100000:0.0:1746147145.962565:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082560 00000100:00100000:0.0:1746147145.962600:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14803 00000100:00100000:0.0:1746147145.962605:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+11:32444:x1830967308082560:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147145.962616:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147145.962634:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7835d expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.962658:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.962665:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147145.962667:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147145.962669:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.962696:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.962708:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 24 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746147145.962719:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310718336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147145.962790:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.963119:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.963145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.963159:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.963173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.963179:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082432 00000100:00100000:2.0:1746147145.963179:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082688 00000100:00100000:2.0:1746147145.963182:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082688 00000100:00100000:3.0:1746147145.963183:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082432 00000100:00100000:0.0:1746147145.963189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.963206:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082816 00000100:00100000:3.0:1746147145.963207:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082816 00000100:00100000:2.0:1746147145.963258:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308082944 00000100:00100000:3.0:1746147145.963263:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083072 00000100:00100000:2.0:1746147145.963264:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308082944 00000100:00100000:3.0:1746147145.963266:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083072 00000100:00100000:2.0:1746147145.963292:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14804 00000100:00100000:2.0:1746147145.963297:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308082432:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147145.963305:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147145.963415:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14805 00000100:00100000:3.0:1746147145.963421:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308082688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147145.963429:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.963440:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78364 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.963454:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147145.963454:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14806 00010000:00010000:3.0:1746147145.963456:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147145.963461:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14807 00000100:00100000:0.0:1746147145.963461:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308082816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147145.963464:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.963468:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147145.963470:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308082944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147145.963475:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7836b expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.963477:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.963477:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.963479:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78356 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.963485:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822ac00/0x3139939425056d00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78372 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.963486:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31800, rc 0) 00010000:00010000:0.0:1746147145.963486:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147145.963488:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.963492:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147145.963493:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147145.963493:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147145.963497:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147145.963502:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147145.963504:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308082688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 84us (359us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147145.963506:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147145.963509:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14805 00010000:00010000:0.0:1746147145.963509:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49400, rc 0) 00010000:00010000:2.0:1746147145.963513:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5000, rc 0) 00000100:00100000:1.0:1746147145.963513:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310718464:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147145.963519:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14808 00000100:00100000:3.0:1746147145.963523:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308083072:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147145.963525:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308082432:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 228us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.963525:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308082816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 65us (365us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147145.963530:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147145.963530:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14804 00010000:00010000:3.0:1746147145.963536:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31600/0x3139939425056d07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78379 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.963536:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14806 00000100:00100000:1.0:1746147145.963543:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.963558:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310718592:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147145.963581:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d88d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147145.964523:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967310718336:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147145.964540:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.964549:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49c00, rc 0) 00000100:00100000:2.0:1746147145.964569:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+12:32444:x1830967308082560:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1964us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147145.964574:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14803 00000100:00100000:1.0:1746147145.965596:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310718464:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147145.965619:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822ac00/0x3139939425056d00 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78372 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.965629:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822ac00/0x3139939425056d00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78372 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147145.965806:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310718592:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147145.965824:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a31600/0x3139939425056d07 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78379 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.965832:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31600/0x3139939425056d07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78379 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.965841:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31600, rc 0) 00000100:00100000:3.0:1746147145.965885:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308083072:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2350us (2684us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147145.965891:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14808 00010000:00010000:1.0:1746147145.966034:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822ac00, rc 0) 00000100:00100000:1.0:1746147145.966134:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308082944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2666us (2959us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147145.966140:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14807 00000100:00100000:0.0:1746147145.967276:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.967398:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083200 00000100:00100000:2.0:1746147145.967406:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083200 00002000:00100000:2.0:1746147145.967444:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4759551) req@ffff8800930e9180 x1830967308083200/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147145.967452:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e9180 with x1830967308083200 ext(4194304->4759551) 00010000:00010000:2.0:1746147145.967461:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 25 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147145.967473:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 25 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147145.967480:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930e9180 00000100:00100000:2.0:1746147145.967513:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1141 00000100:00100000:2.0:1746147145.967519:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308083200:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147145.968019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147145.968083:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083456 00000100:00100000:2.0:1746147145.968113:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083456 00000100:00100000:2.0:1746147145.968137:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15332 00000100:00100000:2.0:1746147145.968142:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32445:x1830967308083456:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147145.968152:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147145.968166:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056d0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78380 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.968240:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.968253:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.968260:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147145.968285:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147145.968294:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 17 pid: 7238 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147145.968303:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310718720:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147145.969659:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147145.970989:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310718720:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.971010:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147145.971478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.971544:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083584 00000100:00100000:0.0:1746147145.971550:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083584 00010000:00010000:0.0:1746147145.971575:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 18 pid: 7238 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746147145.971654:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6513 00000100:00100000:0.0:1746147145.971661:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967308083584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.971674:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.971679:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 18 pid: 7238 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.971688:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 18 pid: 7238 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.971706:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056ccf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78341 expref: 18 pid: 7238 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.971718:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147145.971722:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.971729:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.971735:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.971758:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147145.971835:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147145.971843:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147145.971844:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308083584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 182us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.971850:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6513 00000004:00200000:3.0:1746147145.971864:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147145.971956:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056d0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.971968:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.971975:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.971977:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147145.971979:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4e00, rc 0) 00000100:00100000:3.0:1746147145.972017:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32445:x1830967308083456:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3874us (3998us total) trans 8589936038 rc 0/0 00000100:00100000:3.0:1746147145.972024:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15332 00000100:00100000:0.0:1746147145.972445:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308083200:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4925us (5175us total) trans 17179874248 rc 0/0 00000100:00100000:0.0:1746147145.972454:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1141 00002000:00100000:0.0:1746147145.972461:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4759551) req@ffff8800930e9180 x1830967308083200/t17179874248(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:521/0 lens 488/448 e 0 to 0 dl 1746147156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147145.972469:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e9180 with x1830967308083200 ext(4194304->4759551) 00010000:00010000:0.0:1746147145.972476:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 27 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.972487:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 27 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746147145.972492:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930e9180 00000100:00100000:0.0:1746147145.977201:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.977291:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083712 00000100:00100000:3.0:1746147145.977300:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083712 00000100:00100000:3.0:1746147145.977341:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15333 00000100:00100000:3.0:1746147145.977348:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32445:x1830967308083712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147145.977368:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.977388:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425056d23 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78387 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.977462:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147145.977474:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.977480:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147145.977507:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.977517:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 18 pid: 7238 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147145.977527:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310718848:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147145.977608:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.978791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.979169:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083840 00000100:00100000:0.0:1746147145.979175:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083840 00010000:00010000:0.0:1746147145.979197:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 27 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746147145.979227:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6514 00000100:00100000:0.0:1746147145.979232:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308083840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.979241:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.979256:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 27 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.979266:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 27 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.979282:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013128c000/0x3139939425056c5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7831e expref: 27 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.979294:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147145.979295:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147145.979301:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.979308:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147145.979332:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147145.979341:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310718976:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147145.979407:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147145.981506:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310718976:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147145.981524:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.981619:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967308083840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2384us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.981629:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6514 00000100:00100000:3.0:1746147145.981719:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310718848:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147145.981735:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147145.981737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.981792:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308083968 00000100:00100000:0.0:1746147145.981798:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308083968 00010000:00010000:0.0:1746147145.981819:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 19 pid: 7238 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746147145.981933:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6515 00000100:00100000:0.0:1746147145.981940:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2001:x1830967308083968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147145.981949:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147145.981955:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 19 pid: 7238 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.981964:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 19 pid: 7238 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.981981:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x3139939425056d15 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78380 expref: 19 pid: 7238 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147145.981989:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147145.981993:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.982000:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.982005:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147145.982027:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147145.982046:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967308083968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 107us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147145.982051:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6515 00010000:00010000:3.0:1746147145.982107:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147145.982113:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147145.982151:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147145.982155:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147145.982168:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147145.982192:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425056d23 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78387 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.982202:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78387 expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147145.982211:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147145.982214:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1746147145.982415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147145.983281:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31000, rc 0) 00000100:00100000:1.0:1746147145.983396:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308084224 00000100:00100000:1.0:1746147145.983402:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308084224 00000100:00100000:3.0:1746147145.983427:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32445:x1830967308083712:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6078us (6233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.983433:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15333 00002000:00100000:1.0:1746147145.983469:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800930ea300 x1830967308084224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/0 e 0 to 0 dl 1746147156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.983479:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ea300 with x1830967308084224 ext(2097152->3145727) 00002000:00010000:1.0:1746147145.983483:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ea300 00000100:00100000:1.0:1746147145.983497:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3616 00000100:00100000:1.0:1746147145.983503:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308084224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147145.990066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147145.990229:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308084352 00000100:00100000:1.0:1746147145.990242:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308084352 00000100:00100000:1.0:1746147145.990280:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14809 00000100:00100000:1.0:1746147145.990288:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308084352:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147145.990305:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147145.990321:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7838e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147145.990342:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.990344:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147145.990351:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147145.990366:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147145.990530:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147145.990563:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308084480 00000100:00100000:3.0:1746147145.990567:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308084480 00000100:00100000:3.0:1746147145.990590:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14810 00010000:00010000:1.0:1746147145.990592:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b000, rc 0) 00000100:00100000:3.0:1746147145.990594:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308084480:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147145.990600:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147145.990607:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30a00/0x3139939425056d38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78395 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147145.990632:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308084352:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 345us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147145.990633:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310719104:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147145.990639:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14809 00000100:00100000:3.0:1746147145.990672:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147145.992695:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308084224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9184us (10272us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147145.992705:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3616 00002000:00100000:1.0:1746147145.992714:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff8800930ea300 x1830967308084224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:521/0 lens 488/440 e 0 to 0 dl 1746147156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147145.992723:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ea300 with x1830967308084224 ext(2097152->3145727) 00002000:00010000:1.0:1746147145.992728:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ea300 00000100:00100000:3.0:1746147145.993180:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310719104:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147145.993206:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30a00/0x3139939425056d38 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78395 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.993217:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30a00/0x3139939425056d38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78395 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147145.993227:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30a00, rc 0) 00000100:00100000:3.0:1746147145.993265:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308084480:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2669us (2734us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147145.993271:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14810 00000100:00100000:0.0:1746147145.999702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147145.999791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.000188:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308084608 00000100:00100000:3.0:1746147146.000196:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308084608 00000100:00080000:0.0:1746147146.000226:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147146.000254:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14811 00000100:00100000:3.0:1746147146.000261:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+7:32444:x1830967308084608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.000276:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.000291:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7839c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.000316:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.000322:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.000324:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.000326:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.000350:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.000361:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 21 pid: 1853 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746147146.000371:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310719232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.000759:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.000775:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308084864 00000100:00100000:3.0:1746147146.000779:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308084864 00000100:00100000:3.0:1746147146.000815:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15334 00000100:00100000:3.0:1746147146.000820:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32445:x1830967308084864:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147146.000829:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.000841:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056d46 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783a3 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.000922:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.000933:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.000942:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147146.000952:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147146.001029:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425056d46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746147146.001033:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147146.001040:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 19 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.001047:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.001049:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147146.001051:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fc00, rc 0) 00000100:00100000:3.0:1746147146.001086:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:32445:x1830967308084864:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 265us (1294us total) trans 8589936039 rc 0/0 00000100:00100000:3.0:1746147146.001117:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15334 00000100:00100000:3.0:1746147146.002856:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310719232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.003081:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.003330:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31a00, rc 0) 00000100:00100000:3.0:1746147146.003461:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:32444:x1830967308084608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3199us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.003469:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14811 00000100:00100000:1.0:1746147146.003835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.003885:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308084992 00000100:00100000:2.0:1746147146.003891:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308084992 00000100:00080000:1.0:1746147146.003912:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746147146.003925:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (3969024->4194303) req@ffff880129f56d80 x1830967308084992/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.003938:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967308084992 ext(3969024->4194303) 00010000:00010000:2.0:1746147146.003944:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 22 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746147146.003954:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 22 pid: 1853 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746147146.003960:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129f56d80 00000100:00100000:2.0:1746147146.003982:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1142 00000100:00100000:2.0:1746147146.003989:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308084992:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147146.008694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008791:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.008851:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308085120 00000100:00100000:0.0:1746147146.008858:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308085120 00000100:00100000:0.0:1746147146.008910:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308085376 00000100:00100000:0.0:1746147146.008913:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308085376 00000100:00100000:0.0:1746147146.008926:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308085632 00000100:00100000:0.0:1746147146.008928:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308085632 00000100:00100000:0.0:1746147146.008937:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308085248 00000100:00100000:0.0:1746147146.008939:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308085248 00000100:00100000:0.0:1746147146.008947:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308085504 00000100:00100000:0.0:1746147146.008949:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308085504 00000100:00100000:0.0:1746147146.008957:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308085760 00000100:00100000:0.0:1746147146.008958:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308085760 00000100:00100000:0.0:1746147146.008966:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14812 00000100:00100000:0.0:1746147146.008972:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308085120:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147146.009006:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.009026:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.009033:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.009040:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.009046:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.009047:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.009049:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.009081:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.009115:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 11 pid: 1854 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147146.009127:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310719360:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.009250:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14813 00000100:00100000:1.0:1746147146.009257:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308085376:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147146.009274:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.009283:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.009289:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.009295:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.009299:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.009300:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.009302:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.009316:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.009322:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 23 pid: 1854 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147146.009329:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310719488:192.168.204.25@tcp:104: 00000100:00080000:1.0:1746147146.009353:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147146.009356:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147146.009365:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14814 00000100:00100000:1.0:1746147146.009370:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308085632:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147146.009383:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.009392:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.009398:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.009403:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.009404:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.009406:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.009418:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.009425:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 13 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147146.009432:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310719616:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.009556:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14815 00000100:00100000:2.0:1746147146.009564:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308085248:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147146.009580:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009588:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009594:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.009601:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.009606:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.009607:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.009609:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009624:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.009632:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 7 pid: 9586 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147146.009638:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310719744:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.009671:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14816 00000100:00100000:2.0:1746147146.009675:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308085504:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147146.009689:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009697:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.009703:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.009709:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009713:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.009714:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.009716:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009729:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009735:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 11 pid: 10340 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746147146.009741:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310719872:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.009763:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14817 00000100:00100000:2.0:1746147146.009768:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308085760:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147146.009782:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009788:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147146.009791:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009795:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147146.009796:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009811:0:12201:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009817:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147146.009838:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086016 00000100:00100000:2.0:1746147146.009841:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086016 00000100:00100000:2.0:1746147146.009884:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15335 00000100:00100000:2.0:1746147146.009890:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32450:x1830967308086016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.009903:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.009913:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425056d85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783aa expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.009962:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.009971:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.009979:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.009988:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.009992:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.009997:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010071:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010079:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010112:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147146.010120:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.010177:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010183:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010188:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010193:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.010196:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010202:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010211:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.010214:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147146.010216:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010221:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6000/0x3139939425056d9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010237:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010242:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010253:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010258:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010261:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.010263:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00000100:00080000:1.0:1746147146.010263:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147146.010268:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010274:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147146.010276:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.010278:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010282:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7e00/0x3139939425056d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010288:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010291:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010296:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010299:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.010300:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010308:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010313:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553e00) 00010000:00010000:2.0:1746147146.010315:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.010316:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010320:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425056d93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.010353:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425056d85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783aa expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.010359:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x3139939425056d85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783aa expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.010366:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7400, rc 0) 00000100:00100000:2.0:1746147146.010394:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32450:x1830967308086016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 503us (1706us total) trans 8589936040 rc 301/301 00000100:00100000:2.0:1746147146.010400:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15335 00010000:00010000:1.0:1746147146.010468:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.010480:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 11 pid: 1398 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.010488:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310720128:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147146.010537:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.010545:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.010552:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310720256:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.010569:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9626c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147146.010597:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.010605:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 11 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.010613:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098e10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310720384:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.010631:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147146.010704:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.010714:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746147146.010726:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310720512:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.010757:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.010764:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 25 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.010772:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310720640:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.010789:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147146.010910:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.010910:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.010918:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.010919:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 11 pid: 1853 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.010926:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310720768:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.010926:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310720896:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.010962:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.010968:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.010969:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 13 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.010975:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 23 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.010976:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310721024:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.010981:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310721152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.010989:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.010993:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.012652:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308084992:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8401us (8555us total) trans 21474841516 rc 0/0 00000100:00100000:0.0:1746147146.012662:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1142 00002000:00100000:0.0:1746147146.012671:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (3969024->4194303) req@ffff880129f56d80 x1830967308084992/t21474841516(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.012679:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967308084992 ext(3969024->4194303) 00010000:00010000:0.0:1746147146.012687:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746147146.012698:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746147146.012704:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129f56d80 00000100:00100000:0.0:1746147146.013003:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310719360:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.013027:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310719488:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.013663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.013818:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086144 00000100:00100000:2.0:1746147146.013824:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086144 00010000:00010000:2.0:1746147146.013866:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 12 pid: 1854 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147146.013933:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6516 00000100:00080000:1.0:1746147146.013938:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147146.013940:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308086144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.013951:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.013965:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 12 pid: 1854 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147146.013975:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 12 pid: 1854 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147146.013993:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x3139939425056bfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ed expref: 12 pid: 1854 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147146.014006:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.014113:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967308086144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 173us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.014119:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6516 00000100:00100000:0.0:1746147146.018496:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.018566:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.018588:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.018613:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086656 00000100:00100000:0.0:1746147146.018620:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086656 00010000:00010000:0.0:1746147146.018650:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 14 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147146.018671:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086272 00000100:00100000:0.0:1746147146.018673:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086272 00010000:00010000:0.0:1746147146.018683:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 24 pid: 1854 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147146.018698:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6517 00000100:00100000:0.0:1746147146.018704:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308086656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147146.018716:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147146.018733:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 14 pid: 9585 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147146.018743:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 14 pid: 9585 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147146.018768:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.018802:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308086656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.018811:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6517 00000100:00100000:0.0:1746147146.018825:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6518 00000100:00100000:0.0:1746147146.018829:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967308086272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147146.018834:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147146.018844:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 24 pid: 1854 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147146.018852:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 24 pid: 1854 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147146.018864:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x3139939425056ba9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782b5 expref: 24 pid: 1854 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746147146.018888:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.018901:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967308086272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.018906:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6518 00010000:00010000:1.0:1746147146.019216:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b000/0x3139939425056d31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7838e expref: 13 pid: 9585 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746147146.019233:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310719616:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.019289:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086528 00000100:00100000:3.0:1746147146.019293:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086528 00000100:00100000:3.0:1746147146.019325:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15336 00000100:00100000:3.0:1746147146.019329:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:32448:x1830967308086528:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.019348:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.019361:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425056da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783b1 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.019414:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019425:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019434:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019445:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019450:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019455:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019528:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019538:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.019543:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.019566:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.019578:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 18 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.019588:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310721280:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.019631:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00080000:1.0:1746147146.020161:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147146.026137:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310721536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147146.026197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147146.026234:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310721408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147146.026251:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147146.026424:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310721536 00000100:00100000:3.0:1746147146.026427:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310721408 00000100:00100000:3.0:1746147146.026431:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310721408 00000100:00100000:2.0:1746147146.026431:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310721536 00000100:00100000:2.0:1746147146.026471:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1746147146.026477:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310721536:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1746147146.026484:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147146.026486:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1746147146.026503:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1216525376 pending 249856 free 3909718016 avail 3678195712 00000100:00100000:3.0:1746147146.026532:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1746147146.026538:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310721408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746147146.026551:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1168004160 pending 933888 free 3904991232 avail 3667238912 00000100:00100000:2.0:1746147146.027382:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310721536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 903us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.027389:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1746147146.027622:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310721536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147146.027633:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310721408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147146.027828:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967310721408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1289us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.027834:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1746147146.029557:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310720512:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.029585:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967310720640:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.029610:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.029643:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.029656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.029671:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.029688:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087424 00000100:00100000:0.0:1746147146.029693:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087424 00000100:00100000:0.0:1746147146.029730:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14818 00000100:00100000:0.0:1746147146.029736:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967308087424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.029756:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.029770:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056dc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783b8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.029789:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.029799:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056dc4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783b8 expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.029809:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212800/0x3139939425056dc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783b8 expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.029820:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212800, rc 0) 00000100:00100000:0.0:1746147146.029853:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967308087424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 118us (181us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147146.029858:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14818 00000100:00100000:0.0:1746147146.029895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.029905:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087680 00000100:00100000:0.0:1746147146.029908:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087680 00000100:00100000:0.0:1746147146.029920:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14819 00000100:00100000:0.0:1746147146.029924:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967308087680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.029929:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.029935:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783c6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.029945:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.029949:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dcb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783c6 expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.029957:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783c6 expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.029963:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212c00, rc 0) 00000100:00100000:0.0:1746147146.029974:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967308087680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 50us (78us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147146.029979:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14819 00000100:00100000:0.0:1746147146.030013:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.030020:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087936 00000100:00100000:0.0:1746147146.030023:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087936 00000100:00100000:0.0:1746147146.030036:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14820 00000100:00100000:0.0:1746147146.030039:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967308087936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.030045:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.030053:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212200/0x3139939425056dd2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783d4 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.030080:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310721664:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147146.030142:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.030176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.030187:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310719872:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.030190:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086784 00000100:00100000:0.0:1746147146.030193:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086784 00000100:00100000:2.0:1746147146.030196:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310720896:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.030208:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 8 pid: 9586 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746147146.030210:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087168 00000100:00100000:2.0:1746147146.030213:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087168 00000100:00100000:0.0:1746147146.030223:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087296 00000100:00100000:0.0:1746147146.030225:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087296 00010000:00010000:2.0:1746147146.030233:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030233:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 26 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.030246:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6519 00000100:00100000:0.0:1746147146.030250:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308086784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147146.030253:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6520 00010000:00010000:0.0:1746147146.030257:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147146.030259:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967308087296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.030267:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147146.030273:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 8 pid: 9586 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147146.030277:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 26 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.030282:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 8 pid: 9586 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746147146.030285:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 26 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.030296:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147146.030300:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098446200/0x3139939425056bb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782ca expref: 26 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.030309:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308086784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (666us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147146.030311:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.030315:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6519 00000100:00100000:0.0:1746147146.030325:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6521 00000100:00100000:2.0:1746147146.030328:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308087296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.030329:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2003:x1830967308087168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147146.030333:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6520 00010000:00010000:0.0:1746147146.030335:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147146.030342:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030354:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030365:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff5000/0x3139939425056cf9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78356 expref: 13 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030372:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.030373:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.030377:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030384:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030397:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.030409:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308087168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.030413:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6521 00000100:00100000:1.0:1746147146.030427:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098e10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310720384:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.030434:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.030440:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030441:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746147146.030452:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147146.030453:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.030464:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310720128:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.030464:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.030470:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310720256:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.030471:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030476:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b64ac00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147146.030479:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030486:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.030492:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030494:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.030499:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425056d5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.030528:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308085120:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 21555us (21792us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.030533:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14812 00010000:00010000:3.0:1746147146.030562:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425056bf6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782f4 expref: 7 pid: 9586 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746147146.030564:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.030574:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310719744:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.030583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.030604:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.030615:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088064 00000100:00100000:0.0:1746147146.030618:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088064 00010000:00010000:0.0:1746147146.030627:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746147146.030640:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6522 00000100:00100000:0.0:1746147146.030645:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308088064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147146.030651:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147146.030658:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030666:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030675:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x31399394250568d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7811f expref: 25 pid: 12225 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746147146.030683:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.030695:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967308088064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.030699:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6522 00000100:00100000:1.0:1746147146.030792:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087552 00000100:00100000:1.0:1746147146.030795:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087552 00000100:00100000:1.0:1746147146.030817:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14821 00000100:00100000:1.0:1746147146.030823:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308087552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.030830:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.030836:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092543e00/0x3139939425056dd9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783bf expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.030847:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.030852:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092543e00/0x3139939425056dd9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783bf expref: 26 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.030860:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092543e00/0x3139939425056dd9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783bf expref: 26 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.030866:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543e00, rc 0) 00000100:00100000:1.0:1746147146.030893:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308087552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 70us (328us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147146.030897:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14821 00000100:00100000:1.0:1746147146.030906:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087808 00000100:00100000:1.0:1746147146.030908:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087808 00000100:00100000:1.0:1746147146.030920:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14822 00000100:00100000:1.0:1746147146.030924:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967308087808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.030930:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.030936:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425056de0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783cd expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.030944:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.030949:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425056de0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783cd expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.030957:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425056de0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783cd expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.030963:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543400, rc 0) 00000100:00100000:1.0:1746147146.030976:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967308087808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 51us (392us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147146.030981:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14822 00000100:00100000:2.0:1746147146.036211:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310721024:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.036239:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.036272:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.036296:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.036307:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.036319:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.036338:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.036348:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.036364:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308087040 00000100:00100000:1.0:1746147146.036369:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308087040 00010000:00010000:1.0:1746147146.036393:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 11 pid: 10340 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746147146.036407:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088576 00000100:00100000:1.0:1746147146.036408:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088576 00010000:00010000:1.0:1746147146.036415:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 12 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.036422:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308086912 00000100:00100000:1.0:1746147146.036423:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308086912 00010000:00010000:1.0:1746147146.036430:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 12 pid: 1398 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.036441:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088192 00000100:00100000:1.0:1746147146.036442:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088192 00010000:00010000:1.0:1746147146.036448:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.036454:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088448 00000100:00100000:1.0:1746147146.036455:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088448 00010000:00010000:1.0:1746147146.036460:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 11 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.036466:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088320 00000100:00100000:1.0:1746147146.036467:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088320 00010000:00010000:1.0:1746147146.036473:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 13 pid: 1853 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.036481:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6523 00000100:00100000:1.0:1746147146.036486:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308087040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.036497:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.036512:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 12 pid: 10340 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147146.036520:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 12 pid: 10340 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147146.036538:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504e400/0x3139939425056837 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780cb expref: 12 pid: 10340 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746147146.036554:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.036589:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308087040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.036595:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6523 00000100:00100000:1.0:1746147146.036631:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6524 00000100:00100000:1.0:1746147146.036635:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967308088576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.036641:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.036649:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 10 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.036656:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 10 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.036665:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x3139939425056ce4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7835d expref: 10 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.036674:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.036675:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.036679:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.036686:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.036701:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.036715:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967308088576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.036720:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6524 00000100:00100000:1.0:1746147146.036729:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6525 00000100:00100000:1.0:1746147146.036734:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308086912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.036739:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.036748:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 13 pid: 1398 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.036756:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 13 pid: 1398 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.036767:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425056cf2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7836b expref: 13 pid: 1398 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.036774:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.036787:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308086912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.036792:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6525 00000100:00100000:1.0:1746147146.036800:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6526 00000100:00100000:1.0:1746147146.036805:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967308088192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.036810:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.036815:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.036822:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.036833:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093714c00/0x3139939425056b24 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7827d expref: 7 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.036840:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.036841:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.036843:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.036849:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.036861:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.036885:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+6:2000:x1830967308088192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.036890:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6526 00000100:00100000:1.0:1746147146.036899:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6527 00000100:00100000:1.0:1746147146.036903:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308088448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.036909:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.036914:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 11 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.036921:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 11 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.036930:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x31399394250567c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780a1 expref: 11 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.036941:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.036943:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.036945:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.036950:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.036960:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.036971:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308088448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.036976:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6527 00000100:00100000:1.0:1746147146.036985:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6528 00000100:00100000:1.0:1746147146.036989:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308088320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.036994:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.037001:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 11 pid: 1853 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.037008:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 11 pid: 1853 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.037016:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.037027:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308088320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 38us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.037031:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6528 00010000:00010000:1.0:1746147146.037046:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037053:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037067:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037072:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037079:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037085:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822be00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147146.037106:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037113:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037121:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037127:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425056d62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.037162:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308085376:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 27905us (28396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.037169:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14813 00010000:00010000:1.0:1746147146.037185:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037190:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037200:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037207:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037212:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037216:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822b800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147146.037218:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037223:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037231:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037236:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b800/0x3139939425056d69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.037264:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308085632:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 27894us (28484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.037269:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14814 00000100:00100000:1.0:1746147146.037336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.037345:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088704 00000100:00100000:1.0:1746147146.037348:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088704 00010000:00010000:1.0:1746147146.037359:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 25 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.037369:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6529 00000100:00100000:1.0:1746147146.037374:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308088704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.037379:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.037385:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 25 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.037392:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 25 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.037401:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.037403:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.037405:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037411:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.037424:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.037435:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308088704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.037439:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6529 00000100:00100000:1.0:1746147146.037466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.037473:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088832 00000100:00100000:1.0:1746147146.037475:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088832 00010000:00010000:1.0:1746147146.037484:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 19 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.037493:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6530 00000100:00100000:1.0:1746147146.037497:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2003:x1830967308088832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.037502:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.037505:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 19 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.037512:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 19 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.037522:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147146.037525:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.037533:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.037537:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.037545:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.037555:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:2003:x1830967308088832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.037559:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6530 00010000:00010000:3.0:1746147146.038019:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31800/0x3139939425056ceb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78364 expref: 9 pid: 1853 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.038030:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310720768:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.038039:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974a6800/0x3139939425056bcc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782df expref: 24 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.038049:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310721152:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.038065:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038071:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038074:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038076:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038083:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038087:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038104:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038105:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038109:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038110:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038114:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147146.038116:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038117:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038123:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038125:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147146.038127:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038132:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038136:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038140:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038142:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425056d70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.038145:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x3139939425056d77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.038169:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308085248:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 28606us (29376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.038172:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308085504:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 28496us (29366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.038175:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14815 00000100:00100000:2.0:1746147146.038178:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14816 00010000:00010000:3.0:1746147146.038199:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425056d4d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783a3 expref: 18 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.038213:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310721280:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.038223:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038227:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038231:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147146.038244:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147146.038312:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038317:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038324:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038328:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f588c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.038330:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038334:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038340:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.038342:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147146.038344:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038348:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588c00/0x3139939425056dbd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038361:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038365:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038369:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038372:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038376:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5565600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.038378:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038384:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038389:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147146.038390:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147146.038392:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038395:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5565600/0x3139939425056daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038402:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038406:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038410:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038413:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f588e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.038414:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038418:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038422:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bf2e300) 00010000:00010000:3.0:1746147146.038423:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147146.038424:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038428:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x3139939425056db6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.038458:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425056da8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783b1 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038464:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425056da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783b1 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.038470:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31400, rc 0) 00000100:00100000:3.0:1746147146.038482:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+29:32448:x1830967308086528:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 19153us (19995us total) trans 8589936041 rc 301/301 00000100:00100000:3.0:1746147146.038488:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15336 00000100:00100000:1.0:1746147146.039086:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.039129:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308088960 00000100:00100000:2.0:1746147146.039136:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308088960 00010000:00010000:2.0:1746147146.039152:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.039168:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6531 00000100:00100000:2.0:1746147146.039173:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967308088960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.039180:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.039188:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.039198:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.039209:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.039210:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.039215:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 5 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.039221:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 5 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.039242:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 5 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.039250:0:7225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 5 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.039259:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310721792:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147146.039294:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00010000:00010000:0.0:1746147146.039886:0:9586:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88011e484000 x1830967310721664) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.039900:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425056c58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78317 expref: 24 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.039908:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310721664:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147146.039924:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212200/0x3139939425056dd2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783d4 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.039932:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212200/0x3139939425056dd2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783d4 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.039937:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212200, rc 0) 00000100:00100000:0.0:1746147146.039964:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967308087936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9923us (9950us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147146.039969:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14820 00000100:00100000:2.0:1746147146.043037:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310721792:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147146.043050:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.043109:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967308088960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3934us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.043117:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6531 00000100:00100000:1.0:1746147146.043387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.043642:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308089088 00000100:00100000:0.0:1746147146.043647:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308089088 00000100:00100000:0.0:1746147146.043681:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14823 00000100:00100000:0.0:1746147146.043687:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32450:x1830967308089088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.043700:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.043715:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783db expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147146.043736:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x68141749, atime: 0x68141749, ctime: 0x68141749, blocks: 0x7c8 00010000:00010000:0.0:1746147146.043752:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.043753:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.043759:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.043773:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.043784:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212c00, rc 0) 00000100:00100000:0.0:1746147146.043811:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32450:x1830967308089088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 123us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.043815:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14823 00000100:00100000:0.0:1746147146.044266:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.044308:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308089344 00000100:00100000:2.0:1746147146.044313:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308089344 00002000:00100000:2.0:1746147146.044337:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880094537b80 x1830967308089344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.044346:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537b80 with x1830967308089344 ext(2097152->3145727) 00010000:00010000:2.0:1746147146.044353:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 6 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.044364:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 6 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746147146.044371:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094537b80 00000100:00100000:2.0:1746147146.044575:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1143 00000100:00100000:2.0:1746147146.044581:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+6:2001:x1830967308089344:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147146.045752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.046345:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308089472 00000100:00100000:1.0:1746147146.046351:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308089472 00000100:00100000:1.0:1746147146.046388:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14824 00000100:00100000:1.0:1746147146.046394:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:32448:x1830967308089472:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147146.046405:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.046421:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783e2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147146.046438:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141749, atime: 0x68141749, ctime: 0x68141749, blocks: 0x808 00010000:00010000:1.0:1746147146.046453:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.046454:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.046459:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.046469:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.046476:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542c00, rc 0) 00000100:00100000:1.0:1746147146.046515:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32448:x1830967308089472:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 121us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.046523:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14824 00000100:00100000:0.0:1746147146.051543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.051704:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308089728 00000100:00100000:3.0:1746147146.051714:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308089728 00002000:00100000:3.0:1746147146.051751:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1200128->1204223) req@ffff8801349a0a80 x1830967308089728/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.051760:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0a80 with x1830967308089728 ext(1200128->1204223) 00002000:00010000:3.0:1746147146.051766:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0a80 00000100:00100000:3.0:1746147146.051796:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3617 00000100:00100000:3.0:1746147146.051803:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308089728:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147146.051937:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308089728:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 134us (407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147146.051942:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3617 00002000:00100000:3.0:1746147146.051947:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1200128->1204223) req@ffff8801349a0a80 x1830967308089728/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.051954:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0a80 with x1830967308089728 ext(1200128->1204223) 00002000:00010000:3.0:1746147146.051957:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0a80 00000100:00100000:0.0:1746147146.053601:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.053648:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308089984 00000100:00100000:3.0:1746147146.053654:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308089984 00002000:00100000:3.0:1746147146.053678:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801349a0000 x1830967308089984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.053686:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0000 with x1830967308089984 ext(0->1048575) 00002000:00010000:3.0:1746147146.053690:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0000 00000100:00100000:3.0:1746147146.054729:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3618 00000100:00100000:3.0:1746147146.054737:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308089984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.062171:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2001:x1830967308089344:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 17581us (17896us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.062182:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1143 00002000:00100000:3.0:1746147146.062192:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880094537b80 x1830967308089344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.062201:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094537b80 with x1830967308089344 ext(2097152->3145727) 00010000:00010000:3.0:1746147146.062209:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.062222:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746147146.062227:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094537b80 00000100:00100000:3.0:1746147146.062456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.062893:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308090496 00000100:00100000:2.0:1746147146.062899:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308090496 00000100:00100000:2.0:1746147146.062928:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15337 00000100:00100000:2.0:1746147146.062934:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32453:x1830967308090496:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147146.062950:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.062964:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783e9 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.063023:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063034:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063043:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063053:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063057:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063062:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063164:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063173:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063178:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147146.063185:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.063237:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063243:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063248:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063254:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff5c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.063258:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063263:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063272:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.063274:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147146.063278:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063282:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5c00/0x3139939425056e11 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063308:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063313:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063317:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063321:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063325:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff4600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.063327:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063330:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063335:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147146.063337:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.063339:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063343:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063349:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063354:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063358:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063361:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff4000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.063363:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063367:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063371:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553e00) 00010000:00010000:2.0:1746147146.063372:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.063374:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063377:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.063404:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056dfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e9 expref: 48 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.063410:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e9 expref: 48 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.063417:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4200, rc 0) 00000100:00100000:2.0:1746147146.063442:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32453:x1830967308090496:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 508us (986us total) trans 8589936042 rc 301/301 00000100:00100000:2.0:1746147146.063448:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15337 00000100:00100000:2.0:1746147146.064026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.064149:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308090240 00000100:00100000:3.0:1746147146.064153:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308090240 00002000:00100000:3.0:1746147146.064173:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1306624->1310719) req@ffff8800984d6d80 x1830967308090240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.064181:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6d80 with x1830967308090240 ext(1306624->1310719) 00002000:00010000:3.0:1746147146.064185:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d6d80 00000100:00100000:3.0:1746147146.064207:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3619 00000100:00100000:3.0:1746147146.064212:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967308090240:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147146.064288:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967308090240:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 76us (263us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147146.064293:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3619 00002000:00100000:3.0:1746147146.064297:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1306624->1310719) req@ffff8800984d6d80 x1830967308090240/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.064303:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6d80 with x1830967308090240 ext(1306624->1310719) 00002000:00010000:3.0:1746147146.064305:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d6d80 00000100:00100000:3.0:1746147146.069385:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308089984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14638us (15776us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.069397:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3618 00002000:00100000:3.0:1746147146.069407:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801349a0000 x1830967308089984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.069416:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0000 with x1830967308089984 ext(0->1048575) 00002000:00010000:3.0:1746147146.069421:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0000 00000100:00100000:2.0:1746147146.069491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.069573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.069682:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308090880 00000100:00100000:0.0:1746147146.069690:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308090880 00000100:00100000:0.0:1746147146.069721:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14825 00000100:00100000:0.0:1746147146.069727:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32444:x1830967308090880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.069742:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.069757:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783f0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147146.069773:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x68141749, atime: 0x68141749, ctime: 0x68141749, blocks: 0x1590 00010000:00010000:0.0:1746147146.069788:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.069790:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.069796:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.069809:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.069822:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31400, rc 0) 00000100:00100000:0.0:1746147146.069843:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:32444:x1830967308090880:12345-192.168.204.25@tcp:101:cat.0 Request processed in 116us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.069848:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14825 00000100:00100000:3.0:1746147146.071086:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308090752 00000100:00100000:3.0:1746147146.071117:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308090752 00000100:00100000:3.0:1746147146.071154:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5511 00000100:00100000:3.0:1746147146.071159:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:32448:x1830967308090752:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147146.071308:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:32448:x1830967308090752:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 147us (1816us total) trans 8589936043 rc 0/0 00000100:00100000:3.0:1746147146.071313:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5511 00000100:00100000:0.0:1746147146.074544:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.074586:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308091008 00000100:00100000:2.0:1746147146.074594:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308091008 00010000:00010000:2.0:1746147146.074626:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.074662:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6532 00000100:00100000:2.0:1746147146.074669:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967308091008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.074682:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.074697:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.074708:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.074726:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31a00/0x3139939425056d3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7839c expref: 7 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.074756:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.074757:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.074761:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.074773:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.074801:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.074842:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+6:2002:x1830967308091008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 173us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.074848:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6532 00010000:00010000:3.0:1746147146.075003:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075011:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075027:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075033:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075040:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075046:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147146.075048:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075055:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075065:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.075074:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6e00/0x3139939425056d7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.075136:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2000:x1830967308085760:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 65367us (66312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.075143:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14817 00000100:00100000:0.0:1746147146.075480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.075582:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308091264 00000100:00100000:3.0:1746147146.075585:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308091264 00002000:00100000:3.0:1746147146.075609:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801349a2d80 x1830967308091264/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.075617:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2d80 with x1830967308091264 ext(3145728->4194303) 00002000:00010000:3.0:1746147146.075620:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a2d80 00000100:00100000:3.0:1746147146.076298:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3620 00000100:00100000:3.0:1746147146.076307:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308091264:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147146.084211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.084263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.084356:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308091392 00000100:00100000:3.0:1746147146.084365:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308091392 00000100:00100000:3.0:1746147146.087181:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14826 00000100:00100000:3.0:1746147146.087195:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:32450:x1830967308091392:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147146.087241:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308091648 00000100:00100000:2.0:1746147146.087248:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308091648 00000100:00100000:2.0:1746147146.087282:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15338 00000100:00100000:2.0:1746147146.087288:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:32445:x1830967308091648:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:3.0:1746147146.087300:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.087318:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783f7 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.087325:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746147146.087341:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 5 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.087345:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425056d2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78387 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.087352:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.087354:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.087357:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.087376:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095052a00/0x3139939425056884 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780e7 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.087385:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.087389:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.087443:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32445:x1830967308091648:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 154us (3178us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746147146.087449:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15338 00010000:00010000:3.0:1746147146.087919:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 5 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.087931:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 5 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.087942:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310721920:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.088006:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.089293:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308091264:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12981us (13806us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.089303:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3620 00002000:00100000:3.0:1746147146.089312:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801349a2d80 x1830967308091264/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.089320:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2d80 with x1830967308091264 ext(3145728->4194303) 00002000:00010000:3.0:1746147146.089324:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a2d80 00000100:00100000:0.0:1746147146.089975:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.090027:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308091904 00000100:00100000:1.0:1746147146.090033:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308091904 00000100:00100000:1.0:1746147146.090078:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5512 00000100:00100000:1.0:1746147146.090085:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:32445:x1830967308091904:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147146.090640:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32445:x1830967308091904:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 555us (666us total) trans 8589936044 rc 0/0 00000100:00100000:1.0:1746147146.090646:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5512 00000100:00100000:3.0:1746147146.091051:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310721920:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.091073:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.091109:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57c1a00, rc 0) 00000100:00100000:3.0:1746147146.091129:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:32450:x1830967308091392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3939us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.091135:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14826 00000100:00100000:0.0:1746147146.103616:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.103725:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308092288 00000100:00100000:1.0:1746147146.103734:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308092288 00000100:00100000:1.0:1746147146.103792:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5513 00000100:00100000:1.0:1746147146.103801:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32445:x1830967308092288:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147146.104031:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:32445:x1830967308092288:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 230us (424us total) trans 8589936045 rc 0/0 00000100:00100000:1.0:1746147146.104038:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5513 00000100:00100000:0.0:1746147146.112472:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.112538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.112637:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308092416 00000100:00100000:2.0:1746147146.112649:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308092416 00000100:00100000:3.0:1746147146.112665:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308092032 00000100:00100000:3.0:1746147146.112673:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308092032 00000100:00100000:2.0:1746147146.112714:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14827 00000100:00100000:2.0:1746147146.112723:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+7:32444:x1830967308092416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.112739:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.112755:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e783fe expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147146.112776:0:12201:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x68141749, atime: 0x68141749, ctime: 0x68141749, blocks: 0x1008 00010000:00010000:2.0:1746147146.112794:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.112795:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.112801:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.112813:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.112822:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5c00, rc 0) 00000100:00100000:2.0:1746147146.112891:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+8:32444:x1830967308092416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.112897:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14827 00002000:00100000:3.0:1746147146.113151:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1200128->1310719) req@ffff88009452b480 x1830967308092032/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.113163:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b480 with x1830967308092032 ext(1200128->1310719) 00010000:00010000:3.0:1746147146.113172:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 7 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.113186:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 7 pid: 9586 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746147146.113193:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452b480 00000100:00100000:3.0:1746147146.113220:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1144 00000100:00100000:3.0:1746147146.113226:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967308092032:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147146.126768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.127208:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308092032:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 13979us (15129us total) trans 21474841517 rc 0/0 00000100:00100000:3.0:1746147146.127222:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1144 00002000:00100000:3.0:1746147146.127234:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1200128->1310719) req@ffff88009452b480 x1830967308092032/t21474841517(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.127251:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009452b480 with x1830967308092032 ext(1200128->1310719) 00010000:00010000:3.0:1746147146.127263:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 9 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.127283:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 9 pid: 9586 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746147146.127290:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009452b480 00000100:00100000:3.0:1746147146.127313:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308092672 00000100:00100000:3.0:1746147146.127320:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308092672 00002000:00100000:3.0:1746147146.127347:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880094529500 x1830967308092672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.127354:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529500 with x1830967308092672 ext(3145728->4194303) 00002000:00010000:3.0:1746147146.127357:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094529500 00000100:00100000:3.0:1746147146.127373:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3621 00000100:00100000:3.0:1746147146.127379:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967308092672:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147146.139585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.141344:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308092800 00000100:00100000:2.0:1746147146.141356:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308092800 00010000:00010000:2.0:1746147146.141403:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 11 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.141448:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6533 00000100:00100000:2.0:1746147146.141457:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:2000:x1830967308092800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.141473:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.141494:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 11 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.141507:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 11 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.141531:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425056df5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1310719) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783e2 expref: 11 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.141550:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.141552:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.141559:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.141567:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.141601:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147146.141613:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310722048:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147146.141729:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.142977:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967308092672:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15593us (16214us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.142987:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3621 00002000:00100000:3.0:1746147146.142996:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880094529500 x1830967308092672/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.143004:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529500 with x1830967308092672 ext(3145728->4194303) 00002000:00010000:3.0:1746147146.143009:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094529500 00000100:00100000:2.0:1746147146.146752:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310722048:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147146.146773:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.146830:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308092800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5373us (7258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.146840:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6533 00000100:00100000:3.0:1746147146.147059:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.148931:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093056 00000100:00100000:0.0:1746147146.148942:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093056 00002000:00100000:0.0:1746147146.148990:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097095c00 x1830967308093056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.149001:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095c00 with x1830967308093056 ext(1048576->2097151) 00002000:00010000:0.0:1746147146.149007:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097095c00 00000100:00100000:0.0:1746147146.149042:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3622 00000100:00100000:0.0:1746147146.149050:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308093056:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.152919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.153013:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093312 00000100:00100000:1.0:1746147146.153023:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093312 00002000:00100000:1.0:1746147146.153064:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880097097b80 x1830967308093312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.153074:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097097b80 with x1830967308093312 ext(4194304->4919295) 00002000:00010000:1.0:1746147146.153080:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097097b80 00000100:00100000:1.0:1746147146.153565:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3623 00000100:00100000:1.0:1746147146.153575:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967308093312:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147146.156602:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.157038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.157065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.157107:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093440 00000100:00100000:0.0:1746147146.157115:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093440 00000100:00100000:1.0:1746147146.158064:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093568 00000100:00100000:1.0:1746147146.158075:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093568 00000100:00100000:3.0:1746147146.158117:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093696 00000100:00100000:1.0:1746147146.158127:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14828 00000100:00100000:3.0:1746147146.158129:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093696 00000100:00100000:1.0:1746147146.158135:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308093440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.158153:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.158173:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78405 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.158179:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14829 00000100:00100000:3.0:1746147146.158188:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:2003:x1830967308093568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.158197:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.158199:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.158204:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.158209:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.158220:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7840c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.158225:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.158236:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04600, rc 0) 00010000:00010000:3.0:1746147146.158238:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.158240:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.158248:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.158261:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.158271:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e81800, rc 0) 00000100:00100000:1.0:1746147146.158287:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967308093440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 153us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.158293:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14828 00000100:00100000:1.0:1746147146.158310:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14830 00000100:00100000:3.0:1746147146.158314:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308093568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 127us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.158316:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308093696:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147146.158321:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14829 00010000:00010000:1.0:1746147146.158325:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.158336:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78413 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147146.158354:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x68141749, atime: 0x68141748, ctime: 0x68141749, blocks: 0x808 00010000:00010000:1.0:1746147146.158364:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.158367:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.158371:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.158381:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.158388:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04a00, rc 0) 00000100:00100000:3.0:1746147146.158393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.158406:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308093696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 90us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.158412:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14830 00000100:00100000:3.0:1746147146.158414:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093824 00000100:00100000:3.0:1746147146.158417:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093824 00000100:00100000:0.0:1746147146.158503:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14831 00000100:00100000:0.0:1746147146.158510:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967308093824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.158517:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.158526:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7841a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147146.158538:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x68141748, atime: 0x68141748, ctime: 0x68141748, blocks: 0x800 00010000:00010000:0.0:1746147146.158546:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.158547:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.158552:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.158561:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.158568:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380600, rc 0) 00000100:00100000:0.0:1746147146.158585:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308093824:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.158597:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14831 00000100:00100000:0.0:1746147146.163917:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308093056:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14856us (16846us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147146.163930:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3622 00002000:00100000:0.0:1746147146.163942:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097095c00 x1830967308093056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.163957:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095c00 with x1830967308093056 ext(1048576->2097151) 00002000:00010000:0.0:1746147146.163962:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097095c00 00000100:00100000:0.0:1746147146.164899:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308093312:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11323us (11990us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147146.164908:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3623 00002000:00100000:0.0:1746147146.164915:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880097097b80 x1830967308093312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 724992/724992 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.164922:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097097b80 with x1830967308093312 ext(4194304->4919295) 00002000:00010000:0.0:1746147146.164926:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097097b80 00000100:00100000:1.0:1746147146.179428:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.179691:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308093952 00000100:00100000:3.0:1746147146.179701:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308093952 00000100:00100000:3.0:1746147146.179758:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14832 00000100:00100000:3.0:1746147146.179767:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:32450:x1830967308093952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.179787:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.179809:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78421 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.179836:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.179837:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.179845:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.179860:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.179881:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e81e00, rc 0) 00000100:00100000:3.0:1746147146.179936:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:32450:x1830967308093952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 170us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.179943:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14832 00000100:00100000:0.0:1746147146.185298:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.185512:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308094208 00000100:00100000:2.0:1746147146.185523:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308094208 00002000:00100000:2.0:1746147146.185581:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880096cf9880 x1830967308094208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.185592:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9880 with x1830967308094208 ext(1048576->2097151) 00002000:00010000:2.0:1746147146.185598:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf9880 00000100:00100000:2.0:1746147146.185704:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3624 00000100:00100000:2.0:1746147146.185713:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308094208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.205252:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308094208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19527us (19948us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147146.205263:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3624 00002000:00100000:2.0:1746147146.205274:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880096cf9880 x1830967308094208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.205284:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9880 with x1830967308094208 ext(1048576->2097151) 00002000:00010000:2.0:1746147146.205290:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf9880 00000100:00100000:0.0:1746147146.210411:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.210488:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308094464 00000100:00100000:2.0:1746147146.210497:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308094464 00000100:00100000:2.0:1746147146.210539:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15339 00000100:00100000:2.0:1746147146.210546:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+30:32458:x1830967308094464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147146.210569:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.210586:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78428 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.210649:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210659:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210669:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210680:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210685:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210691:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210765:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210775:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210781:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147146.210788:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.210848:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210854:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210858:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210864:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210880:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff4000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.210885:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210891:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210901:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147146.210903:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.210906:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.210911:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4000/0x3139939425056e5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212137:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212146:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212152:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212156:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff4200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.212159:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212164:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212172:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553c00) 00010000:00010000:2.0:1746147146.212175:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.212178:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212186:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425056e65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.212230:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425056e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.212240:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.212245:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.212247:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147146.212249:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4a00, rc 0) 00000100:00100000:2.0:1746147146.212312:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+32:32458:x1830967308094464:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1765us (1908us total) trans 8589936046 rc 0/0 00000100:00100000:2.0:1746147146.212319:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15339 00000100:00100000:1.0:1746147146.212557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.212937:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308094592 00000100:00100000:0.0:1746147146.212943:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308094592 00000100:00100000:0.0:1746147146.212985:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14833 00000100:00100000:0.0:1746147146.212992:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32450:x1830967308094592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.213004:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.213019:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7842f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.213036:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.213037:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.213043:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.213057:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.213066:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381e00, rc 0) 00000100:00100000:0.0:1746147146.213115:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32450:x1830967308094592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 123us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.213120:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14833 00000100:00100000:0.0:1746147146.214437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.214507:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308094720 00000100:00100000:3.0:1746147146.214511:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308094720 00000100:00100000:3.0:1746147146.214538:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14834 00000100:00100000:3.0:1746147146.214545:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:32453:x1830967308094720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.214555:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.214567:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78436 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.214587:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.214598:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.214604:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.214605:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.214608:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1433600->2097151] (req 1433600->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.214633:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.214643:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.214653:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310722176:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.214907:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.214915:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 9 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.214923:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310722304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.214943:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.222423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.223582:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308094976 00000100:00100000:2.0:1746147146.223592:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308094976 00002000:00100000:2.0:1746147146.223640:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801305f2d80 x1830967308094976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.224355:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2d80 with x1830967308094976 ext(1048576->2097151) 00002000:00010000:2.0:1746147146.224361:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f2d80 00000100:00100000:2.0:1746147146.224387:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3625 00000100:00100000:2.0:1746147146.224395:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967308094976:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147146.226847:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310722176:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.228792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.229189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.229270:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310722304:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.229299:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1433600->2097151] (req 1433600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.229316:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099055a00, rc 0) 00000100:00100000:3.0:1746147146.229357:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32453:x1830967308094720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 14812us (14923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.229365:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14834 00000100:00100000:3.0:1746147146.229389:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308095104 00000100:00100000:3.0:1746147146.229394:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308095104 00000100:00100000:3.0:1746147146.229425:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14835 00000100:00100000:3.0:1746147146.229431:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32458:x1830967308095104:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.229443:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.229454:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7843d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.229472:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.229477:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1433600->2097151] (req 1433600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.229482:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.229485:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1703936->1900543] (req 1703936->1900543) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.229506:0:9585:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1433600->2097151] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.229518:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1703936->1900543] (req 1703936->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.229524:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f007e00, rc 0) 00000100:00100000:3.0:1746147146.229537:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32458:x1830967308095104:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 107us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.229541:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14835 00000100:00100000:1.0:1746147146.230212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.230274:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308095232 00000100:00100000:2.0:1746147146.230279:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308095232 00010000:00010000:2.0:1746147146.230299:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 11 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746147146.230318:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308095360 00000100:00100000:2.0:1746147146.230319:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308095360 00010000:00010000:2.0:1746147146.230327:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.230339:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6534 00000100:00100000:2.0:1746147146.230344:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308095232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.230354:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.230369:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 11 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746147146.230377:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 11 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746147146.230393:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04a00/0x3139939425056e42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78413 expref: 11 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.230465:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6535 00000100:00100000:1.0:1746147146.230471:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308095360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.230477:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.230485:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.230494:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.230504:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81e00/0x3139939425056e50 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78421 expref: 24 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.230520:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.230522:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.230527:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.230533:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.230552:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.230560:0:8909:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.230570:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310722560:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147146.230615:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00010000:00010000:2.0:1746147146.231581:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.231610:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967308095232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1263us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.231617:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6534 00000100:00100000:0.0:1746147146.234866:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310722560:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147146.234894:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.235040:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967308094976:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10643us (12622us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.235050:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3625 00002000:00100000:3.0:1746147146.235060:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801305f2d80 x1830967308094976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.235069:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2d80 with x1830967308094976 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.235073:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f2d80 00000100:00100000:0.0:1746147146.236333:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967308095360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5856us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.236341:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6535 00000100:00100000:0.0:1746147146.244752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.244789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.244829:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308095744 00000100:00100000:2.0:1746147146.244837:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308095744 00000100:00100000:0.0:1746147146.245417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.246302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.246322:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308095488 00000100:00100000:2.0:1746147146.246326:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308095488 00000100:00100000:0.0:1746147146.246333:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14836 00000100:00100000:0.0:1746147146.246343:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32453:x1830967308095744:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:2.0:1746147146.246357:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14837 00010000:00010000:0.0:1746147146.246360:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147146.246363:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308095488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.246370:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.246377:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7844b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.246378:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78444 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.246395:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.246396:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.246399:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.246402:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.246406:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.246411:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.246413:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.246415:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.246416:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.246423:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4600, rc 0) 00010000:00010000:0.0:1746147146.246441:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.246450:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 29 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.246461:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310722688:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.246462:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967308095488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 98us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.246468:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14837 00000100:00100000:2.0:1746147146.246491:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308095872 00000100:00100000:2.0:1746147146.246494:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308095872 00010000:00010000:0.0:1746147146.246508:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746147146.246516:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1433600->2097151) req@ffff8801305f3100 x1830967308095872/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746147146.246516:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 11 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746147146.246523:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310722816:192.168.204.25@tcp:104: 00002000:00100000:2.0:1746147146.246524:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3100 with x1830967308095872 ext(1433600->2097151) 00010000:00010000:2.0:1746147146.246530:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.246538:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 23 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.246538:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00002000:00010000:2.0:1746147146.246548:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305f3100 00000100:00100000:2.0:1746147146.246559:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1145 00000100:00100000:2.0:1746147146.246563:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308095872:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147146.246888:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308096000 00000100:00100000:0.0:1746147146.246892:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308096000 00000100:00100000:0.0:1746147146.246917:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14838 00000100:00100000:0.0:1746147146.246921:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308096000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.246927:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.246936:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78452 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.246946:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.246948:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.246952:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.246961:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.246967:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd200, rc 0) 00000100:00100000:0.0:1746147146.246997:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967308096000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 74us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.247002:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14838 00000100:00100000:0.0:1746147146.254283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.254306:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310722688:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.254319:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310722816:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.254331:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308095872:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7766us (9540us total) trans 21474841518 rc 0/0 00000100:00100000:2.0:1746147146.254340:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1145 00010000:00010000:1.0:1746147146.254344:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147146.254349:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1433600->2097151) req@ffff8801305f3100 x1830967308095872/t21474841518(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.254357:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3100 with x1830967308095872 ext(1433600->2097151) 00010000:00010000:1.0:1746147146.254359:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381c00, rc 0) 00010000:00010000:2.0:1746147146.254365:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.254376:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.254376:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32453:x1830967308095744:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8035us (9632us total) trans 0 rc 0/0 00002000:00010000:2.0:1746147146.254382:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305f3100 00000100:00100000:1.0:1746147146.254383:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14836 00000100:00100000:3.0:1746147146.254395:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308096128 00000100:00100000:3.0:1746147146.254402:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308096128 00010000:00010000:3.0:1746147146.254426:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 12 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.254463:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6536 00000100:00100000:3.0:1746147146.254470:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308096128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.254481:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.254495:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 12 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746147146.254499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147146.254508:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 12 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.254529:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425056e49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7841a expref: 12 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.254544:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.254545:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308096256 00000100:00100000:1.0:1746147146.254549:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308096256 00010000:00010000:1.0:1746147146.254564:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 28 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.254571:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308096128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.254577:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6536 00000100:00100000:1.0:1746147146.254582:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6537 00000100:00100000:1.0:1746147146.254586:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308096256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.254594:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.254601:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 28 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.254609:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 28 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.254620:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425056e7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7842f expref: 28 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.254633:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.254635:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.254641:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.254647:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.254671:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.254681:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310722944:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147146.254729:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.259775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.259866:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310722944:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147146.259897:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.260034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.260116:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308096256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5527us (5616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.260127:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308096384 00000100:00100000:1.0:1746147146.260129:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6537 00000100:00100000:2.0:1746147146.260135:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308096384 00010000:00010000:2.0:1746147146.260170:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.260189:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6538 00000100:00100000:1.0:1746147146.260196:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967308096384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.260208:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147146.260223:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147145 -> 1746147146 00002000:00010000:1.0:1746147146.260226:0:7226:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147145 -> 1746147146 00010000:00010000:1.0:1746147146.260232:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.260244:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.260266:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425056e81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78436 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.260281:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.260283:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.260290:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.260299:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.260326:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.260337:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310723072:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147146.260379:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147146.260415:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308096640 00000100:00100000:1.0:1746147146.260418:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308096640 00002000:00100000:1.0:1746147146.260442:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1212416->1216511) req@ffff880098822a00 x1830967308096640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.260451:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822a00 with x1830967308096640 ext(1212416->1216511) 00002000:00010000:1.0:1746147146.260455:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822a00 00000100:00100000:1.0:1746147146.260477:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3626 00000100:00100000:1.0:1746147146.260481:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308096640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147146.260580:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308096640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 98us (546us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147146.260586:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3626 00002000:00100000:1.0:1746147146.260591:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1212416->1216511) req@ffff880098822a00 x1830967308096640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.260598:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822a00 with x1830967308096640 ext(1212416->1216511) 00002000:00010000:1.0:1746147146.260601:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822a00 00000100:00100000:0.0:1746147146.260929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.261510:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308096896 00000100:00100000:1.0:1746147146.261514:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308096896 00002000:00100000:1.0:1746147146.261534:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098820e00 x1830967308096896/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.261542:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820e00 with x1830967308096896 ext(2097152->4194303) 00002000:00010000:1.0:1746147146.261546:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820e00 00000100:00100000:1.0:1746147146.261567:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3627 00000100:00100000:1.0:1746147146.261572:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308096896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147146.262182:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310723072:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147146.262198:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.262240:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308096384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2044us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.262247:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6538 00000100:00100000:0.0:1746147146.263024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.263054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.263100:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.263129:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308097664 00000100:00100000:3.0:1746147146.263132:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308097152 00000100:00100000:0.0:1746147146.263134:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308097664 00000100:00100000:3.0:1746147146.263143:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308097152 00000100:00100000:0.0:1746147146.263161:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5514 00000100:00100000:0.0:1746147146.263166:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32453:x1830967308097664:12345-192.168.204.25@tcp:35:multiop.0 00002000:00100000:3.0:1746147146.263182:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880095235500 x1830967308097152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.263193:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235500 with x1830967308097152 ext(2097152->4194303) 00002000:00010000:3.0:1746147146.263197:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095235500 00000100:00100000:3.0:1746147146.263217:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308097408 00000100:00100000:3.0:1746147146.263219:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308097408 00002000:00100000:3.0:1746147146.263233:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1703936->1708031) req@ffff880095234700 x1830967308097408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.263239:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234700 with x1830967308097408 ext(1703936->1708031) 00002000:00010000:3.0:1746147146.263242:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095234700 00000100:00100000:2.0:1746147146.263243:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3628 00000100:00100000:2.0:1746147146.263253:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308097152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.263259:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3629 00000100:00100000:3.0:1746147146.263266:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308097408:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147146.263355:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32453:x1830967308097664:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 188us (267us total) trans 8589936047 rc 0/0 00000100:00100000:0.0:1746147146.263360:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5514 00000100:00100000:3.0:1746147146.263388:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308097408:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 121us (332us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147146.263394:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3629 00002000:00100000:3.0:1746147146.263400:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1703936->1708031) req@ffff880095234700 x1830967308097408/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.263406:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234700 with x1830967308097408 ext(1703936->1708031) 00002000:00010000:3.0:1746147146.263409:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095234700 00000100:00100000:2.0:1746147146.271680:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.271736:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308097920 00000100:00100000:3.0:1746147146.271747:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308097920 00002000:00100000:3.0:1746147146.271782:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1896448->1900543) req@ffff8800984d6680 x1830967308097920/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.271791:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6680 with x1830967308097920 ext(1896448->1900543) 00002000:00010000:3.0:1746147146.271796:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d6680 00000100:00100000:3.0:1746147146.271822:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3630 00000100:00100000:3.0:1746147146.271828:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308097920:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147146.271968:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308097920:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 140us (427us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147146.271973:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3630 00002000:00100000:3.0:1746147146.271978:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1896448->1900543) req@ffff8800984d6680 x1830967308097920/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.271984:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6680 with x1830967308097920 ext(1896448->1900543) 00002000:00010000:3.0:1746147146.271987:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d6680 00000100:00100000:1.0:1746147146.278980:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308096896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17392us (18036us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147146.278994:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3627 00002000:00100000:1.0:1746147146.279006:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098820e00 x1830967308096896/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.279017:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820e00 with x1830967308096896 ext(2097152->4194303) 00002000:00010000:1.0:1746147146.279025:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098820e00 00000100:00100000:2.0:1746147146.292218:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308097152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28958us (29190us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147146.292230:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3628 00002000:00100000:2.0:1746147146.292241:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880095235500 x1830967308097152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.292250:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235500 with x1830967308097152 ext(2097152->4194303) 00002000:00010000:2.0:1746147146.292255:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095235500 00000100:00100000:0.0:1746147146.294735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.294828:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308098176 00000100:00100000:2.0:1746147146.294836:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308098176 00000100:00100000:2.0:1746147146.295183:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5515 00000100:00100000:2.0:1746147146.295190:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:32458:x1830967308098176:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147146.296568:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+33:32458:x1830967308098176:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1374us (1836us total) trans 8589936048 rc 0/0 00000100:00100000:2.0:1746147146.296576:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5515 00000100:00100000:0.0:1746147146.298924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.298980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.299061:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308098304 00000100:00100000:3.0:1746147146.299072:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308098304 00000100:00100000:1.0:1746147146.299150:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308098432 00000100:00100000:1.0:1746147146.299158:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308098432 00000100:00100000:3.0:1746147146.299182:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14839 00000100:00100000:1.0:1746147146.299338:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14840 00000100:00100000:1.0:1746147146.299346:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308098432:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.299370:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.299394:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x3139939425056ea4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78460 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.299473:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308098304:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.299493:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.299514:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x3139939425056eab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78459 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.299551:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310723200:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147146.299645:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310723328:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147146.299909:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.300061:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00002000:00010000:1.0:1746147146.301561:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147144 -> 1746147146 00002000:00010000:1.0:1746147146.301566:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147144 -> 1746147146 00002000:00010000:1.0:1746147146.301568:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147144 -> 1746147146 00000100:00100000:1.0:1746147146.301584:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310723200:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147146.301608:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x3139939425056ea4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78460 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.301620:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x3139939425056ea4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78460 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.301643:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7c00, rc 0) 00002000:00010000:3.0:1746147146.301747:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147144 -> 1746147146 00000100:00100000:1.0:1746147146.301751:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308098432:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2405us (2769us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.301759:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310723328:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147146.301759:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14840 00010000:00010000:3.0:1746147146.301775:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x3139939425056eab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78459 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.301917:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x3139939425056eab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78459 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.301940:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c000, rc 0) 00000100:00100000:3.0:1746147146.301961:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308098304:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2771us (3048us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.301967:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14839 00000100:00100000:0.0:1746147146.309144:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.309175:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.309221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.309386:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308098944 00000100:00100000:2.0:1746147146.309392:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308099200 00000100:00100000:1.0:1746147146.309392:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308099456 00000100:00100000:0.0:1746147146.309396:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308098944 00000100:00100000:2.0:1746147146.309406:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308099200 00000100:00100000:1.0:1746147146.309406:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308099456 00002000:00100000:0.0:1746147146.309444:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880095236d80 x1830967308098944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 504/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.309448:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880095234a80 x1830967308099200/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.309448:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095234380 x1830967308099456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.309451:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095236d80 with x1830967308098944 ext(1048576->2097151) 00002000:00010000:0.0:1746147146.309456:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095236d80 00002000:00100000:2.0:1746147146.309458:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234a80 with x1830967308099200 ext(0->1048575) 00002000:00100000:1.0:1746147146.309458:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234380 with x1830967308099456 ext(4194304->4919295) 00002000:00010000:2.0:1746147146.309463:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234a80 00002000:00010000:1.0:1746147146.309463:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234380 00000100:00100000:0.0:1746147146.309481:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3631 00000100:00100000:0.0:1746147146.309486:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308098944:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.309814:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3632 00000100:00100000:2.0:1746147146.309822:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308099456:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147146.309828:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3633 00000100:00100000:1.0:1746147146.309835:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967308099200:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147146.310220:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.310242:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308098816 00000100:00100000:3.0:1746147146.310247:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308098816 00002000:00100000:3.0:1746147146.310264:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880095237b80 x1830967308098816/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.310271:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237b80 with x1830967308098816 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.310276:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237b80 00000100:00100000:3.0:1746147146.310288:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3634 00000100:00100000:3.0:1746147146.310293:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308098816:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.326041:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308098944:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16545us (16900us total) trans 0 rc 851968/851968 00000100:00100000:2.0:1746147146.326053:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3631 00002000:00100000:2.0:1746147146.326064:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880095236d80 x1830967308098944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 504/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 851968/851968 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.326072:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095236d80 with x1830967308098944 ext(1048576->2097151) 00002000:00010000:2.0:1746147146.326078:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095236d80 00000100:00100000:3.0:1746147146.328072:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308099456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18245us (18842us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147146.328081:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3632 00002000:00100000:3.0:1746147146.328104:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095234380 x1830967308099456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.328111:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234380 with x1830967308099456 ext(4194304->4919295) 00002000:00010000:3.0:1746147146.328117:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234380 00000100:00100000:1.0:1746147146.329459:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:2003:x1830967308099200:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19620us (20278us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147146.329468:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3633 00002000:00100000:1.0:1746147146.329475:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880095234a80 x1830967308099200/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.329486:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234a80 with x1830967308099200 ext(0->1048575) 00002000:00010000:1.0:1746147146.329489:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234a80 00000100:00100000:3.0:1746147146.330162:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967308098816:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19867us (19942us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.330168:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3634 00002000:00100000:3.0:1746147146.330173:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880095237b80 x1830967308098816/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.330180:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237b80 with x1830967308098816 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.330184:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237b80 00000100:00100000:0.0:1746147146.335724:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.336166:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308099584 00000100:00100000:3.0:1746147146.336175:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308099584 00000100:00100000:3.0:1746147146.336282:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14841 00000100:00100000:3.0:1746147146.336290:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308099584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.336307:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.336324:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x3139939425056eb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78467 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.336374:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310723456:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147146.336877:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.339623:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310723456:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147146.339650:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x3139939425056eb2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78467 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.339663:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x3139939425056eb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78467 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.339691:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fec00, rc 0) 00000100:00100000:3.0:1746147146.339732:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308099584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3442us (4016us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.339739:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14841 00000100:00100000:0.0:1746147146.348235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.348398:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308099712 00000100:00100000:3.0:1746147146.348408:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308099712 00000100:00100000:3.0:1746147146.348455:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14842 00000100:00100000:3.0:1746147146.348463:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308099712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.348480:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.348497:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x3139939425056eb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7846e expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.348545:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310723584:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147146.348644:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.350178:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.350252:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308099840 00000100:00100000:1.0:1746147146.350258:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308099840 00000100:00100000:1.0:1746147146.350289:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14843 00000100:00100000:1.0:1746147146.350295:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+11:32462:x1830967308099840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.350308:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.350320:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78475 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.350344:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.350350:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147146.350352:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147146.350355:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.350376:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.350386:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 26 pid: 9585 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.350395:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310723712:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.350548:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.351876:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310723584:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147146.351900:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x3139939425056eb9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7846e expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.351911:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x3139939425056eb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7846e expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.351932:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe800, rc 0) 00000100:00100000:3.0:1746147146.351962:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308099712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3500us (3741us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.351974:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14842 00000100:00100000:0.0:1746147146.352062:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310723712:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147146.352079:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.352105:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6400, rc 0) 00000100:00100000:2.0:1746147146.352162:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:32462:x1830967308099840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1862us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.352169:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14843 00000100:00100000:0.0:1746147146.352558:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.353078:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308099968 00000100:00100000:3.0:1746147146.353241:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308099968 00002000:00100000:3.0:1746147146.353714:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1216511) req@ffff880097d76a00 x1830967308099968/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.353725:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76a00 with x1830967308099968 ext(1048576->1216511) 00010000:00010000:3.0:1746147146.353733:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 27 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.353745:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 27 pid: 9585 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746147146.353751:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d76a00 00000100:00100000:3.0:1746147146.353779:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1146 00000100:00100000:3.0:1746147146.353786:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308099968:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147146.357613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.357763:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308100224 00000100:00100000:2.0:1746147146.357770:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308100224 00000100:00100000:2.0:1746147146.357818:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5516 00000100:00100000:2.0:1746147146.357826:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32450:x1830967308100224:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147146.358119:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32450:x1830967308100224:12345-192.168.204.25@tcp:35:cat.0 Request processed in 293us (515us total) trans 8589936049 rc 0/0 00000100:00100000:2.0:1746147146.358125:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5516 00000100:00100000:3.0:1746147146.363117:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308099968:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9302us (10530us total) trans 17179874249 rc 0/0 00000100:00100000:3.0:1746147146.363132:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1146 00002000:00100000:3.0:1746147146.363143:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1216511) req@ffff880097d76a00 x1830967308099968/t17179874249(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.363152:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76a00 with x1830967308099968 ext(1048576->1216511) 00010000:00010000:3.0:1746147146.363161:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.363175:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746147146.363181:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d76a00 00000100:00100000:0.0:1746147146.367264:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.367373:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308100352 00000100:00100000:2.0:1746147146.367382:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308100352 00010000:00010000:2.0:1746147146.367415:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.367441:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6539 00000100:00100000:2.0:1746147146.367448:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967308100352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.367461:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.367477:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.367488:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.367506:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381c00/0x3139939425056e8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7844b expref: 29 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.367537:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.367539:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.367544:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.367551:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.367577:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147146.367587:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310723840:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147146.367665:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147146.369122:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310723840:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147146.369139:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.369171:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308100352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1723us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.369180:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6539 00000100:00100000:0.0:1746147146.373486:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.375352:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308100608 00000100:00100000:3.0:1746147146.375365:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308100608 00002000:00100000:3.0:1746147146.375409:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880097d75500 x1830967308100608/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.375419:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75500 with x1830967308100608 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.375425:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d75500 00000100:00100000:3.0:1746147146.375453:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3635 00000100:00100000:3.0:1746147146.375461:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967308100608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.385216:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967308100608:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9748us (11728us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.385228:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3635 00002000:00100000:3.0:1746147146.385238:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880097d75500 x1830967308100608/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.385252:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75500 with x1830967308100608 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.385258:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d75500 00000100:00100000:0.0:1746147146.393179:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.393298:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308100864 00000100:00100000:2.0:1746147146.393307:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308100864 00000100:00100000:2.0:1746147146.393372:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15340 00000100:00100000:2.0:1746147146.393380:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32467:x1830967308100864:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147146.393404:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.393425:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425056ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7847c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.393494:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393506:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393516:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393528:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393533:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393539:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393623:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393633:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393638:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147146.393650:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.393709:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393714:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393719:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393724:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393730:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.393739:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393745:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393755:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147146.393757:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.393761:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393766:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425056ece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393786:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393791:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393800:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393803:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.393805:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393809:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393815:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23e00) 00010000:00010000:2.0:1746147146.393817:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.393819:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393824:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543a00/0x3139939425056ed5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.393860:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425056ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 52 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.393880:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 51 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.393886:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.393887:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147146.393889:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542a00, rc 0) 00000100:00100000:2.0:1746147146.393931:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32467:x1830967308100864:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 552us (761us total) trans 8589936050 rc 0/0 00000100:00100000:2.0:1746147146.393937:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15340 00000100:00100000:0.0:1746147146.402838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.402909:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308101120 00000100:00100000:3.0:1746147146.402919:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308101120 00000100:00100000:0.0:1746147146.402932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:3.0:1746147146.402959:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097d74000 x1830967308101120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.402968:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74000 with x1830967308101120 ext(2097152->3145727) 00002000:00010000:3.0:1746147146.402973:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74000 00000100:00100000:1.0:1746147146.405376:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308101376 00000100:00100000:1.0:1746147146.405390:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308101376 00002000:00100000:1.0:1746147146.405431:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880098859f80 x1830967308101376/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.405440:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859f80 with x1830967308101376 ext(2097152->3145727) 00002000:00010000:1.0:1746147146.405445:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098859f80 00000100:00100000:1.0:1746147146.406016:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3636 00000100:00100000:1.0:1746147146.406024:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967308101120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.406168:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3637 00000100:00100000:2.0:1746147146.406177:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308101376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.417370:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+10:2000:x1830967308101376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11185us (14427us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147146.417381:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3637 00002000:00100000:2.0:1746147146.417391:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880098859f80 x1830967308101376/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.417400:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859f80 with x1830967308101376 ext(2097152->3145727) 00002000:00010000:2.0:1746147146.417405:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098859f80 00000100:00100000:1.0:1746147146.418446:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967308101120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12419us (15612us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147146.418453:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3636 00002000:00100000:1.0:1746147146.418460:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097d74000 x1830967308101120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.418467:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74000 with x1830967308101120 ext(2097152->3145727) 00002000:00010000:1.0:1746147146.418471:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74000 00000100:00100000:0.0:1746147146.434312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.434403:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308101632 00000100:00100000:2.0:1746147146.434412:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308101632 00000100:00100000:2.0:1746147146.434449:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15341 00000100:00100000:2.0:1746147146.434456:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:32469:x1830967308101632:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147146.434475:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.434491:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78483 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.434567:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.434580:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.434587:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 50 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.434595:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.434619:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 50 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.434629:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 50 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.434638:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310723968:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.434726:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.434733:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 34 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.434740:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310724096:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.434754:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147146.438454:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310723968:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.438466:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310724096:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.438484:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147146.438953:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.438990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.439054:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308101888 00000100:00100000:1.0:1746147146.439059:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308101888 00010000:00010000:1.0:1746147146.439108:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 35 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.439127:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308101760 00000100:00100000:1.0:1746147146.439129:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308101760 00010000:00010000:1.0:1746147146.439138:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 51 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.439167:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6540 00000100:00100000:1.0:1746147146.439173:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308101888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.439184:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.439188:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 35 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.439195:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 35 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.439199:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6541 00000100:00100000:3.0:1746147146.439207:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2000:x1830967308101760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.439211:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4a00/0x3139939425056e6c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78428 expref: 35 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.439214:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.439219:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 51 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.439226:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147146.439229:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147146.439740:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147146.439746:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147146.439758:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 51 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.439772:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x3139939425056edc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7847c expref: 51 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.440039:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+34:2000:x1830967308101888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 864us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.440045:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6540 00010000:00010000:3.0:1746147146.441113:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.441119:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.441127:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.441136:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.441172:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.441204:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967308101760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1996us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.441210:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6541 00010000:00010000:2.0:1746147146.441303:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.441310:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147146.441327:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.441432:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 35 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.441465:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 34 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.441471:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.441473:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147146.441475:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a400, rc 0) 00000100:00100000:2.0:1746147146.441500:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:32469:x1830967308101632:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7044us (7195us total) trans 8589936051 rc 0/0 00000100:00100000:2.0:1746147146.441505:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15341 00000100:00100000:0.0:1746147146.485934:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.486119:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102016 00000100:00100000:2.0:1746147146.486129:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102016 00000100:00100000:3.0:1746147146.487371:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14844 00000100:00100000:3.0:1746147146.487388:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:32469:x1830967308102016:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.487412:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.487437:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7848a expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.487473:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.487482:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.487489:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.487491:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.487495:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 11 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.487533:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.487554:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 24 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.487568:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310724224:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.487713:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.487723:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.487733:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310724352:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.487762:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.493236:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310724224:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.493251:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310724352:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.493285:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 11 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.493304:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff200, rc 0) 00000100:00100000:3.0:1746147146.493360:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+11:32469:x1830967308102016:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5977us (7435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.493368:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14844 00000100:00100000:0.0:1746147146.495382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.496255:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102144 00000100:00100000:3.0:1746147146.496266:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102144 00010000:00010000:3.0:1746147146.496316:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.497172:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.498345:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102272 00000100:00100000:3.0:1746147146.498353:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102272 00010000:00010000:3.0:1746147146.498386:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 25 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.498421:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6542 00000100:00100000:3.0:1746147146.498432:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+11:2001:x1830967308102144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.498453:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.498480:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.498492:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.498520:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425056e2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783fe expref: 11 pid: 12201 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.498546:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.498604:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967308102144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 172us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.498612:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6542 00000100:00100000:3.0:1746147146.498633:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6543 00000100:00100000:3.0:1746147146.498640:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308102272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.498649:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.498660:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 25 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.498670:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 25 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.498683:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425056e9d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78452 expref: 25 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.498694:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.498696:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.498703:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.498712:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.498749:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.498763:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310724480:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147146.498826:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.502785:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310724480:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147146.502814:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.502903:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967308102272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4260us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.502914:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6543 00000100:00100000:2.0:1746147146.503800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.503955:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102528 00000100:00100000:1.0:1746147146.503963:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102528 00002000:00100000:1.0:1746147146.504005:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2715648->2719743) req@ffff8800909fa680 x1830967308102528/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.504019:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa680 with x1830967308102528 ext(2715648->2719743) 00002000:00010000:1.0:1746147146.504024:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fa680 00000100:00100000:1.0:1746147146.504170:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3638 00000100:00100000:1.0:1746147146.504180:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308102528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147146.504346:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308102528:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 165us (544us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147146.504352:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3638 00002000:00100000:1.0:1746147146.504357:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2715648->2719743) req@ffff8800909fa680 x1830967308102528/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.504364:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa680 with x1830967308102528 ext(2715648->2719743) 00002000:00010000:1.0:1746147146.504367:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fa680 00000100:00100000:0.0:1746147146.510810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.511160:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102656 00000100:00100000:3.0:1746147146.511172:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102656 00000100:00100000:3.0:1746147146.511419:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14845 00000100:00100000:3.0:1746147146.511428:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:32469:x1830967308102656:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.511451:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.511474:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78491 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.511511:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.511520:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.511528:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.511530:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.511534:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 13 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.511572:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.511586:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 27 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.511600:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310724608:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.511742:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.511753:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.511762:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310724736:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.511791:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.516381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.516549:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310724608:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.516561:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310724736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.516593:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 13 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.516611:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff600, rc 0) 00000100:00100000:3.0:1746147146.516670:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:32469:x1830967308102656:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5243us (5874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.516680:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14845 00000100:00100000:2.0:1746147146.517998:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102784 00000100:00100000:2.0:1746147146.518010:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102784 00010000:00010000:2.0:1746147146.518048:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 28 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746147146.518081:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6544 00000100:00100000:2.0:1746147146.518137:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308102784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.518155:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.518180:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 28 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746147146.518192:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 28 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746147146.518223:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425056e96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78444 expref: 28 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746147146.518255:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.518296:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308102784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 205us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.518302:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6544 00000100:00100000:2.0:1746147146.519082:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.519590:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308102912 00000100:00100000:1.0:1746147146.519597:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308102912 00010000:00010000:1.0:1746147146.519621:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.519647:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6545 00000100:00100000:1.0:1746147146.519655:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967308102912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.519668:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.519683:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.519694:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.519715:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a31400/0x3139939425056e1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f0 expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.519744:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.519747:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.519755:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 12 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.519765:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 12 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.519803:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 12 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.519818:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310724864:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147146.521000:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147146.522296:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310724864:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147146.522315:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.522877:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308102912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3206us (3782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.522888:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6545 00000100:00100000:0.0:1746147146.523622:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.523734:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308103168 00000100:00100000:2.0:1746147146.523744:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308103168 00002000:00100000:2.0:1746147146.523794:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3219456->3223551) req@ffff88012f3cea00 x1830967308103168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.523804:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cea00 with x1830967308103168 ext(3219456->3223551) 00002000:00010000:2.0:1746147146.523810:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cea00 00000100:00100000:2.0:1746147146.523854:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3639 00000100:00100000:2.0:1746147146.523875:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308103168:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147146.524227:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308103168:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 363us (606us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147146.524234:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3639 00002000:00100000:2.0:1746147146.524241:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3219456->3223551) req@ffff88012f3cea00 x1830967308103168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.524247:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cea00 with x1830967308103168 ext(3219456->3223551) 00002000:00010000:2.0:1746147146.524251:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cea00 00000100:00100000:0.0:1746147146.561882:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.562390:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308103296 00000100:00100000:3.0:1746147146.562403:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308103296 00000100:00100000:3.0:1746147146.562468:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14846 00000100:00100000:3.0:1746147146.562478:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32467:x1830967308103296:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.562500:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.562521:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78498 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.562554:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.562566:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.562568:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.562571:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3149824->4108287] (req 3149824->4108287) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.562601:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 9 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.562614:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 9 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.562626:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310724992:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.563439:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.566927:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310724992:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.566951:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3149824->4108287] (req 3149824->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.566965:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe200, rc 0) 00000100:00100000:3.0:1746147146.567207:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32467:x1830967308103296:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4730us (5344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.567216:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14846 00000100:00100000:0.0:1746147146.567881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.567912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.567974:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308103424 00000100:00100000:1.0:1746147146.567979:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308103424 00002000:00100000:1.0:1746147146.568010:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2715648->3145727) req@ffff880091d94a80 x1830967308103424/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.568023:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94a80 with x1830967308103424 ext(2715648->3145727) 00000100:00100000:2.0:1746147146.569164:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308103680 00000100:00100000:2.0:1746147146.569174:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308103680 00002000:00100000:2.0:1746147146.569215:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880091d94380 x1830967308103680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.569224:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94380 with x1830967308103680 ext(2097152->3145727) 00002000:00010000:2.0:1746147146.569230:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94380 00000100:00100000:2.0:1746147146.569273:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3640 00000100:00100000:2.0:1746147146.569279:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308103680:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147146.569401:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 10 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.569415:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 10 pid: 17600 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746147146.569422:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d94a80 00000100:00100000:1.0:1746147146.569447:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1147 00000100:00100000:1.0:1746147146.569456:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:2002:x1830967308103424:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147146.577932:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308103680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8645us (10011us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147146.577943:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3640 00002000:00100000:2.0:1746147146.577953:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880091d94380 x1830967308103680/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.577962:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94380 with x1830967308103680 ext(2097152->3145727) 00002000:00010000:2.0:1746147146.577967:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94380 00000100:00100000:0.0:1746147146.579437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.580758:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308103424:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11300us (12873us total) trans 21474841519 rc 0/0 00000100:00100000:1.0:1746147146.580770:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1147 00002000:00100000:1.0:1746147146.580782:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2715648->3145727) req@ffff880091d94a80 x1830967308103424/t21474841519(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.580791:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94a80 with x1830967308103424 ext(2715648->3145727) 00010000:00010000:1.0:1746147146.580801:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 12 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.580818:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 12 pid: 17600 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746147146.580829:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d94a80 00000100:00100000:2.0:1746147146.581123:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308103936 00000100:00100000:2.0:1746147146.581132:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308103936 00000100:00100000:2.0:1746147146.581170:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15342 00000100:00100000:2.0:1746147146.581176:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32477:x1830967308103936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.581201:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.581218:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x3139939425056f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7849f expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.581287:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581303:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581314:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581325:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581330:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581335:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581430:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x3139939425056f29 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581441:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x3139939425056f29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581447:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x3139939425056f29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147146.581454:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.581528:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581534:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581539:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581545:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581550:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.581554:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581560:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581570:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147146.581573:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.581576:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581581:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x3139939425056f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581596:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581600:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581604:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581608:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ae00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.581610:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581614:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581619:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23700) 00010000:00010000:2.0:1746147146.581621:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.581623:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581628:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x3139939425056f22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.581663:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x3139939425056f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7849f expref: 53 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.581673:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x3139939425056f29 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7849f expref: 52 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.581679:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.581680:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147146.581682:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b000, rc 0) 00000100:00100000:2.0:1746147146.581724:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32477:x1830967308103936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 547us (2295us total) trans 8589936052 rc 0/0 00000100:00100000:2.0:1746147146.581730:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15342 00000100:00100000:0.0:1746147146.585005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.585127:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104064 00000100:00100000:1.0:1746147146.585135:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104064 00000100:00100000:1.0:1746147146.585195:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 823 00000100:00100000:1.0:1746147146.585204:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967308104064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.585218:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.585242:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b000/0x3139939425056f29 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7849f expref: 52 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.585264:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147146.585269:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.585320:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2001:x1830967308104064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.585326:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 823 00000100:00100000:0.0:1746147146.586317:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.586351:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.586376:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.586404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.586419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.586428:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104192 00000100:00100000:3.0:1746147146.586432:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104192 00000100:00100000:0.0:1746147146.586439:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.586465:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104320 00000100:00100000:3.0:1746147146.586467:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104320 00000100:00100000:0.0:1746147146.586470:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104448 00000100:00100000:0.0:1746147146.586472:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104448 00000100:00100000:3.0:1746147146.586481:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104576 00000100:00100000:3.0:1746147146.586483:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104576 00000100:00100000:0.0:1746147146.586492:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104832 00000100:00100000:0.0:1746147146.586494:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104832 00000100:00100000:3.0:1746147146.586495:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14847 00000100:00100000:3.0:1746147146.586500:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308104192:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147146.586506:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14848 00000100:00100000:0.0:1746147146.586510:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308104320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.586514:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.586516:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.586528:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425056f3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784a6 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.586528:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784ad expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.586544:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.586546:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.586554:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.586566:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147146.586570:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310725120:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147146.586575:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6400, rc 0) 00000100:00100000:0.0:1746147146.586596:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308104320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.586601:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14848 00000100:00100000:0.0:1746147146.586611:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14849 00000100:00100000:0.0:1746147146.586616:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308104448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147146.586621:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.586628:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7000/0x3139939425056f45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784b4 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.586642:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.586648:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310725248:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147146.586659:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14850 00000100:00100000:3.0:1746147146.586664:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308104576:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147146.586667:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147146.586669:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.586675:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425056f4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784bb expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.586678:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308104704 00000100:00100000:0.0:1746147146.586680:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308104704 00010000:00010000:0.0:1746147146.586690:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 13 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.586694:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310725376:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147146.586708:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6546 00000100:00100000:3.0:1746147146.586712:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.586712:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:2003:x1830967308104704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147146.586718:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147146.586725:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14851 00000100:00100000:3.0:1746147146.586729:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:32474:x1830967308104832:12345-192.168.204.25@tcp:101:cat.0 00002000:00010000:0.0:1746147146.586733:0:8909:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147145 -> 1746147146 00010000:00010000:3.0:1746147146.586734:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746147146.586735:0:8909:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147145 -> 1746147146 00010000:00010000:3.0:1746147146.586740:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784c2 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.586740:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 13 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.586750:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 14 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.587421:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.587424:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.587429:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.587445:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.587446:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.587450:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.587462:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.587468:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.587468:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.587471:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.587476:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.587481:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.587487:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81600, rc 0) 00010000:00010000:0.0:1746147146.587490:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.587497:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310725504:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147146.587518:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:32474:x1830967308104832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 788us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.587524:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14851 00010000:00010000:0.0:1746147146.587922:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.587931:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310725632:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147146.588460:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2240 going to sleep for 11 seconds 00010000:00010000:2.0:1746147146.588635:0:12201:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880097097100 x1830967310725376) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 13 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.588656:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x3139939425056eff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2715648->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7848a expref: 13 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.588669:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310725376:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147146.588688:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425056f4c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784bb expref: 28 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.588701:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425056f4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784bb expref: 28 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.588708:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80600, rc 0) 00000100:00100000:2.0:1746147146.588729:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308104576:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2064us (2324us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147146.588734:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14850 00000100:00100000:3.0:1746147146.588846:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310725120:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147146.588859:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425056f3e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784a6 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.588879:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425056f3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784a6 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746147146.589186:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147145 -> 1746147146 00002000:00010000:0.0:1746147146.589190:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147145 -> 1746147146 00002000:00010000:0.0:1746147146.589192:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147145 -> 1746147146 00000100:00100000:0.0:1746147146.589204:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310725248:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147146.589220:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7000/0x3139939425056f45 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784b4 expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.589229:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7000/0x3139939425056f45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784b4 expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147146.589240:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7000, rc 0) 00000100:00100000:0.0:1746147146.589259:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308104448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2643us (2882us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147146.589265:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14849 00010000:00010000:3.0:1746147146.589384:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe000, rc 0) 00000100:00100000:3.0:1746147146.589403:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308104192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2902us (3087us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.589409:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14847 00000100:00100000:0.0:1746147146.590426:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310725504:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147146.590731:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310725632:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147146.590746:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.590780:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308104704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4066us (4358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.590787:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6546 00000100:00100000:0.0:1746147146.593234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.593306:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.593319:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308105088 00000100:00100000:1.0:1746147146.593327:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308105088 00000100:00100000:0.0:1746147146.593339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.593358:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308105344 00000100:00100000:2.0:1746147146.593363:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308105344 00002000:00100000:1.0:1746147146.593376:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3149824->3153919) req@ffff8801312e8380 x1830967308105088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.593383:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8801312ebb80 x1830967308105344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.593390:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ebb80 with x1830967308105344 ext(2097152->3145727) 00002000:00100000:1.0:1746147146.593390:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8380 with x1830967308105088 ext(3149824->3153919) 00002000:00010000:2.0:1746147146.593395:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ebb80 00002000:00010000:1.0:1746147146.593395:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8380 00000100:00100000:1.0:1746147146.593423:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3641 00000100:00100000:2.0:1746147146.593427:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308105600 00000100:00100000:2.0:1746147146.593429:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308105600 00000100:00100000:1.0:1746147146.593431:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308105088:12345-192.168.204.25@tcp:3:multiop.0 00002000:00100000:2.0:1746147146.593442:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3223552->4194303) req@ffff8801312e8a80 x1830967308105600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.593449:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8a80 with x1830967308105600 ext(3223552->4194303) 00002000:00010000:2.0:1746147146.593452:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312e8a80 00000100:00100000:2.0:1746147146.593464:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3642 00000100:00100000:2.0:1746147146.593469:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308105344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147146.593562:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308105088:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 132us (335us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147146.593567:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3641 00002000:00100000:1.0:1746147146.593572:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3149824->3153919) req@ffff8801312e8380 x1830967308105088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.593583:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8380 with x1830967308105088 ext(3149824->3153919) 00002000:00010000:1.0:1746147146.593586:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e8380 00000100:00100000:1.0:1746147146.593599:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3643 00000100:00100000:1.0:1746147146.593603:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308105600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147146.598747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.599530:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308105728 00000100:00100000:3.0:1746147146.599539:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308105728 00000100:00100000:3.0:1746147146.599590:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14852 00000100:00100000:3.0:1746147146.599598:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32477:x1830967308105728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.599617:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.599635:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784c9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.599664:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.599672:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.599673:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.599677:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 26 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.599706:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.599719:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 13 pid: 9585 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.599731:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310725760:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.599826:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147146.603561:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308105600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9946us (10209us total) trans 0 rc 970752/970752 00000100:00100000:1.0:1746147146.603572:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3643 00002000:00100000:1.0:1746147146.603585:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3223552->4194303) req@ffff8801312e8a80 x1830967308105600/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 970752/970752 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.603594:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e8a80 with x1830967308105600 ext(3223552->4194303) 00002000:00010000:1.0:1746147146.603600:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312e8a80 00000100:00100000:3.0:1746147146.606429:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310725760:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.606461:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 26 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.606477:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81000, rc 0) 00000100:00100000:3.0:1746147146.606544:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32477:x1830967308105728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6944us (7804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.606544:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308105344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13071us (13235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.606551:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14852 00000100:00100000:2.0:1746147146.606555:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3642 00002000:00100000:2.0:1746147146.606564:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8801312ebb80 x1830967308105344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.606572:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ebb80 with x1830967308105344 ext(2097152->3145727) 00002000:00010000:2.0:1746147146.606577:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ebb80 00000100:00100000:0.0:1746147146.607110:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.607143:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.607199:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308106112 00000100:00100000:1.0:1746147146.607206:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308106112 00002000:00100000:1.0:1746147146.607237:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (4104192->4108287) req@ffff8801312e9f80 x1830967308106112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.607245:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9f80 with x1830967308106112 ext(4104192->4108287) 00002000:00010000:1.0:1746147146.607248:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e9f80 00000100:00100000:1.0:1746147146.607271:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308105984 00000100:00100000:1.0:1746147146.607273:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308105984 00002000:00100000:1.0:1746147146.607284:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1703936->1900543) req@ffff8801312e9880 x1830967308105984/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.607290:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9880 with x1830967308105984 ext(1703936->1900543) 00010000:00010000:1.0:1746147146.607295:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 12 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.607308:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 12 pid: 9585 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746147146.607314:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312e9880 00000100:00100000:1.0:1746147146.607325:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1148 00000100:00100000:1.0:1746147146.607331:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308105984:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147146.607432:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3644 00000100:00100000:0.0:1746147146.607438:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308106112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147146.607858:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308106112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 419us (747us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147146.607876:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3644 00002000:00100000:0.0:1746147146.607881:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (4104192->4108287) req@ffff8801312e9f80 x1830967308106112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.607887:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9f80 with x1830967308106112 ext(4104192->4108287) 00002000:00010000:0.0:1746147146.607890:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312e9f80 00000100:00100000:1.0:1746147146.613164:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967308105984:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5820us (6007us total) trans 21474841520 rc 0/0 00000100:00100000:1.0:1746147146.613177:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1148 00002000:00100000:1.0:1746147146.613190:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1703936->1900543) req@ffff8801312e9880 x1830967308105984/t21474841520(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.613198:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312e9880 with x1830967308105984 ext(1703936->1900543) 00010000:00010000:1.0:1746147146.613208:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 14 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.613222:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 14 pid: 9585 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746147146.613229:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312e9880 00000100:00100000:0.0:1746147146.613494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.613562:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308106368 00000100:00100000:1.0:1746147146.613569:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308106368 00000100:00100000:1.0:1746147146.613944:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5517 00000100:00100000:1.0:1746147146.613952:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32467:x1830967308106368:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147146.614111:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32467:x1830967308106368:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 160us (618us total) trans 8589936053 rc 0/0 00000100:00100000:1.0:1746147146.614117:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5517 00000100:00100000:0.0:1746147146.614368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.614476:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308106496 00000100:00100000:3.0:1746147146.614480:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308106496 00000100:00100000:3.0:1746147146.614503:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14853 00000100:00100000:3.0:1746147146.614507:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:32474:x1830967308106496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.614517:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.614533:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784d0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.614555:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.614562:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.614563:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.614566:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.614591:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.614600:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 25 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.614610:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310725888:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.614671:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.617342:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310725888:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.617374:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 15 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.617396:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81a00, rc 0) 00000100:00100000:3.0:1746147146.617445:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:32474:x1830967308106496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2936us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.617453:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14853 00000100:00100000:0.0:1746147146.617738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.617839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.617876:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308106624 00000100:00100000:0.0:1746147146.617882:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308106624 00002000:00100000:0.0:1746147146.617918:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3149824->4108287) req@ffff88013486bb80 x1830967308106624/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.617926:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486bb80 with x1830967308106624 ext(3149824->4108287) 00010000:00010000:0.0:1746147146.617933:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.617943:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 26 pid: 17600 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746147146.617949:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013486bb80 00000100:00100000:0.0:1746147146.617972:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1149 00000100:00100000:0.0:1746147146.617978:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308106624:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147146.618312:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308106752 00000100:00100000:1.0:1746147146.618316:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308106752 00010000:00010000:1.0:1746147146.618335:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 15 pid: 9585 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.618352:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6547 00000100:00100000:1.0:1746147146.618357:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967308106752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.618365:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.618379:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 15 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.618388:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 15 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.618407:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x3139939425056e88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->1900543) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7843d expref: 15 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.618431:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.618433:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.618440:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.618446:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.618473:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.618483:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310726016:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147146.618532:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.623675:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310726016:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147146.623698:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147146.623740:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967308106752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5380us (6001us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147146.623751:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6547 00000100:00100000:0.0:1746147146.625828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.626025:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308107008 00000100:00100000:2.0:1746147146.626034:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308107008 00000100:00100000:0.0:1746147146.626043:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147146.626129:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88013486a680 x1830967308107008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147146.626136:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308107264 00002000:00100000:2.0:1746147146.626139:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486a680 with x1830967308107008 ext(1048576->2097151) 00000100:00100000:3.0:1746147146.626140:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308107264 00002000:00010000:2.0:1746147146.626144:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013486a680 00002000:00100000:3.0:1746147146.626158:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88013486b480 x1830967308107264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.626165:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486b480 with x1830967308107264 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.626168:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013486b480 00000100:00100000:2.0:1746147146.626176:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3645 00000100:00100000:3.0:1746147146.626185:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3646 00000100:00100000:3.0:1746147146.626191:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308107264:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.626194:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967308107008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147146.628935:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308106624:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10941us (11081us total) trans 21474841521 rc 0/0 00000100:00100000:0.0:1746147146.628948:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1149 00002000:00100000:0.0:1746147146.628960:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (3149824->4108287) req@ffff88013486bb80 x1830967308106624/t21474841521(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.628970:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486bb80 with x1830967308106624 ext(3149824->4108287) 00010000:00010000:0.0:1746147146.628980:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 30 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.628996:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 30 pid: 17600 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746147146.629003:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013486bb80 00000100:00100000:3.0:1746147146.631682:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308107264:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5476us (5623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.631695:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3646 00002000:00100000:3.0:1746147146.631705:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88013486b480 x1830967308107264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.631714:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486b480 with x1830967308107264 ext(1048576->2097151) 00002000:00010000:3.0:1746147146.631720:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013486b480 00000100:00100000:2.0:1746147146.633798:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308107008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7603us (7969us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147146.633808:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3645 00002000:00100000:2.0:1746147146.633816:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88013486a680 x1830967308107008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.633825:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486a680 with x1830967308107008 ext(1048576->2097151) 00002000:00010000:2.0:1746147146.633834:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013486a680 00000100:00100000:3.0:1746147146.639711:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.639825:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308107392 00000100:00100000:0.0:1746147146.639834:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308107392 00010000:00010000:0.0:1746147146.639881:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746147146.639918:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6548 00000100:00100000:0.0:1746147146.639926:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308107392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147146.639942:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147146.639961:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.639974:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.639998:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe200/0x3139939425056f0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3149824->4108287) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78498 expref: 28 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.640269:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.640272:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147146.640280:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.640289:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147146.640322:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.640335:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134868380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310726144:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147146.640757:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.641347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.641372:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147146.641421:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147146.641790:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308107520 00000100:00100000:2.0:1746147146.641795:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308107520 00000100:00100000:2.0:1746147146.641836:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308107648 00000100:00100000:2.0:1746147146.641838:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308107648 00000100:00100000:2.0:1746147146.641857:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14854 00000100:00100000:2.0:1746147146.641872:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308107520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.641887:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.641903:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425056f68 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784d7 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147146.641938:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310726272:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147146.641985:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147146.642052:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14855 00000100:00100000:2.0:1746147146.642058:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967308107648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.642065:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.642075:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784de expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.642104:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.642106:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.642112:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.642125:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.642134:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57a0e00, rc 0) 00000100:00100000:2.0:1746147146.642155:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967308107648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 98us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.642161:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14855 00000100:00100000:2.0:1746147146.644579:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134868380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310726144:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147146.644602:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.644921:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308107392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4993us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.644930:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6548 00000100:00100000:0.0:1746147146.650967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.651451:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308107904 00000100:00100000:2.0:1746147146.651461:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308107904 00002000:00100000:2.0:1746147146.651508:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880134869180 x1830967308107904/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.651518:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134869180 with x1830967308107904 ext(3145728->4194303) 00002000:00010000:2.0:1746147146.651524:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134869180 00000100:00100000:2.0:1746147146.651556:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3647 00000100:00100000:2.0:1746147146.651564:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967308107904:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.651723:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310726272:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147146.651760:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425056f68 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d7 expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.651773:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425056f68 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d7 expref: 29 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.651801:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cca00, rc 0) 00000100:00100000:3.0:1746147146.652062:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308107520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9986us (10504us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.652070:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14854 00000100:00100000:0.0:1746147146.653723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.654250:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108032 00000100:00100000:3.0:1746147146.654256:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108032 00000100:00100000:3.0:1746147146.654304:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14856 00000100:00100000:3.0:1746147146.654312:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32477:x1830967308108032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.654330:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.654348:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784e5 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.654374:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 11 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.654381:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.654383:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147146.654387:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.654414:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 11 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.654431:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 11 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.654442:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310726400:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.654502:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.656323:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310726400:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.656350:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.656365:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:3.0:1746147146.656404:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32477:x1830967308108032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2092us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.656412:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14856 00000100:00100000:0.0:1746147146.657785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.657812:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108160 00000100:00100000:0.0:1746147146.657819:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108160 00002000:00100000:0.0:1746147146.657858:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3223551) req@ffff88013486b100 x1830967308108160/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.657878:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486b100 with x1830967308108160 ext(3145728->3223551) 00010000:00010000:0.0:1746147146.657887:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 12 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746147146.657900:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 12 pid: 17600 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746147146.657907:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013486b100 00000100:00100000:0.0:1746147146.657931:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1150 00000100:00100000:0.0:1746147146.657938:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2000:x1830967308108160:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147146.663896:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967308107904:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12320us (12926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147146.663908:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3647 00002000:00100000:3.0:1746147146.663920:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880134869180 x1830967308107904/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.663928:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134869180 with x1830967308107904 ext(3145728->4194303) 00002000:00010000:3.0:1746147146.663934:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134869180 00000100:00100000:2.0:1746147146.664703:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2000:x1830967308108160:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6763us (6923us total) trans 17179874250 rc 0/0 00000100:00100000:2.0:1746147146.664711:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1150 00002000:00100000:2.0:1746147146.664716:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3223551) req@ffff88013486b100 x1830967308108160/t17179874250(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/448 e 0 to 0 dl 1746147157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.664723:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013486b100 with x1830967308108160 ext(3145728->3223551) 00010000:00010000:2.0:1746147146.664732:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 14 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.664747:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 14 pid: 17600 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746147146.664754:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013486b100 00000100:00100000:0.0:1746147146.670946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.670991:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.671579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.671682:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108288 00000100:00100000:1.0:1746147146.671692:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108288 00000100:00100000:1.0:1746147146.671735:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108416 00000100:00100000:1.0:1746147146.671737:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108416 00000100:00100000:1.0:1746147146.671755:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14857 00000100:00100000:1.0:1746147146.671763:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308108288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.671786:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.671806:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784ec expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.671830:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.671832:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.671842:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.671869:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.671883:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a5800, rc 0) 00000100:00100000:1.0:1746147146.671940:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308108288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 177us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.671946:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14857 00000100:00100000:1.0:1746147146.671962:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14858 00000100:00100000:1.0:1746147146.671967:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308108416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.671975:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.671987:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784f3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.672028:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310726528:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147146.672371:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147146.672718:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108544 00000100:00100000:2.0:1746147146.672723:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108544 00010000:00010000:2.0:1746147146.672746:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 16 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.672765:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6549 00000100:00100000:2.0:1746147146.672770:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308108544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147146.672779:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.672800:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 16 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.672812:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 16 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.672828:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.672830:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.672835:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.672843:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.672878:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147146.672888:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310726656:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147146.672925:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147146.674162:0:9586:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880095062300 x1830967310726528) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 16 pid: 17600 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.674186:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x3139939425056f06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78491 expref: 16 pid: 17600 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.674996:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310726528:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147146.675026:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f84 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784f3 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.675038:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784f3 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.675047:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a5400, rc 0) 00000100:00100000:1.0:1746147146.675080:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308108416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3112us (4088us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147146.675107:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14858 00000100:00100000:2.0:1746147146.675908:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310726656:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147146.675923:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.676002:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:2000:x1830967308108544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3230us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.676011:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6549 00000100:00100000:0.0:1746147146.679445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.680243:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108672 00000100:00100000:1.0:1746147146.680253:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108672 00000100:00100000:1.0:1746147146.680795:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14859 00000100:00100000:1.0:1746147146.680804:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:32474:x1830967308108672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147146.680824:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.680843:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e784fa expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.680884:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.680886:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.680995:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.681012:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.681023:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:1.0:1746147146.681514:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:32474:x1830967308108672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 710us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.681521:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14859 00000100:00100000:0.0:1746147146.689429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.690161:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308108928 00000100:00100000:2.0:1746147146.690172:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308108928 00000100:00100000:0.0:1746147146.690179:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147146.690222:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880099155180 x1830967308108928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.690232:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155180 with x1830967308108928 ext(2097152->4194303) 00002000:00010000:2.0:1746147146.690238:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099155180 00000100:00100000:2.0:1746147146.690749:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308109312 00000100:00100000:2.0:1746147146.690752:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308109312 00002000:00100000:2.0:1746147146.690765:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099156d80 x1830967308109312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.690771:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156d80 with x1830967308109312 ext(4194304->4919295) 00002000:00010000:2.0:1746147146.690774:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099156d80 00000100:00100000:0.0:1746147146.690826:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.690963:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308109440 00000100:00100000:2.0:1746147146.690967:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308109440 00000100:00100000:2.0:1746147146.690983:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3648 00000100:00100000:3.0:1746147146.690989:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3649 00000100:00100000:2.0:1746147146.690991:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308108928:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.690995:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308109312:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:1.0:1746147146.692189:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880099156300 x1830967308109440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147146.692200:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156300 with x1830967308109440 ext(2097152->4194303) 00002000:00010000:1.0:1746147146.692206:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156300 00000100:00100000:1.0:1746147146.692224:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3650 00000100:00100000:1.0:1746147146.692231:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308109440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.704883:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308108928:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13880us (15453us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147146.704895:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3648 00002000:00100000:2.0:1746147146.704908:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880099155180 x1830967308108928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.704924:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155180 with x1830967308108928 ext(2097152->4194303) 00002000:00010000:2.0:1746147146.704930:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099155180 00000100:00100000:3.0:1746147146.709025:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308109312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18016us (18830us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147146.709039:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3649 00002000:00100000:3.0:1746147146.709052:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099156d80 x1830967308109312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.709062:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156d80 with x1830967308109312 ext(4194304->4919295) 00002000:00010000:3.0:1746147146.709069:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099156d80 00000100:00100000:2.0:1746147146.713045:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308109440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20801us (22206us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147146.713059:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3650 00002000:00100000:2.0:1746147146.713071:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880099156300 x1830967308109440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.713081:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156300 with x1830967308109440 ext(2097152->4194303) 00002000:00010000:2.0:1746147146.713087:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156300 00000100:00100000:1.0:1746147146.721603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.721738:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308109696 00000100:00100000:2.0:1746147146.721748:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308109696 00002000:00100000:2.0:1746147146.721796:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095062300 x1830967308109696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.721806:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062300 with x1830967308109696 ext(4194304->4919295) 00002000:00010000:2.0:1746147146.721811:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062300 00000100:00100000:2.0:1746147146.721843:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3651 00000100:00100000:2.0:1746147146.721852:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967308109696:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.727274:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967308109696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5411us (5670us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147146.727287:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3651 00002000:00100000:2.0:1746147146.727300:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095062300 x1830967308109696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.727310:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062300 with x1830967308109696 ext(4194304->4919295) 00002000:00010000:2.0:1746147146.727316:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062300 00000100:00100000:0.0:1746147146.733720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.735895:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308109952 00000100:00100000:2.0:1746147146.735908:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308109952 00000100:00100000:2.0:1746147146.735973:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5518 00000100:00100000:2.0:1746147146.735982:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32477:x1830967308109952:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147146.736230:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32477:x1830967308109952:12345-192.168.204.25@tcp:35:cat.0 Request processed in 248us (2521us total) trans 8589936054 rc 0/0 00000100:00100000:2.0:1746147146.736236:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5518 00000100:00100000:0.0:1746147146.765241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.765595:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308110080 00000100:00100000:1.0:1746147146.765606:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308110080 00000100:00100000:1.0:1746147146.765664:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14860 00000100:00100000:1.0:1746147146.765673:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:32481:x1830967308110080:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147146.765693:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.765713:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78501 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.765746:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.765755:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.765762:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.765763:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.765767:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [315392->663551] (req 315392->663551) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.765799:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.765811:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.765823:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310726784:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147146.765959:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.765971:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 28 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.765980:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310726912:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.766000:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147146.772880:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310726784:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.772898:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310726912:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147146.772938:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [315392->663551] (req 315392->663551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.772958:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a5400, rc 0) 00000100:00100000:1.0:1746147146.773013:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:32481:x1830967308110080:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7340us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.773022:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14860 00000100:00100000:0.0:1746147146.773558:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.773617:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308110208 00000100:00100000:3.0:1746147146.773625:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308110208 00010000:00010000:3.0:1746147146.773654:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 29 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.773745:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6550 00000100:00100000:3.0:1746147146.773753:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308110208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.773766:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.773787:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 29 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.773797:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 29 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.773820:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425056dee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783db expref: 29 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.773851:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.773931:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308110208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 178us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.773937:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6550 00000100:00100000:0.0:1746147146.781519:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.781657:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308110336 00000100:00100000:3.0:1746147146.781668:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308110336 00010000:00010000:3.0:1746147146.781707:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.781739:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6551 00000100:00100000:3.0:1746147146.781747:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308110336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.781762:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.781783:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.781796:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.781820:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e04600/0x3139939425056e34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78405 expref: 15 pid: 9584 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.781853:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.781855:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.781870:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.781880:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.781920:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.781933:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310727040:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147146.782025:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.784392:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310727040:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147146.784411:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.784452:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308110336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2705us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.784463:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6551 00000100:00100000:0.0:1746147146.785668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.785776:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308110592 00000100:00100000:2.0:1746147146.785783:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308110592 00002000:00100000:2.0:1746147146.785823:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (315392->319487) req@ffff88012ca13100 x1830967308110592/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.785834:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13100 with x1830967308110592 ext(315392->319487) 00002000:00010000:2.0:1746147146.785839:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13100 00000100:00100000:2.0:1746147146.785875:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3652 00000100:00100000:2.0:1746147146.785883:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308110592:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147146.786008:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308110592:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 125us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147146.786014:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3652 00002000:00100000:2.0:1746147146.786020:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (315392->319487) req@ffff88012ca13100 x1830967308110592/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.786026:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13100 with x1830967308110592 ext(315392->319487) 00002000:00010000:2.0:1746147146.786029:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13100 00000100:00100000:1.0:1746147146.792405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.792578:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308110848 00000100:00100000:3.0:1746147146.792589:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308110848 00002000:00100000:3.0:1746147146.792634:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (659456->663551) req@ffff880095060700 x1830967308110848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.792648:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060700 with x1830967308110848 ext(659456->663551) 00002000:00010000:3.0:1746147146.792654:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060700 00000100:00100000:3.0:1746147146.792692:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3653 00000100:00100000:3.0:1746147146.792700:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308110848:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147146.792852:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308110848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 152us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147146.792871:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3653 00002000:00100000:3.0:1746147146.792876:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (659456->663551) req@ffff880095060700 x1830967308110848/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.792889:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060700 with x1830967308110848 ext(659456->663551) 00002000:00010000:3.0:1746147146.792893:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060700 00000100:00100000:0.0:1746147146.827253:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.827345:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308110976 00000100:00100000:1.0:1746147146.827355:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308110976 00000100:00100000:1.0:1746147146.827410:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15343 00000100:00100000:1.0:1746147146.827488:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:32484:x1830967308110976:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147146.827512:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.827532:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056f99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78508 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.827587:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827601:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827611:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827623:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827629:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827634:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827703:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827713:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 33 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.827720:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147146.827748:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 33 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.827759:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 33 pid: 7239 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.827771:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310727168:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147146.827869:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.832037:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.832141:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308111232 00000100:00100000:2.0:1746147146.832151:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308111232 00000100:00100000:2.0:1746147146.832209:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5519 00000100:00100000:2.0:1746147146.832217:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:30600:x1830967308111232:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147146.832532:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310727168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147146.832555:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147146.832789:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:30600:x1830967308111232:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 571us (760us total) trans 8589936055 rc 0/0 00000100:00100000:2.0:1746147146.832796:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5519 00000100:00100000:0.0:1746147146.836502:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.836613:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308111360 00000100:00100000:3.0:1746147146.836622:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308111360 00010000:00010000:3.0:1746147146.836659:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 35 pid: 7239 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.836690:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6552 00000100:00100000:3.0:1746147146.836697:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308111360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.836713:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.836719:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 35 pid: 7239 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.836730:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 35 pid: 7239 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.836753:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425056ef1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78483 expref: 35 pid: 7239 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.836787:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.836793:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.836804:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.836812:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.836835:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.836888:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+34:2002:x1830967308111360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 190us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.836894:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6552 00010000:00010000:3.0:1746147146.837018:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837024:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147146.837080:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147146.837084:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147146.837124:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837134:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837145:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837151:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837156:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837161:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837167:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.837171:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837177:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837185:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147146.837187:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147146.837190:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837195:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425056fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837205:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837210:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837215:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837218:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.837220:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837225:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837230:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f00c400) 00010000:00010000:3.0:1746147146.837232:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147146.837234:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837238:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425056fa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.837268:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425056f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.837279:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 19 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.837284:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.837286:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147146.837287:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a4a00, rc 0) 00000100:00100000:3.0:1746147146.837311:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:32484:x1830967308110976:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 9828us (10071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.837317:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15343 00000100:00100000:0.0:1746147146.839559:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839977:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.839998:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308111744 00000100:00100000:0.0:1746147146.840006:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308111744 00000100:00100000:0.0:1746147146.840043:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112000 00000100:00100000:0.0:1746147146.840045:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112000 00000100:00100000:0.0:1746147146.840057:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308111872 00000100:00100000:0.0:1746147146.840059:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308111872 00000100:00100000:0.0:1746147146.840068:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112128 00000100:00100000:0.0:1746147146.840070:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112128 00000100:00100000:0.0:1746147146.840078:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112256 00000100:00100000:0.0:1746147146.840079:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112256 00000100:00100000:0.0:1746147146.840117:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112384 00000100:00100000:0.0:1746147146.840119:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112384 00000100:00100000:0.0:1746147146.840132:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14861 00000100:00100000:0.0:1746147146.840138:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308111744:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147146.840156:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.840173:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425056fb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78516 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147146.840225:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727296:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147146.840303:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147146.840521:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14862 00000100:00100000:1.0:1746147146.840529:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308112000:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147146.840537:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.840550:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78524 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.840563:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840565:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840573:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840589:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840599:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94400, rc 0) 00000100:00100000:1.0:1746147146.840623:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308112000:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 95us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.840629:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14862 00000100:00100000:1.0:1746147146.840645:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14863 00000100:00100000:1.0:1746147146.840649:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308111872:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147146.840654:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.840660:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7851d expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.840673:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840674:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840678:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840686:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840691:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00000100:00100000:1.0:1746147146.840706:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308111872:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 57us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.840711:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14863 00000100:00100000:1.0:1746147146.840720:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14864 00000100:00100000:1.0:1746147146.840724:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308112128:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147146.840729:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.840735:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7852b expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.840743:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840744:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840749:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840757:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840768:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94800, rc 0) 00000100:00100000:1.0:1746147146.840782:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308112128:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 58us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.840786:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14864 00000100:00100000:1.0:1746147146.840793:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14865 00000100:00100000:1.0:1746147146.840798:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308112256:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147146.840802:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.840808:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78532 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.840817:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840818:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840822:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840830:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840837:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:1.0:1746147146.840850:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308112256:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 52us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.840854:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14865 00000100:00100000:1.0:1746147146.840875:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14866 00000100:00100000:1.0:1746147146.840879:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308112384:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147146.840887:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147146.840893:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78539 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.840903:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840904:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.840908:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840916:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.840922:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:1.0:1746147146.840934:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308112384:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 55us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.840938:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14866 00000100:00100000:3.0:1746147146.841172:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308111616 00000100:00100000:3.0:1746147146.841177:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308111616 00000100:00100000:3.0:1746147146.841205:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15344 00000100:00100000:3.0:1746147146.841210:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32486:x1830967308111616:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147146.841222:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.841233:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80c00/0x3139939425056fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7850f expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.841300:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841311:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841320:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841333:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841338:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841342:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841438:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841447:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841452:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147146.841460:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147146.841524:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841530:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841535:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841541:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841546:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db80e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.841550:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841556:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841565:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147146.841568:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147146.841571:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841576:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425056fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841585:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841590:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841594:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841598:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.841600:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841604:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841610:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1100) 00010000:00010000:3.0:1746147146.841612:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147146.841613:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841617:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81c00/0x3139939425056fed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147146.841650:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80c00/0x3139939425056fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 56 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.841660:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 55 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.841666:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.841668:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147146.841670:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80200, rc 0) 00000100:00100000:3.0:1746147146.841693:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:32486:x1830967308111616:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 483us (2142us total) trans 8589936056 rc 0/0 00000100:00100000:3.0:1746147146.841698:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15344 00002000:00010000:2.0:1746147146.847933:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147145 -> 1746147146 00002000:00010000:2.0:1746147146.847943:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147145 -> 1746147146 00002000:00010000:2.0:1746147146.847946:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147145 -> 1746147146 00000100:00100000:2.0:1746147146.847971:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727296:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147146.848008:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425056fb5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78516 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.848023:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425056fb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78516 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.848049:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731e00, rc 0) 00000100:00100000:2.0:1746147146.848124:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308111744:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 7984us (8241us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147146.848133:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14861 00000100:00100000:1.0:1746147146.853923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.854371:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112640 00000100:00100000:3.0:1746147146.854382:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112640 00000100:00100000:3.0:1746147146.854446:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15345 00000100:00100000:3.0:1746147146.854453:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:32484:x1830967308112640:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147146.854475:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.854493:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425057002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78540 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.854591:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.854607:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.854614:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 54 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.854622:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.854651:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 54 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.854663:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 54 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.854674:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310727424:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.855456:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.855466:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 20 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.855475:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310727552:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.855871:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.861517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.861866:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310727424:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147146.861881:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310727552:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147146.861900:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147146.861980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.862039:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112768 00000100:00100000:1.0:1746147146.862045:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112768 00010000:00010000:1.0:1746147146.862073:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 55 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.862128:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308112896 00000100:00100000:1.0:1746147146.862131:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308112896 00010000:00010000:1.0:1746147146.862141:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 21 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.862166:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6553 00000100:00100000:1.0:1746147146.862173:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2003:x1830967308112768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.862186:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.862192:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 55 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.862200:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 55 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.862219:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425056ff4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7850f expref: 55 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.862235:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6554 00010000:00010000:1.0:1746147146.862235:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147146.862238:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147146.862246:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:2.0:1746147146.862249:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:2003:x1830967308112896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.862251:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147146.862265:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147146.862273:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 21 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.862289:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2003:x1830967308112768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (780us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147146.862291:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 21 pid: 7238 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.862296:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6553 00010000:00010000:2.0:1746147146.862308:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4a00/0x3139939425056fae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78508 expref: 21 pid: 7238 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147146.862327:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.862331:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.862340:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.862346:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.862367:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147146.862408:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:2003:x1830967308112896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 163us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.862414:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6554 00010000:00010000:2.0:1746147146.862510:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147146.862518:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147146.862538:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.862672:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80400/0x3139939425057002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78540 expref: 21 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.862692:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78540 expref: 20 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.862698:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.862701:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147146.862703:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81800, rc 0) 00000100:00100000:2.0:1746147146.862747:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:32484:x1830967308112640:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 8294us (8830us total) trans 8589936057 rc 0/0 00000100:00100000:2.0:1746147146.862754:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15345 00000100:00100000:0.0:1746147146.865753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.865847:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308113152 00000100:00100000:3.0:1746147146.865882:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308113152 00000100:00100000:3.0:1746147146.865944:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15346 00000100:00100000:3.0:1746147146.865959:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:32484:x1830967308113152:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147146.865983:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.865986:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147146.866012:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057009 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78540 expref: 20 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.866041:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.866045:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147146.866056:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057017 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78547 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.866166:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866177:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866184:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866194:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866199:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866205:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866210:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147146.866213:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866218:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866225:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147146.866227:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147146.866230:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866234:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505701e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147146.866253:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057017 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78547 expref: 20 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.866260:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057017 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78547 expref: 20 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.866267:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80e00, rc 0) 00000100:00100000:3.0:1746147146.866317:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:32484:x1830967308113152:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 366us (575us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.866323:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15346 00000100:00100000:1.0:1746147146.870122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.870491:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308113408 00000100:00100000:3.0:1746147146.870501:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308113408 00000100:00100000:3.0:1746147146.871329:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5520 00000100:00100000:3.0:1746147146.871341:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+19:32484:x1830967308113408:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147146.872379:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:32484:x1830967308113408:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 1039us (2265us total) trans 8589936058 rc 0/0 00000100:00100000:3.0:1746147146.872388:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5520 00000100:00100000:0.0:1746147146.898148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.899405:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308113536 00000100:00100000:2.0:1746147146.899418:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308113536 00000100:00100000:2.0:1746147146.901575:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14867 00000100:00100000:2.0:1746147146.901593:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32486:x1830967308113536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147146.901614:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.901634:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7854e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.901667:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.901675:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.901681:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.901691:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.901693:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.901695:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1880064->2097151] (req 1880064->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.901725:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.901737:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746147146.901749:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727680:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.901878:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.901887:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 9 pid: 12201 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746147146.901894:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727808:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.901921:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.901929:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 13 pid: 9585 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.901941:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727936:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.901957:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.907831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.908440:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727680:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.908452:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727808:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.908460:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310727936:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.908493:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1880064->2097151] (req 1880064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.908512:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1c00, rc 0) 00000100:00100000:2.0:1746147146.908572:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32486:x1830967308113536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6986us (10433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.908582:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14867 00000100:00100000:3.0:1746147146.909260:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308113664 00000100:00100000:3.0:1746147146.909268:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308113664 00010000:00010000:3.0:1746147146.909297:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 10 pid: 12201 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746147146.909327:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6555 00000100:00100000:3.0:1746147146.909339:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308113664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.909357:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.909379:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 10 pid: 12201 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.909388:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 10 pid: 12201 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.909414:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425056fca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7852b expref: 10 pid: 12201 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746147146.909430:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147146.909452:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308113664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 119us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.909458:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6555 00000100:00100000:0.0:1746147146.909647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.909825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.909930:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308113792 00000100:00100000:1.0:1746147146.909934:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308113792 00010000:00010000:1.0:1746147146.909951:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 14 pid: 9585 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.909966:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308113920 00000100:00100000:1.0:1746147146.909968:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308113920 00010000:00010000:1.0:1746147146.909978:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.909991:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6556 00000100:00100000:1.0:1746147146.909996:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308113792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.910003:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.910012:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 14 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.910019:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 14 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.910031:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6400/0x3139939425056ec0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78475 expref: 14 pid: 9585 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.910043:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.910063:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967308113792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.910069:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6556 00000100:00100000:1.0:1746147146.910079:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6557 00000100:00100000:1.0:1746147146.910083:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308113920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.910107:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.910113:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.910122:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.910135:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x3139939425056f37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ad expref: 29 pid: 9586 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.910571:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.910572:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147146.910580:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.910587:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147146.910618:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147146.910629:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310728064:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147146.911032:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.931384:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.932434:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308114176 00000100:00100000:2.0:1746147146.932444:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308114176 00002000:00100000:2.0:1746147146.932491:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1880064->1884159) req@ffff880099011880 x1830967308114176/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.932501:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011880 with x1830967308114176 ext(1880064->1884159) 00002000:00010000:2.0:1746147146.932506:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099011880 00000100:00100000:2.0:1746147146.932528:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3654 00000100:00100000:2.0:1746147146.932536:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967308114176:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147146.932672:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310728064:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147146.932684:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967308114176:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 147us (1311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147146.932691:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3654 00010000:00010000:1.0:1746147146.932693:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147146.932696:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1880064->1884159) req@ffff880099011880 x1830967308114176/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147146.932703:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011880 with x1830967308114176 ext(1880064->1884159) 00002000:00010000:2.0:1746147146.932706:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099011880 00000100:00100000:1.0:1746147146.932723:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308113920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 22638us (22897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.932731:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6557 00000100:00100000:0.0:1746147146.949515:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.949586:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308114304 00000100:00100000:2.0:1746147146.949595:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308114304 00000100:00100000:2.0:1746147146.949650:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14868 00000100:00100000:2.0:1746147146.949659:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32486:x1830967308114304:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147146.949678:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.949697:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78555 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.949725:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.949739:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.949750:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 12 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.949759:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.949761:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147146.949764:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.949799:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 12 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.949811:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 12 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.949824:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728192:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.949935:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 8 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.949943:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 8 pid: 12201 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746147146.949951:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728320:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.949978:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.949985:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746147146.949993:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728448:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.952315:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147146.953502:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728192:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147146.953518:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147146.953738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.954294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147146.954823:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308114560 00000100:00100000:1.0:1746147146.954831:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308114560 00010000:00010000:1.0:1746147146.954879:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 9 pid: 12201 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746147146.954922:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308114432 00000100:00100000:1.0:1746147146.954924:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308114432 00010000:00010000:1.0:1746147146.954935:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746147146.954960:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6558 00000100:00100000:1.0:1746147146.954967:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308114560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.954981:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.955001:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 9 pid: 12201 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.955011:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 9 pid: 12201 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.955034:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x3139939425056fd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78532 expref: 9 pid: 12201 timeout: 784 lvb_type: 1 00010000:00010000:1.0:1746147146.955055:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.955115:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308114560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 143us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.955121:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6558 00000100:00100000:1.0:1746147146.955135:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6559 00000100:00100000:1.0:1746147146.955139:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+13:2001:x1830967308114432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147146.955146:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147146.955152:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.955159:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.955170:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425056f8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784fa expref: 13 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746147146.955177:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147146.955191:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308114432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147146.955196:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6559 00000100:00100000:2.0:1746147146.956602:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147146.956639:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.956651:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1000, rc 0) 00000100:00100000:2.0:1746147146.956730:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32486:x1830967308114304:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7071us (7225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147146.956738:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14868 00000100:00100000:0.0:1746147146.959307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.959708:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308114688 00000100:00100000:3.0:1746147146.959718:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308114688 00010000:00010000:3.0:1746147146.959753:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147146.959780:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6560 00000100:00100000:3.0:1746147146.959787:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967308114688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147146.959802:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147146.959826:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.959838:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.959871:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x3139939425056f76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784e5 expref: 29 pid: 1136 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746147146.965725:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.965732:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147146.965757:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.965770:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147146.965829:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.965844:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310728576:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147146.965990:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.972938:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.973017:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308114944 00000100:00100000:2.0:1746147146.973027:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308114944 00000100:00100000:2.0:1746147146.973105:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15347 00000100:00100000:2.0:1746147146.973115:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:32492:x1830967308114944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147146.973143:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.973163:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425057033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7855c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.973240:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973253:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973263:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973275:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973284:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973289:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973389:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973399:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973405:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147146.973413:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147146.973486:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973493:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973499:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973505:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973510:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.973514:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973520:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973533:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147146.973536:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.973540:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973544:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942505703a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973559:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973564:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973568:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973573:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7f600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147146.973575:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973580:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973585:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23200) 00010000:00010000:2.0:1746147146.973587:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147146.973590:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973594:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425057041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147146.973628:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425057033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 57 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.973640:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 56 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.973646:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147146.973648:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147146.973651:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:2.0:1746147146.973707:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+56:32492:x1830967308114944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 593us (779us total) trans 8589936059 rc 0/0 00000100:00100000:2.0:1746147146.973713:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15347 00000100:00100000:0.0:1746147146.975604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.975640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147146.975658:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308115072 00000100:00100000:2.0:1746147146.975665:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308115072 00000100:00100000:0.0:1746147146.975671:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308115200 00000100:00100000:0.0:1746147146.975674:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308115200 00000100:00100000:0.0:1746147146.975716:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14869 00000100:00100000:2.0:1746147146.975722:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14870 00000100:00100000:0.0:1746147146.975724:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967308115200:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147146.975728:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967308115072:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147146.975786:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310728576:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147146.975805:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147146.975823:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147146.975836:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147146.975837:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730200/0x3139939425057056 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7856a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147146.975845:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136349400/0x313993942505705d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78563 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147146.975896:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728832:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147146.975897:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310728704:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147146.975998:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147146.976238:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147146.976357:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967308114688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 16569us (17056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147146.976366:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6560 00000100:00100000:0.0:1746147146.977918:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.979127:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308115456 00000100:00100000:3.0:1746147146.979135:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308115456 00002000:00100000:3.0:1746147146.979183:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2428928->2433023) req@ffff880093146300 x1830967308115456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.979193:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146300 with x1830967308115456 ext(2428928->2433023) 00002000:00010000:3.0:1746147146.979199:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146300 00000100:00100000:3.0:1746147146.979226:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3655 00000100:00100000:3.0:1746147146.979233:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308115456:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147146.979364:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308115456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 131us (1453us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147146.979370:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3655 00002000:00100000:3.0:1746147146.979374:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2428928->2433023) req@ffff880093146300 x1830967308115456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147146.979381:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146300 with x1830967308115456 ext(2428928->2433023) 00002000:00010000:3.0:1746147146.979383:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146300 00000100:00100000:1.0:1746147146.980123:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310728704:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147146.980159:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730200/0x3139939425057056 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7856a expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.980172:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730200/0x3139939425057056 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7856a expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147146.980616:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730200, rc 0) 00000100:00100000:1.0:1746147146.980649:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967308115200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4926us (5008us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147146.980656:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14869 00000100:00100000:0.0:1746147146.980937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.981044:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310728832:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147146.981064:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136349400/0x313993942505705d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78563 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.981075:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136349400/0x313993942505705d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78563 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147146.981105:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136349400, rc 0) 00000100:00100000:3.0:1746147146.981128:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+12:2002:x1830967308115072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5400us (5530us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147146.981136:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14870 00000100:00100000:3.0:1746147146.981152:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308115584 00000100:00100000:3.0:1746147146.981155:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308115584 00000100:00100000:3.0:1746147146.981183:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14871 00000100:00100000:3.0:1746147146.981189:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308115584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147146.981199:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147146.981213:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x3139939425057064 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78571 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147146.981254:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310728960:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147146.983139:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147146.988365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147146.988427:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308115840 00000100:00100000:3.0:1746147146.988437:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308115840 00000100:00100000:0.0:1746147146.989314:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.989338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147146.989365:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308116096 00000100:00100000:0.0:1746147146.989369:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308116096 00002000:00100000:0.0:1746147146.989405:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880093144e00 x1830967308116096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 504/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.989415:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144e00 with x1830967308116096 ext(0->1048575) 00002000:00010000:0.0:1746147146.989421:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093144e00 00000100:00100000:0.0:1746147146.989433:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308116352 00000100:00100000:0.0:1746147146.989435:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308116352 00002000:00100000:0.0:1746147146.989446:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009c30ad80 x1830967308116352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/0 e 0 to 0 dl 1746147157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147146.989453:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30ad80 with x1830967308116352 ext(1048576->2097151) 00002000:00010000:0.0:1746147146.989455:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30ad80 00000100:00100000:0.0:1746147146.989473:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3656 00000100:00100000:0.0:1746147146.989480:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308116096:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147146.990131:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3657 00000100:00100000:2.0:1746147146.990140:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308116352:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147146.990670:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5521 00000100:00100000:3.0:1746147146.990679:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+56:32486:x1830967308115840:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147146.990871:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+57:32486:x1830967308115840:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 193us (2517us total) trans 8589936060 rc 0/0 00000100:00100000:3.0:1746147146.990881:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5521 00000100:00100000:2.0:1746147146.993316:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310728960:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147146.993354:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x3139939425057064 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78571 expref: 29 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.993373:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80e00/0x3139939425057064 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78571 expref: 29 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147146.993389:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80e00, rc 0) 00000100:00100000:2.0:1746147146.993420:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308115584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 12230us (12484us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147146.993428:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14871 00000100:00100000:0.0:1746147147.006383:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.006479:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308116480 00000100:00100000:3.0:1746147147.006488:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308116480 00000100:00100000:3.0:1746147147.006583:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14872 00000100:00100000:2.0:1746147147.006709:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+12:2003:x1830967308116096:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17226us (17393us total) trans 0 rc 700416/700416 00000100:00100000:2.0:1746147147.006720:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3656 00002000:00100000:2.0:1746147147.006731:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880093144e00 x1830967308116096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 504/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.006741:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144e00 with x1830967308116096 ext(0->1048575) 00000100:00100000:3.0:1746147147.006745:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32492:x1830967308116480:12345-192.168.204.25@tcp:101:cat.0 00002000:00010000:2.0:1746147147.006747:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093144e00 00010000:00010000:3.0:1746147147.006763:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.006784:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78578 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.006815:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.006822:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.006824:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.006827:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.006871:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.006884:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 11 pid: 9586 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746147147.006896:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310729088:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.007208:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.007925:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308116352:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17782us (18581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147147.007933:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3657 00002000:00100000:2.0:1746147147.007941:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009c30ad80 x1830967308116352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:522/0 lens 488/440 e 0 to 0 dl 1746147157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.007950:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30ad80 with x1830967308116352 ext(1048576->2097151) 00002000:00010000:2.0:1746147147.007954:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30ad80 00000100:00100000:3.0:1746147147.009435:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310729088:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.009468:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.009491:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80200, rc 0) 00000100:00100000:3.0:1746147147.009575:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32492:x1830967308116480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2982us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.009584:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14872 00000100:00100000:0.0:1746147147.017591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.017650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.017665:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308116608 00000100:00100000:2.0:1746147147.017677:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308116608 00002000:00100000:2.0:1746147147.017729:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (315392->663551) req@ffff88009c309c00 x1830967308116608/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.017739:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309c00 with x1830967308116608 ext(315392->663551) 00010000:00010000:2.0:1746147147.017749:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 12 pid: 9586 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746147147.017765:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 12 pid: 9586 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746147147.017772:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c309c00 00000100:00100000:3.0:1746147147.017801:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308116736 00000100:00100000:3.0:1746147147.017806:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308116736 00000100:00100000:2.0:1746147147.017810:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1151 00000100:00100000:2.0:1746147147.017820:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967308116608:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147147.017849:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14873 00000100:00100000:3.0:1746147147.017867:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+13:32493:x1830967308116736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.017878:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.017896:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7857f expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.017921:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.017928:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.017930:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.017933:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.017963:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.017971:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 28 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.017983:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310729216:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.018047:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.020444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.021217:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308116992 00000100:00100000:3.0:1746147147.021225:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308116992 00000100:00100000:3.0:1746147147.021462:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15348 00000100:00100000:3.0:1746147147.021472:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+34:32496:x1830967308116992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147147.021500:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.021519:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425057079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78586 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.021634:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.021650:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 56 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.021658:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.021689:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 56 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.021700:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 56 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.021711:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310729344:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.022152:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.025718:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310729216:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.025753:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.025771:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80c00, rc 0) 00000100:00100000:0.0:1746147147.025808:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.025830:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:32493:x1830967308116736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7973us (8179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.025842:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14873 00000100:00100000:3.0:1746147147.026801:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310729344:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.026820:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147147.027526:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308117120 00000100:00100000:1.0:1746147147.027535:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308117120 00002000:00100000:1.0:1746147147.027576:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1880064->2097151) req@ffff88009c309500 x1830967308117120/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.027588:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309500 with x1830967308117120 ext(1880064->2097151) 00010000:00010000:1.0:1746147147.027597:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 29 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.027609:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 29 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746147147.027617:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c309500 00000100:00100000:1.0:1746147147.027646:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1152 00000100:00100000:1.0:1746147147.027653:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308117120:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147147.027807:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967308116608:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9986us (10225us total) trans 17179874251 rc 0/0 00000100:00100000:2.0:1746147147.027815:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1151 00002000:00100000:2.0:1746147147.027821:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (315392->663551) req@ffff88009c309c00 x1830967308116608/t17179874251(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.027828:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309c00 with x1830967308116608 ext(315392->663551) 00010000:00010000:2.0:1746147147.027834:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.027843:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746147147.027848:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c309c00 00000100:00100000:1.0:1746147147.028522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.029043:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308117248 00000100:00100000:2.0:1746147147.029048:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308117248 00010000:00010000:2.0:1746147147.029069:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 57 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.029116:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6561 00000100:00100000:2.0:1746147147.029122:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+57:2001:x1830967308117248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.029131:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.029136:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 57 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.029146:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 57 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.029168:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425057048 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7855c expref: 57 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.029184:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.029189:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.029199:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.029206:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.029224:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.029259:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+56:2001:x1830967308117248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.029269:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6561 00010000:00010000:2.0:1746147147.029291:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.029297:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147147.029315:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147147.029444:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425057079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 37 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.029457:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 36 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.029463:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.029466:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147147.029468:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33400, rc 0) 00000100:00100000:2.0:1746147147.029489:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+36:32496:x1830967308116992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8020us (9056us total) trans 8589936061 rc 0/0 00000100:00100000:2.0:1746147147.029495:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15348 00000100:00100000:1.0:1746147147.034399:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.034434:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308117376 00000100:00100000:1.0:1746147147.034444:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308117376 00010000:00010000:1.0:1746147147.034484:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.034531:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6562 00000100:00100000:1.0:1746147147.034540:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308117376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.034553:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.034571:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.034580:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.034605:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a5400/0x3139939425056f92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->663551) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78501 expref: 15 pid: 9586 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.034620:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.034621:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.034628:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.034634:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.034662:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.034674:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729472:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147147.034756:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.036664:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308117120:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9000us (10846us total) trans 17179874252 rc 0/0 00000100:00100000:0.0:1746147147.036677:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1152 00002000:00100000:0.0:1746147147.036687:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1880064->2097151) req@ffff88009c309500 x1830967308117120/t17179874252(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.036698:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309500 with x1830967308117120 ext(1880064->2097151) 00010000:00010000:0.0:1746147147.036708:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 31 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.036722:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 31 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746147147.036729:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c309500 00000100:00100000:1.0:1746147147.040157:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729472:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147147.040185:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.040257:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308117376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5715us (5865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.040270:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6562 00000100:00100000:0.0:1746147147.043435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.043658:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308117632 00000100:00100000:2.0:1746147147.043669:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308117632 00002000:00100000:2.0:1746147147.043723:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009c308e00 x1830967308117632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.043733:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308e00 with x1830967308117632 ext(0->1048575) 00002000:00010000:2.0:1746147147.043739:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c308e00 00000100:00100000:2.0:1746147147.043770:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3658 00000100:00100000:2.0:1746147147.043781:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967308117632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.049077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.051120:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308117760 00000100:00100000:1.0:1746147147.051134:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308117760 00010000:00010000:1.0:1746147147.051179:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.051232:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6563 00000100:00100000:1.0:1746147147.051240:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308117760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.051255:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.051276:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.051290:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.051313:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057025 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7854e expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.051344:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.051346:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.051354:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.051364:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.051409:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.051425:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729600:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147147.051547:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.059794:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967308117632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16002us (16354us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147147.059807:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3658 00002000:00100000:2.0:1746147147.059819:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009c308e00 x1830967308117632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.059829:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308e00 with x1830967308117632 ext(0->1048575) 00002000:00010000:2.0:1746147147.059835:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c308e00 00000100:00100000:0.0:1746147147.062564:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.062629:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118016 00000100:00100000:2.0:1746147147.062639:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118016 00002000:00100000:2.0:1746147147.062686:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880098e10000 x1830967308118016/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.062696:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10000 with x1830967308118016 ext(1048576->2097151) 00002000:00010000:2.0:1746147147.062704:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e10000 00000100:00100000:2.0:1746147147.062727:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3659 00000100:00100000:2.0:1746147147.062734:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308118016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.063702:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729600:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147147.063729:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.063772:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308117760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 12533us (14707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.063782:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6563 00000100:00100000:0.0:1746147147.075553:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+14:2001:x1830967308118016:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12805us (12987us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147147.075565:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3659 00002000:00100000:0.0:1746147147.075577:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880098e10000 x1830967308118016/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.075587:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098e10000 with x1830967308118016 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.075594:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098e10000 00000100:00100000:0.0:1746147147.076741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.076804:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118144 00000100:00100000:3.0:1746147147.076812:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118144 00000100:00100000:3.0:1746147147.076869:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14874 00000100:00100000:3.0:1746147147.076877:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32492:x1830967308118144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.076895:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.076917:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7858d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.076942:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.076944:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.076952:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.076966:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.076977:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:3.0:1746147147.077008:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32492:x1830967308118144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 131us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.077013:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14874 00000100:00100000:0.0:1746147147.079691:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.079754:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118400 00000100:00100000:2.0:1746147147.079761:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118400 00002000:00100000:2.0:1746147147.079802:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801323d5f80 x1830967308118400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.079812:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5f80 with x1830967308118400 ext(1048576->2097151) 00002000:00010000:2.0:1746147147.079817:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5f80 00000100:00100000:2.0:1746147147.079848:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3660 00000100:00100000:2.0:1746147147.079862:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308118400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.081738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.082152:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118528 00000100:00100000:1.0:1746147147.082158:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118528 00000100:00100000:1.0:1746147147.082585:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14875 00000100:00100000:1.0:1746147147.082594:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+14:32493:x1830967308118528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147147.082609:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.082629:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78594 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.082657:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.082665:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147147.082667:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147147.082671:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.082703:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.082715:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 32 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.082726:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310729728:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147147.082791:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.096026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.096534:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310729728:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.096568:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.096585:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7000, rc 0) 00000100:00100000:1.0:1746147147.096634:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+15:32493:x1830967308118528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 14041us (14901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.096644:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14875 00000100:00100000:2.0:1746147147.096834:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118656 00000100:00100000:2.0:1746147147.096842:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118656 00002000:00100000:2.0:1746147147.096891:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2433023) req@ffff8801323d7800 x1830967308118656/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.096900:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7800 with x1830967308118656 ext(2097152->2433023) 00010000:00010000:2.0:1746147147.096907:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.096920:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746147147.096928:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d7800 00000100:00100000:0.0:1746147147.097051:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967308118400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17196us (17366us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147147.097058:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3660 00002000:00100000:0.0:1746147147.097064:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801323d5f80 x1830967308118400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.097071:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5f80 with x1830967308118400 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.097074:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5f80 00000100:00100000:0.0:1746147147.097086:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1153 00000100:00100000:0.0:1746147147.097107:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308118656:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147147.102244:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308118656:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5123us (6216us total) trans 17179874253 rc 0/0 00000100:00100000:3.0:1746147147.102261:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1153 00002000:00100000:3.0:1746147147.102275:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2433023) req@ffff8801323d7800 x1830967308118656/t17179874253(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.102285:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7800 with x1830967308118656 ext(2097152->2433023) 00010000:00010000:3.0:1746147147.102296:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.102311:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 33 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746147147.102319:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d7800 00000100:00100000:0.0:1746147147.103120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.103653:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118784 00000100:00100000:1.0:1746147147.103662:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118784 00000100:00100000:1.0:1746147147.103711:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14876 00000100:00100000:1.0:1746147147.103718:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32492:x1830967308118784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147147.103734:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.103750:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7859b expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.103777:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147147.103783:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2433024->3145727] (req 2433024->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.103795:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2433024->3145727] (req 2433024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.103806:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7200, rc 0) 00000100:00100000:1.0:1746147147.103847:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32492:x1830967308118784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.103865:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14876 00000100:00100000:0.0:1746147147.107350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.108398:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308118912 00000100:00100000:1.0:1746147147.108409:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308118912 00010000:00010000:1.0:1746147147.108452:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.108493:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6564 00000100:00100000:1.0:1746147147.108501:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967308118912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.108516:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.108536:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.108548:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.108570:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x313993942505702c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78555 expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.108598:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.108600:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.108607:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.108615:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.108621:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.108623:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.108625:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.108630:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.108658:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.108668:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729856:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147147.108771:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.108779:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729984:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147147.108799:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.112901:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729856:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147147.112914:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310729984:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147147.112942:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147147.112984:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308118912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4482us (5643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.112996:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6564 00000100:00100000:0.0:1746147147.119937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.120380:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308119168 00000100:00100000:3.0:1746147147.120389:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308119168 00002000:00100000:3.0:1746147147.120436:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d7b80 x1830967308119168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.120446:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7b80 with x1830967308119168 ext(2097152->4194303) 00002000:00010000:3.0:1746147147.120451:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d7b80 00000100:00100000:3.0:1746147147.120486:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3661 00000100:00100000:3.0:1746147147.120492:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308119168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.122299:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.122356:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308119424 00000100:00100000:2.0:1746147147.122363:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308119424 00002000:00100000:2.0:1746147147.122399:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2433024->4194303) req@ffff8801323d4e00 x1830967308119424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.122409:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4e00 with x1830967308119424 ext(2433024->4194303) 00002000:00010000:2.0:1746147147.122415:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d4e00 00000100:00100000:2.0:1746147147.122432:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3662 00000100:00100000:2.0:1746147147.122438:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308119424:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.142362:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308119424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19912us (20060us total) trans 0 rc 1761280/1761280 00000100:00100000:2.0:1746147147.142376:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3662 00002000:00100000:2.0:1746147147.142569:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2433024->4194303) req@ffff8801323d4e00 x1830967308119424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1761280/1761280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.142586:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4e00 with x1830967308119424 ext(2433024->4194303) 00002000:00010000:2.0:1746147147.142592:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d4e00 00000100:00100000:3.0:1746147147.147831:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308119168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27325us (27895us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147147.147844:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3661 00002000:00100000:3.0:1746147147.147866:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff8801323d7b80 x1830967308119168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.147881:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7b80 with x1830967308119168 ext(2097152->4194303) 00002000:00010000:3.0:1746147147.147887:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d7b80 00000100:00100000:0.0:1746147147.158035:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.158278:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308119680 00000100:00100000:3.0:1746147147.158290:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308119680 00002000:00100000:3.0:1746147147.158337:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099013b80 x1830967308119680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.158347:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013b80 with x1830967308119680 ext(4194304->4919295) 00002000:00010000:3.0:1746147147.158353:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099013b80 00000100:00100000:3.0:1746147147.158388:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3663 00000100:00100000:3.0:1746147147.158396:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308119680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.164394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.165063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.165187:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308119808 00000100:00100000:2.0:1746147147.165197:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308119808 00000100:00100000:2.0:1746147147.165246:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308119936 00000100:00100000:2.0:1746147147.165249:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308119936 00000100:00100000:2.0:1746147147.165277:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14877 00000100:00100000:2.0:1746147147.165286:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308119808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.165306:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.165327:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785a2 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.165350:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.165353:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.165362:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.165377:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.165388:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeea00, rc 0) 00000100:00100000:2.0:1746147147.165437:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308119808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 152us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.165442:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14877 00000100:00100000:2.0:1746147147.165458:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14878 00000100:00100000:2.0:1746147147.165463:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:32496:x1830967308119936:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147147.165470:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.165480:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785a9 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.165496:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.165504:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.165510:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.165515:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.165516:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.165519:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1298432->2076671] (req 1298432->2076671) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.165549:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.165561:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746147147.165574:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730112:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.165657:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.165669:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 9 pid: 12201 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746147147.165678:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730240:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.165705:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.165713:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 27 pid: 1136 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.165719:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730368:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.165737:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.171062:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730112:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.171074:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730240:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.171081:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730368:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.171129:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1298432->2076671] (req 1298432->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.171148:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbef400, rc 0) 00000100:00100000:2.0:1746147147.171197:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:32496:x1830967308119936:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5732us (6133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.171206:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14878 00000100:00100000:0.0:1746147147.171273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.171296:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308120064 00000100:00100000:0.0:1746147147.171302:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308120064 00010000:00010000:0.0:1746147147.171329:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.171352:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308119680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12956us (13411us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147147.171361:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3663 00000100:00100000:0.0:1746147147.171367:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6565 00002000:00100000:3.0:1746147147.171370:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099013b80 x1830967308119680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147147.171375:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308120064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746147147.171378:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013b80 with x1830967308119680 ext(4194304->4919295) 00002000:00010000:3.0:1746147147.171383:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099013b80 00010000:00010000:0.0:1746147147.171387:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147147.171412:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746147147.171422:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746147147.171446:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425056fbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78524 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746147147.171468:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147147.171486:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308120064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.171492:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6565 00000100:00100000:0.0:1746147147.172063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.173108:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308120192 00000100:00100000:2.0:1746147147.173116:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308120192 00010000:00010000:2.0:1746147147.173144:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746147147.173185:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6566 00000100:00100000:2.0:1746147147.173192:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967308120192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.173205:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.173220:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.173231:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.173250:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a5800/0x3139939425056f7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784ec expref: 16 pid: 9586 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.173266:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.173311:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967308120192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 119us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.173316:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6566 00000100:00100000:0.0:1746147147.175988:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.177454:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308120320 00000100:00100000:2.0:1746147147.177466:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308120320 00000100:00100000:2.0:1746147147.177557:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14879 00000100:00100000:2.0:1746147147.177567:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308120320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.177589:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.177611:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x31399394250570b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785b0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.177637:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.177649:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x31399394250570b1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785b0 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.177661:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x31399394250570b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785b0 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.177672:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee800, rc 0) 00000100:00100000:2.0:1746147147.178451:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308120320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 883us (2468us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.178458:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14879 00000100:00100000:1.0:1746147147.178656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.179071:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308120448 00000100:00100000:3.0:1746147147.179076:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308120448 00010000:00010000:3.0:1746147147.179133:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 28 pid: 1136 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.179155:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6567 00000100:00100000:3.0:1746147147.179161:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308120448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147147.179175:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147147.179195:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 28 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.179205:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 28 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.179226:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81000/0x3139939425056f5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c9 expref: 28 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.179252:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.179254:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.179261:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.179270:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.179301:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.179313:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310730496:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147147.179389:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.180549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.180755:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308120704 00000100:00100000:3.0:1746147147.180761:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308120704 00002000:00100000:3.0:1746147147.180804:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88011e500a80 x1830967308120704/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.180821:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500a80 with x1830967308120704 ext(4194304->4919295) 00002000:00010000:3.0:1746147147.180826:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500a80 00000100:00100000:3.0:1746147147.180865:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3664 00000100:00100000:3.0:1746147147.180873:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308120704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.183045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.183119:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310730496:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147147.183121:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308121088 00000100:00100000:0.0:1746147147.183127:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308121088 00010000:00010000:2.0:1746147147.183143:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.183210:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308120448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4047us (4552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.183222:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6567 00002000:00100000:1.0:1746147147.185457:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1298432->1302527) req@ffff88011e502300 x1830967308121088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.185470:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502300 with x1830967308121088 ext(1298432->1302527) 00002000:00010000:1.0:1746147147.185477:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e502300 00000100:00100000:2.0:1746147147.185668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.185678:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3665 00000100:00100000:1.0:1746147147.185690:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967308121088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.185843:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967308121088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 156us (2809us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147147.185860:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3665 00002000:00100000:1.0:1746147147.185866:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1298432->1302527) req@ffff88011e502300 x1830967308121088/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.185872:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502300 with x1830967308121088 ext(1298432->1302527) 00002000:00010000:1.0:1746147147.185875:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e502300 00000100:00100000:3.0:1746147147.186124:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308120960 00000100:00100000:3.0:1746147147.186132:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308120960 00000100:00100000:3.0:1746147147.186169:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14880 00000100:00100000:3.0:1746147147.186173:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308120960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.186183:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.186202:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81200/0x31399394250570b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785b7 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.186633:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730624:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.187250:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.189217:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308120704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8335us (8662us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147147.189228:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3664 00002000:00100000:3.0:1746147147.189240:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88011e500a80 x1830967308120704/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.189249:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500a80 with x1830967308120704 ext(4194304->4919295) 00002000:00010000:3.0:1746147147.189254:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500a80 00002000:00010000:3.0:1746147147.190307:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147146 -> 1746147147 00002000:00010000:3.0:1746147147.190312:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147146 -> 1746147147 00002000:00010000:3.0:1746147147.190316:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147146 -> 1746147147 00000100:00100000:3.0:1746147147.190333:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310730624:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.190367:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81200/0x31399394250570b8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785b7 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.190381:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81200/0x31399394250570b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785b7 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.190413:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81200, rc 0) 00000100:00100000:3.0:1746147147.190457:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308120960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4282us (4794us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.190466:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14880 00000100:00100000:0.0:1746147147.196306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.197213:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308121344 00000100:00100000:3.0:1746147147.197224:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308121344 00002000:00100000:3.0:1746147147.197275:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2072576->2076671) req@ffff88011e485500 x1830967308121344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.197286:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967308121344 ext(2072576->2076671) 00002000:00010000:3.0:1746147147.197292:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:3.0:1746147147.197328:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3666 00000100:00100000:3.0:1746147147.197336:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308121344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147147.197501:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308121344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 165us (1208us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147147.197511:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3666 00002000:00100000:3.0:1746147147.197516:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2072576->2076671) req@ffff88011e485500 x1830967308121344/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.197530:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967308121344 ext(2072576->2076671) 00002000:00010000:3.0:1746147147.197532:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:2.0:1746147147.202045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.203639:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308121600 00000100:00100000:3.0:1746147147.203651:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308121600 00000100:00100000:3.0:1746147147.203949:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5522 00000100:00100000:3.0:1746147147.203959:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+56:32492:x1830967308121600:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147147.204398:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+57:32492:x1830967308121600:12345-192.168.204.25@tcp:35:cat.0 Request processed in 440us (2363us total) trans 8589936062 rc 0/0 00000100:00100000:3.0:1746147147.204405:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5522 00000100:00100000:0.0:1746147147.218354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.219241:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308121856 00000100:00100000:2.0:1746147147.219251:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308121856 00000100:00100000:2.0:1746147147.219309:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15349 00000100:00100000:2.0:1746147147.219318:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+57:32501:x1830967308121856:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147147.219341:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.219363:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785be expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.219448:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219460:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219470:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219481:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219487:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219492:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219581:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219590:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219595:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147147.219603:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147147.219669:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219676:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219685:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219691:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219696:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.219699:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219704:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219713:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147147.219715:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147147.219719:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219723:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219752:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219757:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219761:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219765:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbef000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.219767:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219774:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219780:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23800) 00010000:00010000:2.0:1746147147.219783:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147147.219784:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219789:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147147.219821:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785be expref: 60 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.219831:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785be expref: 59 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.219837:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.219839:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147147.219842:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee400, rc 0) 00000100:00100000:2.0:1746147147.219902:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+59:32501:x1830967308121856:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 584us (1558us total) trans 8589936063 rc 0/0 00000100:00100000:2.0:1746147147.219907:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15349 00000100:00100000:0.0:1746147147.229726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.231185:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308121984 00000100:00100000:2.0:1746147147.231196:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308121984 00000100:00100000:2.0:1746147147.231254:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 824 00000100:00100000:2.0:1746147147.231263:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+59:2003:x1830967308121984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.231278:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.231307:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785be expref: 59 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.231832:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.231837:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.231895:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+58:2003:x1830967308121984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 633us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.231903:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 824 00000100:00100000:0.0:1746147147.298765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.298892:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308122112 00000100:00100000:2.0:1746147147.298904:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308122112 00000100:00100000:2.0:1746147147.299324:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15350 00000100:00100000:2.0:1746147147.299334:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+20:32503:x1830967308122112:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147147.299360:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.299381:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785c5 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.299445:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299458:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299469:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299481:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299487:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299492:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299565:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299576:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 35 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.299583:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.299613:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 35 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.299626:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 35 pid: 7239 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.299637:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310730752:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.299747:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.304240:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.304315:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308122368 00000100:00100000:3.0:1746147147.304325:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308122368 00000100:00100000:3.0:1746147147.304381:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5523 00000100:00100000:3.0:1746147147.304390:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+36:30748:x1830967308122368:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147147.304629:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:30748:x1830967308122368:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 239us (401us total) trans 8589936064 rc 0/0 00000100:00100000:3.0:1746147147.304635:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5523 00000100:00100000:2.0:1746147147.307331:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310730752:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.307364:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147147.308216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.308302:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308122496 00000100:00100000:2.0:1746147147.308311:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308122496 00010000:00010000:2.0:1746147147.308345:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 37 pid: 7239 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.308381:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6568 00000100:00100000:2.0:1746147147.308388:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967308122496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.308405:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.308410:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 37 pid: 7239 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.308421:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 37 pid: 7239 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.308443:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33400/0x3139939425057080 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78586 expref: 37 pid: 7239 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.308465:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.308470:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.308481:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.308488:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.308515:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.308567:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+36:2001:x1830967308122496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.308573:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6568 00010000:00010000:3.0:1746147147.308646:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308654:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147147.308704:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147147.308708:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147147.308724:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308738:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308749:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308755:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308761:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308766:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308770:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbefa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147147.308774:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308780:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308787:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147147.308790:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147147.308793:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308797:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbefa00/0x31399394250570e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308809:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308813:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308818:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308821:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbef000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147147.308823:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308827:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308832:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23700) 00010000:00010000:3.0:1746147147.308833:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147147.308835:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308840:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x31399394250570f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.308881:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee400/0x31399394250570e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.309269:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 21 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.309275:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.309277:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147147.309279:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeee00, rc 0) 00000100:00100000:3.0:1746147147.309308:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:32503:x1830967308122112:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9975us (10554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.309316:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15350 00000100:00100000:2.0:1746147147.313249:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.313294:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308122624 00000100:00100000:2.0:1746147147.313302:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308122624 00000100:00100000:2.0:1746147147.313349:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14881 00000100:00100000:2.0:1746147147.313358:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2003:x1830967308122624:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147147.313381:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.313402:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785cc expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.313427:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.313429:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.313437:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.313453:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.313463:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33c00, rc 0) 00000100:00100000:2.0:1746147147.313523:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967308122624:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.313529:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14881 00000100:00100000:0.0:1746147147.315595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.316648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.316683:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.316723:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308122752 00000100:00100000:0.0:1746147147.316731:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308122752 00000100:00100000:2.0:1746147147.316913:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308122880 00000100:00100000:2.0:1746147147.316922:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308122880 00000100:00100000:2.0:1746147147.316954:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308123008 00000100:00100000:2.0:1746147147.316956:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308123008 00000100:00100000:2.0:1746147147.317403:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14882 00000100:00100000:3.0:1746147147.317412:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14883 00000100:00100000:2.0:1746147147.317412:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308122880:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147147.317421:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967308123008:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.317430:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.317430:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.317448:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785e1 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.317448:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785da expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.317468:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.317468:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.317470:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.317470:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.317478:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.317478:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.317493:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.317493:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.317502:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00010000:00010000:2.0:1746147147.317502:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:3.0:1746147147.317574:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2003:x1830967308123008:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 155us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.317582:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14883 00000100:00100000:3.0:1746147147.317599:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14884 00000100:00100000:3.0:1746147147.317604:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967308122752:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.317613:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.317625:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db80e00/0x3139939425057113 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785d3 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.317675:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310730880:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147147.318116:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308122880:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 703us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.318122:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14882 00000100:00100000:3.0:1746147147.320598:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.325667:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310730880:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.325707:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db80e00/0x3139939425057113 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785d3 expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.325722:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db80e00/0x3139939425057113 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785d3 expref: 10 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.337201:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80e00, rc 0) 00000100:00100000:3.0:1746147147.337310:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967308122752:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 19697us (21716us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.337321:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14884 00000100:00100000:0.0:1746147147.337877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.337947:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.337977:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308123392 00000100:00100000:0.0:1746147147.337984:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308123392 00002000:00100000:0.0:1746147147.338027:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098c70000 x1830967308123392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.338037:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70000 with x1830967308123392 ext(0->1048575) 00002000:00010000:0.0:1746147147.338043:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c70000 00000100:00100000:0.0:1746147147.338056:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308123520 00000100:00100000:0.0:1746147147.338058:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308123520 00002000:00100000:0.0:1746147147.338068:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098c71f80 x1830967308123520/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 504/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.338074:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71f80 with x1830967308123520 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.338077:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c71f80 00000100:00100000:0.0:1746147147.338086:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3667 00000100:00100000:0.0:1746147147.338110:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308123392:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.338950:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3668 00000100:00100000:0.0:1746147147.338960:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308123520:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.348182:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.349157:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308123392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11042us (11276us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147147.349170:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3667 00002000:00100000:1.0:1746147147.349182:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098c70000 x1830967308123392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.349191:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70000 with x1830967308123392 ext(0->1048575) 00002000:00010000:1.0:1746147147.349197:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c70000 00000100:00100000:3.0:1746147147.351070:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308123776 00000100:00100000:3.0:1746147147.351082:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308123776 00000100:00100000:3.0:1746147147.351157:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15351 00000100:00100000:3.0:1746147147.351165:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+21:32503:x1830967308123776:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.351183:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.351203:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505711a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785e8 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.351305:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.351319:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.351327:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.351356:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.351367:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 22 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.351378:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310731008:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.351463:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147147.359575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.359679:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310731008:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.359704:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147147.359902:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308123904 00000100:00100000:2.0:1746147147.359910:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308123904 00010000:00010000:2.0:1746147147.359948:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.359980:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6569 00000100:00100000:2.0:1746147147.359988:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2001:x1830967308123904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.360002:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.360008:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.360020:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.360045:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x31399394250570f7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785c5 expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.360062:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.360067:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.360078:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.360086:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.360125:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.360165:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:2001:x1830967308123904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 177us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.360172:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6569 00010000:00010000:3.0:1746147147.360441:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.360448:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147147.360465:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147147.360591:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505711a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.360609:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.360615:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.360624:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147147.360626:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80e00, rc 0) 00000100:00100000:3.0:1746147147.360881:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32503:x1830967308123776:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9716us (12708us total) trans 8589936065 rc 0/0 00000100:00100000:3.0:1746147147.360888:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15351 00000100:00100000:0.0:1746147147.360946:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:2000:x1830967308123520:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21986us (22996us total) trans 0 rc 270336/270336 00000100:00100000:0.0:1746147147.360959:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3668 00002000:00100000:0.0:1746147147.360967:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098c71f80 x1830967308123520/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 504/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 270336/270336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.360976:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71f80 with x1830967308123520 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.360981:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c71f80 00000100:00100000:0.0:1746147147.365193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.365255:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124032 00000100:00100000:3.0:1746147147.365273:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124032 00000100:00100000:3.0:1746147147.365331:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15352 00000100:00100000:3.0:1746147147.365339:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32503:x1830967308124032:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.365363:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.365390:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505712f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785ef expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.365488:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.365505:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.365511:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.365544:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.365556:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.365568:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310731136:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.365764:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.370232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.370504:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124160 00000100:00100000:3.0:1746147147.370514:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124160 00000100:00100000:3.0:1746147147.370559:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14885 00000100:00100000:3.0:1746147147.370568:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32501:x1830967308124160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147147.370596:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.370616:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785f6 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.370646:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.370654:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.370661:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.370667:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.370668:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.370671:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1273856->2097151] (req 1273856->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.370701:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.370712:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.370724:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310731264:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.370813:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.370826:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 10 pid: 1136 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.370834:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310731392:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.370873:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.370882:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 15 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.370890:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310731520:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.370908:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.371003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.371080:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124288 00000100:00100000:1.0:1746147147.371085:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124288 00010000:00010000:1.0:1746147147.371136:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 24 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.371159:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6570 00000100:00100000:1.0:1746147147.371164:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2001:x1830967308124288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.371176:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.371182:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 24 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.371192:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 24 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.371213:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147147.371218:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.371228:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.371234:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.371248:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.371271:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2001:x1830967308124288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.371277:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6570 00010000:00010000:2.0:1746147147.371407:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x3139939425057121 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e8 expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.371424:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310731136:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.371442:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.371449:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.371454:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147147.371510:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147147.371514:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147147.371532:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.371560:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942505712f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.371572:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.371578:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.371580:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147147.371583:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81800, rc 0) 00000100:00100000:2.0:1746147147.371608:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32503:x1830967308124032:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6270us (6427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.371614:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15352 00000100:00100000:0.0:1746147147.377423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.377684:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124416 00000100:00100000:3.0:1746147147.377695:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124416 00000100:00100000:3.0:1746147147.377741:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14886 00000100:00100000:3.0:1746147147.377751:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308124416:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.377773:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.377797:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425057144 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e785fd expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.377890:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310731648:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147147.378035:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310731264:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.378048:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310731392:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.378057:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310731520:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.378086:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1273856->2097151] (req 1273856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.378132:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563000, rc 0) 00000100:00100000:3.0:1746147147.379130:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.379329:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32501:x1830967308124160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8757us (9108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.379339:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14885 00000100:00100000:0.0:1746147147.382945:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.383652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.383703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.383787:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124544 00000100:00100000:2.0:1746147147.383797:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124544 00010000:00010000:2.0:1746147147.383840:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 16 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.383885:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124672 00000100:00100000:2.0:1746147147.383888:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124672 00010000:00010000:2.0:1746147147.383898:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 11 pid: 1136 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746147147.383911:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308124800 00000100:00100000:2.0:1746147147.383912:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308124800 00010000:00010000:2.0:1746147147.383922:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.384489:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6571 00000100:00100000:2.0:1746147147.384499:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308124544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.384517:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.384543:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 16 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.384554:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 16 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.384581:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425057072 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7857f expref: 16 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.384607:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.384675:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308124544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 177us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.384681:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6571 00000100:00100000:2.0:1746147147.384695:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6572 00000100:00100000:2.0:1746147147.384699:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308124672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.384705:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.384711:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 11 pid: 1136 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.384718:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 11 pid: 1136 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.384728:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425057105 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785da expref: 11 pid: 1136 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.384736:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.384747:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308124672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.384751:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6572 00000100:00100000:2.0:1746147147.384758:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6573 00000100:00100000:2.0:1746147147.384761:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967308124800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.384767:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.384771:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.384780:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.384790:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x313993942505708e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7858d expref: 34 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.384797:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.384799:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.384805:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.384812:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.384841:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.384862:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310731776:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.384908:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.387812:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310731648:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.387845:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425057144 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785fd expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.387868:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563800/0x3139939425057144 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785fd expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.388074:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563800, rc 0) 00000100:00100000:3.0:1746147147.388262:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308124416:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10511us (10848us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.388271:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14886 00000100:00100000:0.0:1746147147.389581:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310731776:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147147.389596:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147147.389623:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967308124800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4860us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.389631:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6573 00000100:00100000:0.0:1746147147.390030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.390117:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308125056 00000100:00100000:2.0:1746147147.390126:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308125056 00002000:00100000:2.0:1746147147.390162:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1273856->1277951) req@ffff880094529880 x1830967308125056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.390171:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529880 with x1830967308125056 ext(1273856->1277951) 00002000:00010000:2.0:1746147147.390176:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094529880 00000100:00100000:2.0:1746147147.392249:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3669 00000100:00100000:2.0:1746147147.392265:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308125056:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147147.392422:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308125056:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 163us (2392us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147147.392428:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3669 00002000:00100000:2.0:1746147147.392436:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8e:0x0] (1273856->1277951) req@ffff880094529880 x1830967308125056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.392444:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094529880 with x1830967308125056 ext(1273856->1277951) 00002000:00010000:2.0:1746147147.392449:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094529880 00000100:00100000:0.0:1746147147.393575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.393768:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308125312 00000100:00100000:2.0:1746147147.393776:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308125312 00000100:00100000:2.0:1746147147.393816:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15353 00000100:00100000:2.0:1746147147.393823:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32503:x1830967308125312:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147147.393837:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.393868:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505714b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78604 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.393965:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.393981:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400369:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400407:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400414:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400421:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400426:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.400432:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400438:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400457:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.400459:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147147.400462:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400467:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057152 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.400544:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505714b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78604 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.400551:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505714b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78604 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.400558:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91200, rc 0) 00000100:00100000:2.0:1746147147.400628:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32503:x1830967308125312:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6803us (7055us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.400636:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15353 00000100:00100000:1.0:1746147147.401502:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.401559:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308125440 00000100:00100000:3.0:1746147147.401567:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308125440 00000100:00100000:3.0:1746147147.402521:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14887 00000100:00100000:3.0:1746147147.402531:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32501:x1830967308125440:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147147.402551:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.402570:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7860b expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.402601:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.402612:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.402619:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.402625:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.402628:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.402631:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2158591] (req 2097152->2158591) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.402665:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.402677:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.402689:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310731904:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.407818:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.407841:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 9 pid: 1398 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.407869:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310732032:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.407959:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.407968:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 14 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.407976:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310732160:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.408003:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.413005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.413300:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308125696 00000100:00100000:1.0:1746147147.413311:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308125696 00000100:00100000:1.0:1746147147.413371:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5524 00000100:00100000:1.0:1746147147.413379:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32503:x1830967308125696:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147147.415781:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:32503:x1830967308125696:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 2390us (2777us total) trans 8589936066 rc 0/0 00000100:00100000:1.0:1746147147.415794:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5524 00000100:00100000:0.0:1746147147.422242:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.422289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.422369:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308125824 00000100:00100000:2.0:1746147147.422379:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308125824 00000100:00100000:3.0:1746147147.422413:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310731904:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.422416:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 10 pid: 1398 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.422425:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310732032:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.422433:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310732160:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.422439:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308125952 00000100:00100000:2.0:1746147147.422441:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308125952 00010000:00010000:2.0:1746147147.422450:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 35 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.422462:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2158591] (req 2097152->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.422464:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6574 00000100:00100000:2.0:1746147147.422470:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2002:x1830967308125824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147147.422479:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563400, rc 0) 00010000:00010000:2.0:1746147147.422485:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.422505:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 10 pid: 1398 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.422515:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 10 pid: 1398 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.422522:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32501:x1830967308125440:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 19994us (21025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.422529:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14887 00010000:00010000:2.0:1746147147.422536:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x313993942505710c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785e1 expref: 10 pid: 1398 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746147147.422551:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.422568:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2002:x1830967308125824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.422574:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6574 00000100:00100000:2.0:1746147147.422585:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6575 00000100:00100000:2.0:1746147147.422589:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967308125952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.422596:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.422602:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.422610:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.422622:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x313993942505709c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2433024->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7859b expref: 34 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.422633:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.422663:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308125952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.422668:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6575 00000100:00100000:0.0:1746147147.428873:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.429426:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308126080 00000100:00100000:2.0:1746147147.429438:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308126080 00010000:00010000:2.0:1746147147.429476:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 15 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.429517:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6576 00000100:00100000:2.0:1746147147.429526:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308126080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.429541:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.429562:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 15 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.429574:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 15 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.429598:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x3139939425057095 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78594 expref: 15 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.429632:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.429634:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.429642:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.429650:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.429685:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.429698:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310732288:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.429800:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.432415:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310732288:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.432440:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.432503:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308126080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2977us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.432515:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6576 00000100:00100000:0.0:1746147147.434760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.434884:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308126336 00000100:00100000:1.0:1746147147.434893:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308126336 00002000:00100000:1.0:1746147147.434938:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2154496->2158591) req@ffff880094527480 x1830967308126336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.434949:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094527480 with x1830967308126336 ext(2154496->2158591) 00002000:00010000:1.0:1746147147.434956:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094527480 00000100:00100000:1.0:1746147147.434986:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3670 00000100:00100000:1.0:1746147147.434994:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967308126336:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147147.435151:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967308126336:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 157us (407us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147147.435158:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3670 00002000:00100000:1.0:1746147147.435163:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2154496->2158591) req@ffff880094527480 x1830967308126336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.435170:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094527480 with x1830967308126336 ext(2154496->2158591) 00002000:00010000:1.0:1746147147.435174:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094527480 00000100:00100000:0.0:1746147147.438914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.439039:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308126592 00000100:00100000:1.0:1746147147.439050:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308126592 00000100:00100000:1.0:1746147147.439133:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5525 00000100:00100000:1.0:1746147147.439142:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+58:32501:x1830967308126592:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147147.439358:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+59:32501:x1830967308126592:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 216us (454us total) trans 8589936067 rc 0/0 00000100:00100000:1.0:1746147147.439365:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5525 00000100:00100000:0.0:1746147147.449616:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.450405:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308126848 00000100:00100000:2.0:1746147147.450416:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308126848 00000100:00100000:2.0:1746147147.450473:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15354 00000100:00100000:2.0:1746147147.450482:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+59:32513:x1830967308126848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.450509:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.450531:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91800/0x3139939425057160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78612 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.450617:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.450635:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.450646:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.450660:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.450768:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.450774:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451037:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451048:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451054:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147147.451061:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147147.451154:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451161:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451166:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451172:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451178:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.451255:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451263:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451275:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147147.451278:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147147.451283:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451288:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451619:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451626:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451631:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451635:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.451637:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451643:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451650:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23e00) 00010000:00010000:2.0:1746147147.451652:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147147.451654:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451658:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x313993942505716e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.451831:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91800/0x3139939425057160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 62 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.451843:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 61 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.451861:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.451863:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147147.451865:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91600, rc 0) 00000100:00100000:2.0:1746147147.452720:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+61:32513:x1830967308126848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2236us (3112us total) trans 8589936068 rc 0/0 00000100:00100000:2.0:1746147147.452728:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15354 00000100:00100000:0.0:1746147147.459970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.460135:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308126976 00000100:00100000:3.0:1746147147.460145:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308126976 00000100:00100000:3.0:1746147147.460871:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14888 00000100:00100000:3.0:1746147147.460880:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308126976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.460901:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.460920:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563c00/0x3139939425057183 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78619 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.460974:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310732416:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.461116:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.462861:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310732416:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.462891:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563c00/0x3139939425057183 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78619 expref: 28 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.462903:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563c00/0x3139939425057183 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78619 expref: 28 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.462919:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563c00, rc 0) 00000100:00100000:3.0:1746147147.462964:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308126976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2085us (3007us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.462972:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14888 00000100:00100000:2.0:1746147147.463451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.463499:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308127232 00000100:00100000:0.0:1746147147.463506:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308127232 00000100:00100000:0.0:1746147147.463549:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15355 00000100:00100000:0.0:1746147147.463555:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+36:32512:x1830967308127232:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147147.463573:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.463983:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505718a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78620 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.464086:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147147.464133:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.464140:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 60 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.464148:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147147.464176:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 60 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.464189:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 60 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.464201:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310732544:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147147.464281:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.464290:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 22 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.464298:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310732672:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147147.464318:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.467274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.467639:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308127360 00000100:00100000:3.0:1746147147.467649:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308127360 00000100:00100000:3.0:1746147147.468254:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14889 00000100:00100000:3.0:1746147147.468263:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32513:x1830967308127360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.468367:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.468388:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78627 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.468417:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.468424:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.468426:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.468429:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.468461:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.468471:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 14 pid: 12225 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.468489:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310732800:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.469228:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.470689:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.471251:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308127616 00000100:00100000:3.0:1746147147.471258:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308127616 00010000:00010000:3.0:1746147147.471292:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.471508:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6577 00000100:00100000:3.0:1746147147.471516:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2000:x1830967308127616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147147.471532:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147147.471537:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.471547:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 23 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.471568:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.471573:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.471582:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.471586:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147147.471625:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:2000:x1830967308127616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.471630:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6577 00000100:00100000:0.0:1746147147.471835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.471918:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310732544:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.471936:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x3139939425057136 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785ef expref: 22 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.471965:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310732672:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.471986:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147147.472064:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308127488 00000100:00100000:1.0:1746147147.472069:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308127488 00010000:00010000:1.0:1746147147.472086:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 61 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.472123:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6578 00000100:00100000:1.0:1746147147.472128:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+61:2001:x1830967308127488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.472135:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.472140:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 61 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.472146:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 61 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.472159:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057175 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78612 expref: 61 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.472170:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147147.472174:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.472181:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.472187:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.472216:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.472239:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+60:2001:x1830967308127488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 111us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.472245:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6578 00000100:00100000:1.0:1746147147.472387:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.472405:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308127744 00000100:00100000:1.0:1746147147.472408:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308127744 00002000:00100000:1.0:1746147147.472435:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1298432->2076671) req@ffff8801349a3100 x1830967308127744/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.472445:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3100 with x1830967308127744 ext(1298432->2076671) 00010000:00010000:1.0:1746147147.472458:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 15 pid: 12225 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.472470:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 15 pid: 12225 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746147147.472476:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a3100 00000100:00100000:1.0:1746147147.472490:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1154 00000100:00100000:1.0:1746147147.472496:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2001:x1830967308127744:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147147.472659:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310732800:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.472676:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.472688:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562c00, rc 0) 00000100:00100000:1.0:1746147147.472706:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32513:x1830967308127360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4445us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.472713:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14889 00010000:00010000:2.0:1746147147.472870:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.472880:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147147.472899:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147147.474215:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505718a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 39 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.474231:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 38 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.474239:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.474241:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147147.474244:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9200, rc 0) 00000100:00100000:2.0:1746147147.474291:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+38:32512:x1830967308127232:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10736us (10842us total) trans 8589936069 rc 0/0 00000100:00100000:2.0:1746147147.474298:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15355 00000100:00100000:1.0:1746147147.483544:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308127744:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11034us (11142us total) trans 21474841522 rc 0/0 00000100:00100000:1.0:1746147147.483558:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1154 00002000:00100000:1.0:1746147147.483572:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1298432->2076671) req@ffff8801349a3100 x1830967308127744/t21474841522(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.483582:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3100 with x1830967308127744 ext(1298432->2076671) 00010000:00010000:1.0:1746147147.483593:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 17 pid: 12225 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.483615:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 17 pid: 12225 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746147147.483622:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a3100 00000100:00100000:0.0:1746147147.492242:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.492341:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308127872 00000100:00100000:2.0:1746147147.492351:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308127872 00010000:00010000:2.0:1746147147.492392:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 17 pid: 12225 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.492421:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6579 00000100:00100000:2.0:1746147147.492429:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308127872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.492444:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.492464:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 17 pid: 12225 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.492488:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 17 pid: 12225 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.492513:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef400/0x31399394250570aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->2076671) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a9 expref: 17 pid: 12225 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.492532:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.492534:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.492541:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.492549:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.492583:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.492595:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310732928:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.493291:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.502834:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310732928:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.502869:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.502917:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308127872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10488us (10687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.502929:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6579 00000100:00100000:0.0:1746147147.507540:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.507585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.507611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.507639:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308128256 00000100:00100000:0.0:1746147147.507648:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308128256 00000100:00100000:0.0:1746147147.507689:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308128384 00000100:00100000:0.0:1746147147.507691:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308128384 00000100:00100000:0.0:1746147147.507707:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308128512 00000100:00100000:0.0:1746147147.507709:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308128512 00000100:00100000:0.0:1746147147.507725:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14890 00000100:00100000:0.0:1746147147.507734:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967308128256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147147.507756:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.507779:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7862e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.507805:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147147.507807:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147147.507817:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14891 00010000:00010000:0.0:1746147147.507818:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147147.507828:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308128384:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147147.507836:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.507838:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.507859:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9800, rc 0) 00010000:00010000:1.0:1746147147.507862:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c10e00/0x31399394250571ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78635 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.507910:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310733056:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147147.507913:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308128256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 179us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.507919:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14890 00000100:00100000:0.0:1746147147.507936:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14892 00000100:00100000:0.0:1746147147.507942:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967308128512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147147.507948:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.507957:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9000/0x31399394250571b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7863c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.507982:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.507982:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310733184:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147147.508007:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.508060:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.508107:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308128640 00000100:00100000:0.0:1746147147.508110:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308128640 00002000:00100000:0.0:1746147147.511582:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1273855) req@ffff880094526300 x1830967308128640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.511598:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526300 with x1830967308128640 ext(1048576->1273855) 00002000:00010000:0.0:1746147147.511606:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526300 00000100:00100000:0.0:1746147147.511658:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3671 00000100:00100000:0.0:1746147147.511673:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308128640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.512066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.512339:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308128768 00000100:00100000:1.0:1746147147.512347:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308128768 00002000:00100000:1.0:1746147147.512386:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094524000 x1830967308128768/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.512395:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524000 with x1830967308128768 ext(1048576->2097151) 00002000:00010000:1.0:1746147147.512399:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094524000 00000100:00100000:1.0:1746147147.512415:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3672 00000100:00100000:1.0:1746147147.512421:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308128768:12345-192.168.204.25@tcp:3:cat.0 00002000:00010000:2.0:1746147147.525571:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147146 -> 1746147147 00002000:00010000:2.0:1746147147.525581:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147146 -> 1746147147 00002000:00010000:2.0:1746147147.525583:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147146 -> 1746147147 00000100:00100000:2.0:1746147147.525609:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310733184:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147147.525643:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9000/0x31399394250571b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7863c expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.525658:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9000/0x31399394250571b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7863c expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.525689:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9000, rc 0) 00002000:00010000:1.0:1746147147.525690:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147146 -> 1746147147 00002000:00010000:1.0:1746147147.525695:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147146 -> 1746147147 00002000:00010000:1.0:1746147147.525697:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147146 -> 1746147147 00000100:00100000:1.0:1746147147.525705:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310733056:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147147.525722:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c10e00/0x31399394250571ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78635 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.525732:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c10e00/0x31399394250571ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78635 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.525748:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c10e00, rc 0) 00000100:00100000:2.0:1746147147.527363:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+15:2002:x1830967308128512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 19411us (19741us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.527374:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14892 00000100:00100000:1.0:1746147147.527471:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+14:2003:x1830967308128384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 19644us (19883us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147147.527478:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14891 00000100:00100000:1.0:1746147147.528060:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308128640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16393us (19997us total) trans 0 rc 225280/225280 00000100:00100000:1.0:1746147147.528067:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3671 00002000:00100000:1.0:1746147147.528078:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1273855) req@ffff880094526300 x1830967308128640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 225280/225280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.528109:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526300 with x1830967308128640 ext(1048576->1273855) 00002000:00010000:1.0:1746147147.528115:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526300 00000100:00100000:1.0:1746147147.529167:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308128768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16742us (17097us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147147.529175:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3672 00002000:00100000:1.0:1746147147.529182:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094524000 x1830967308128768/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.529191:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524000 with x1830967308128768 ext(1048576->2097151) 00002000:00010000:1.0:1746147147.529195:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094524000 00000100:00100000:0.0:1746147147.541241:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.541908:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308128896 00000100:00100000:2.0:1746147147.541921:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308128896 00000100:00100000:2.0:1746147147.542005:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15356 00000100:00100000:2.0:1746147147.542017:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+22:32518:x1830967308128896:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147147.542052:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.542079:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x31399394250571bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78643 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.542202:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.542218:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.542229:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.542248:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.542255:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.542261:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.543148:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.543165:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 37 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.543172:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.543207:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 37 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.543218:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 37 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.543232:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310733312:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.543336:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.543964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.544072:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308129152 00000100:00100000:0.0:1746147147.544080:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308129152 00002000:00100000:0.0:1746147147.544156:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094534700 x1830967308129152/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.544167:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534700 with x1830967308129152 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.544173:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094534700 00000100:00100000:0.0:1746147147.544199:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3673 00000100:00100000:0.0:1746147147.544209:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308129152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.553231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.553322:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308129408 00000100:00100000:3.0:1746147147.553335:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308129408 00002000:00100000:3.0:1746147147.553391:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2158592->4194303) req@ffff8800909f9c00 x1830967308129408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.553401:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9c00 with x1830967308129408 ext(2158592->4194303) 00002000:00010000:3.0:1746147147.553407:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9c00 00000100:00100000:3.0:1746147147.553430:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3674 00000100:00100000:3.0:1746147147.553437:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308129408:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.553759:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.553825:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310733312:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.553856:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147147.554055:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308129536 00000100:00100000:0.0:1746147147.554061:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308129536 00010000:00010000:0.0:1746147147.554098:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 38 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.554120:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6580 00000100:00100000:0.0:1746147147.554126:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+38:2002:x1830967308129536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147147.554137:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147147.554143:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 38 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.554153:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 38 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.554171:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057191 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78620 expref: 38 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.554193:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147147.554198:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147147.554208:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147147.554214:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147147.554227:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147147.554262:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+37:2002:x1830967308129536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 136us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.554268:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6580 00010000:00010000:1.0:1746147147.554412:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554418:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147147.554463:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147147.554467:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147147.554485:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554494:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554505:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554510:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554515:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554521:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554527:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147147.554531:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554541:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554549:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147147.554552:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147147.554556:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554561:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x31399394250571c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554582:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554588:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554592:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554595:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147147.554597:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554601:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554607:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23800) 00010000:00010000:1.0:1746147147.554609:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147147.554611:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554615:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x31399394250571c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.554646:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56800/0x31399394250571bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.554656:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.554661:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147147.554663:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147147.554664:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57000, rc 0) 00000100:00100000:1.0:1746147147.554686:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:32518:x1830967308128896:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 12672us (13460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.554693:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15356 00000100:00100000:0.0:1746147147.565244:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308129152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21021us (21269us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147147.565259:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3673 00002000:00100000:0.0:1746147147.565271:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880094534700 x1830967308129152/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.565282:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094534700 with x1830967308129152 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.565288:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094534700 00000100:00100000:0.0:1746147147.569188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.569237:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308129664 00000100:00100000:1.0:1746147147.569248:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308129664 00000100:00100000:1.0:1746147147.569311:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14893 00000100:00100000:1.0:1746147147.569319:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967308129664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147147.569340:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.569361:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7864a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.569388:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.569390:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.569399:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.569415:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.569431:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80c00, rc 0) 00000100:00100000:1.0:1746147147.569490:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967308129664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 171us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.569496:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14893 00000100:00100000:0.0:1746147147.574278:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.574306:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.574388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.574429:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308129792 00000100:00100000:3.0:1746147147.574433:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308129408:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20993us (21213us total) trans 0 rc 2035712/2035712 00000100:00100000:0.0:1746147147.574436:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308129792 00000100:00100000:3.0:1746147147.574445:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3674 00002000:00100000:3.0:1746147147.574459:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2158592->4194303) req@ffff8800909f9c00 x1830967308129408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 2035712/2035712 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.574468:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9c00 with x1830967308129408 ext(2158592->4194303) 00000100:00100000:0.0:1746147147.574472:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308129920 00002000:00010000:3.0:1746147147.574474:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9c00 00000100:00100000:0.0:1746147147.574474:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308129920 00000100:00100000:0.0:1746147147.574485:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308130048 00000100:00100000:0.0:1746147147.574486:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308130048 00000100:00100000:0.0:1746147147.574498:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14894 00000100:00100000:0.0:1746147147.574506:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+14:32517:x1830967308129792:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147147.574510:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14895 00000100:00100000:1.0:1746147147.574516:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308129920:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147147.574522:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.574522:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.574541:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x31399394250571e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78658 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.574541:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78651 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.574594:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310733440:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147147.574651:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.575012:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14896 00000100:00100000:3.0:1746147147.575021:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308130048:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.575029:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.575037:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092562800/0x31399394250571ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7865f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.575060:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310733568:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.575127:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147147.575344:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.575353:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147147.575354:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147147.575358:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.577775:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.577795:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 32 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.577811:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310733696:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.577890:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147147.577931:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310733440:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147147.577961:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x31399394250571e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78658 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.577975:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81400/0x31399394250571e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78658 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.577990:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:1.0:1746147147.578018:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308129920:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3501us (3709us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147147.578026:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14895 00000100:00100000:2.0:1746147147.578330:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310733568:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147147.578348:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092562800/0x31399394250571ec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7865f expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.578366:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092562800/0x31399394250571ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7865f expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.578387:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562800, rc 0) 00000100:00100000:2.0:1746147147.578410:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308130048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3391us (4021us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.578415:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14896 00000100:00100000:0.0:1746147147.582936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.582982:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.583049:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308130304 00000100:00100000:1.0:1746147147.583057:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308130304 00000100:00100000:1.0:1746147147.583145:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15357 00000100:00100000:1.0:1746147147.583154:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+23:32518:x1830967308130304:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147147.583174:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.583195:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x31399394250571f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78666 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.583234:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310733696:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.583261:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.583276:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8c00, rc 0) 00010000:00010000:1.0:1746147147.583300:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.583315:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.583320:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+15:32517:x1830967308129792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8814us (9053us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147147.583323:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147147.583328:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14894 00010000:00010000:1.0:1746147147.583353:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.583364:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 24 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.583378:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310733824:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147147.583429:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.583744:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308130432 00000100:00100000:3.0:1746147147.583748:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308130432 00002000:00100000:3.0:1746147147.583776:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1273856->2097151) req@ffff880099888700 x1830967308130432/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.583786:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888700 with x1830967308130432 ext(1273856->2097151) 00010000:00010000:3.0:1746147147.583793:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 33 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.583802:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 33 pid: 1398 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746147147.583814:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099888700 00000100:00100000:3.0:1746147147.583911:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1155 00000100:00100000:3.0:1746147147.583917:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308130432:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147147.585393:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310733824:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.585417:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147147.585795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.586117:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308130560 00000100:00100000:2.0:1746147147.586124:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308130560 00000100:00100000:0.0:1746147147.586199:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.586355:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308130688 00000100:00100000:3.0:1746147147.586359:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308130688 00000100:00100000:3.0:1746147147.586396:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14897 00000100:00100000:3.0:1746147147.586403:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308130688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.586419:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.586437:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x3139939425057201 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7866d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.586467:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.586488:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310733952:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147147.586516:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6581 00000100:00100000:2.0:1746147147.586522:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2001:x1830967308130560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.586532:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.586538:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.586547:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.586565:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00010000:00010000:2.0:1746147147.586566:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x31399394250571d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78643 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.586580:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.586586:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.586597:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.586603:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.587927:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.587974:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2001:x1830967308130560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1447us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.587983:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6581 00010000:00010000:1.0:1746147147.588042:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.588051:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147147.588071:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147147.588266:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80e00/0x31399394250571f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.588293:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.588300:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147147.588303:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147147.588305:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:1.0:1746147147.588328:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32518:x1830967308130304:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5176us (5346us total) trans 8589936070 rc 0/0 00000100:00100000:1.0:1746147147.588334:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15357 00000100:00100000:1.0:1746147147.596549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.596579:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308130816 00000100:00100000:1.0:1746147147.596587:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308130816 00000100:00100000:3.0:1746147147.596675:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310733952:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.596711:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x3139939425057201 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7866d expref: 36 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.596725:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563a00/0x3139939425057201 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7866d expref: 36 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.596740:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563a00, rc 0) 00000100:00100000:3.0:1746147147.596785:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308130688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10383us (10586us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.596794:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14897 00000100:00100000:1.0:1746147147.597944:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15358 00000100:00100000:1.0:1746147147.597952:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32518:x1830967308130816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147147.597971:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.597992:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505720f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78674 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.598071:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.598108:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.598115:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.598143:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.598153:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.598165:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310734080:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147147.598226:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.601201:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967308130432:12345-192.168.204.25@tcp:4:cat.0 Request processed in 17269us (18263us total) trans 17179874254 rc 0/0 00000100:00100000:2.0:1746147147.601216:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1155 00002000:00100000:2.0:1746147147.601229:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1273856->2097151) req@ffff880099888700 x1830967308130432/t17179874254(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.601240:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888700 with x1830967308130432 ext(1273856->2097151) 00010000:00010000:2.0:1746147147.601251:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 35 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.601265:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 35 pid: 1398 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746147147.601272:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099888700 00000100:00100000:0.0:1746147147.602386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.602432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.602521:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131200 00000100:00100000:3.0:1746147147.602535:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131200 00000100:00100000:2.0:1746147147.602556:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131072 00000100:00100000:2.0:1746147147.602560:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131072 00010000:00010000:3.0:1746147147.602569:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 26 pid: 7238 timeout: 785 lvb_type: 0 00002000:00100000:2.0:1746147147.602589:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009988a680 x1830967308131072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147147.602596:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6582 00002000:00100000:2.0:1746147147.602598:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988a680 with x1830967308131072 ext(4194304->4919295) 00002000:00010000:2.0:1746147147.602602:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988a680 00000100:00100000:3.0:1746147147.602603:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2002:x1830967308131200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147147.602613:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3675 00010000:00010000:3.0:1746147147.602618:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147147.602618:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308131072:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147147.602623:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 26 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.602633:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 26 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.602655:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.602660:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.602670:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.602679:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147147.602695:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147147.602725:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2002:x1830967308131200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.602730:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6582 00010000:00010000:1.0:1746147147.603058:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x31399394250571fa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78666 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.603076:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310734080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.603110:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.603117:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.603122:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147147.603171:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147147.603176:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147147.603193:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147147.603222:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505720f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.603234:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.603240:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147147.603242:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147147.603244:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56600, rc 0) 00000100:00100000:1.0:1746147147.603272:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32518:x1830967308130816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5320us (6736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.603278:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15358 00000100:00100000:3.0:1746147147.605706:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.605756:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131328 00000100:00100000:0.0:1746147147.605766:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131328 00000100:00100000:0.0:1746147147.605826:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14898 00000100:00100000:0.0:1746147147.605835:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:32512:x1830967308131328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147147.605864:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.605884:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7867b expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.605917:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.605925:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147147.605933:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 27 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147147.605940:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 18 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.605945:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147147.605947:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147147.605950:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 7/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2531328->3145727] (req 2531328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.605982:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 18 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.605992:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.606004:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734208:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147147.606120:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 27 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147147.606130:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 27 pid: 17600 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746147147.606138:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734336:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147147.606179:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 9 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147147.606186:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 9 pid: 12201 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746147147.606194:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734464:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147147.606219:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.606227:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 18 pid: 1136 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.606234:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734592:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147147.606250:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.609303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.609757:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.610070:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131456 00000100:00100000:2.0:1746147147.610081:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131456 00010000:00010000:2.0:1746147147.610155:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.610237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.610365:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131712 00000100:00100000:1.0:1746147147.610369:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131712 00000100:00100000:1.0:1746147147.610392:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131584 00000100:00100000:1.0:1746147147.610394:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131584 00000100:00100000:1.0:1746147147.610410:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14899 00000100:00100000:1.0:1746147147.610417:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308131712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147147.610435:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.610451:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425057224 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78689 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.610506:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310734720:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.610608:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14900 00000100:00100000:3.0:1746147147.610617:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308131584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.610623:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.610631:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505722b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78682 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.610655:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310734848:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147147.611057:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6583 00000100:00100000:2.0:1746147147.611064:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308131456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.611074:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.611120:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.611133:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.611153:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.611155:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.611162:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.611170:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.611199:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.611208:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310734976:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147147.611404:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.611602:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.612084:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.612415:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308131072:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9793us (10030us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147147.612428:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3675 00002000:00100000:0.0:1746147147.612438:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009988a680 x1830967308131072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.612447:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988a680 with x1830967308131072 ext(4194304->4919295) 00002000:00010000:0.0:1746147147.612450:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988a680 00000100:00100000:0.0:1746147147.613214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.613245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.613286:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.613342:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131968 00000100:00100000:1.0:1746147147.613349:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131968 00010000:00010000:1.0:1746147147.613377:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746147147.613401:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308131840 00000100:00100000:1.0:1746147147.613403:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308131840 00010000:00010000:1.0:1746147147.613413:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 19 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.613427:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308132096 00000100:00100000:1.0:1746147147.613429:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308132096 00010000:00010000:1.0:1746147147.613439:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 28 pid: 17600 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746147147.613451:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6584 00000100:00100000:1.0:1746147147.613457:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308131968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.613469:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.613488:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.613499:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 10 pid: 12201 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.613519:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.613549:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308131968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.613555:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6584 00000100:00100000:2.0:1746147147.613559:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734208:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.613569:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734336:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147147.613573:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6585 00010000:00010000:2.0:1746147147.613579:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425056fd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78539 expref: 9 pid: 12201 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746147147.613579:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308131840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.613586:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.613593:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 19 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.613596:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734464:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.613601:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 19 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.613603:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310734592:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147147.613613:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81600/0x3139939425056f53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784c2 expref: 19 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746147147.613626:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147147.613635:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2531328->3145727] (req 2531328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147147.613642:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308131840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (396us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147147.613645:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226200, rc 0) 00000100:00100000:1.0:1746147147.613647:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6585 00000100:00100000:1.0:1746147147.613656:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6586 00000100:00100000:1.0:1746147147.613661:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308132096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147147.613665:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+17:32512:x1830967308131328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7832us (7970us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147147.613668:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147147.613671:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14898 00010000:00010000:1.0:1746147147.613674:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 28 pid: 17600 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.613682:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 28 pid: 17600 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.613693:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425056f6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784de expref: 28 pid: 17600 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.613709:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.613724:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308132096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.613729:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6586 00000100:00100000:1.0:1746147147.614575:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310734720:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147147.614595:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425057224 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78689 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.614605:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425057224 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78689 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.614612:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56a00, rc 0) 00000100:00100000:1.0:1746147147.614648:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308131712:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4231us (4892us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147147.614654:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14899 00000100:00100000:2.0:1746147147.616679:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310734976:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.616699:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147147.616744:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.616781:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308131456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5717us (7488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.616791:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6583 00000100:00100000:1.0:1746147147.616808:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308132352 00000100:00100000:1.0:1746147147.616814:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308132352 00002000:00100000:1.0:1746147147.616862:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801305f2680 x1830967308132352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.616871:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2680 with x1830967308132352 ext(1048576->2097151) 00002000:00010000:1.0:1746147147.616876:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f2680 00000100:00100000:1.0:1746147147.616893:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3676 00000100:00100000:1.0:1746147147.617016:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308132352:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147147.619554:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.619586:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.619609:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308132608 00000100:00100000:2.0:1746147147.619622:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308132608 00000100:00100000:2.0:1746147147.619659:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308132480 00000100:00100000:2.0:1746147147.619661:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308132480 00000100:00100000:2.0:1746147147.619684:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14901 00000100:00100000:2.0:1746147147.619691:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308132608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.619709:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.619729:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4000/0x3139939425057232 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78697 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.619751:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.619764:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4000/0x3139939425057232 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78697 expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.619774:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c4000/0x3139939425057232 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78697 expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.619787:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4000, rc 0) 00000100:00100000:2.0:1746147147.619822:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308132608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 131us (276us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.619828:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14901 00000100:00100000:2.0:1746147147.619856:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14902 00000100:00100000:2.0:1746147147.619861:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308132480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.619872:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.619882:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78690 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.619892:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.619894:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.619901:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 36 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.619914:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 36 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.619923:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c5400, rc 0) 00000100:00100000:2.0:1746147147.619938:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308132480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.619943:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14902 00000100:00100000:2.0:1746147147.619982:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.620002:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308132736 00000100:00100000:2.0:1746147147.620005:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308132736 00010000:00010000:2.0:1746147147.620020:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 17 pid: 1136 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.620038:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6587 00000100:00100000:2.0:1746147147.620043:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308132736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.620052:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.620071:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 17 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.620085:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 17 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.620121:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425056f61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e784d0 expref: 17 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.620130:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.620132:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.620137:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 16 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.620143:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 16 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.620170:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 16 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.620182:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310735104:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.620237:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00010000:00010000:3.0:1746147147.620663:0:1136:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880097097800 x1830967310734848) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 35 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.620681:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563000/0x313993942505713d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785f6 expref: 35 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.620695:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310734848:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.620716:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505722b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78682 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.620724:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505722b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78682 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.620730:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562e00, rc 0) 00000100:00100000:3.0:1746147147.620749:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308131584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10134us (10512us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.620754:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14900 00000100:00100000:2.0:1746147147.625216:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.625266:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.625291:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308133376 00000100:00100000:2.0:1746147147.625299:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308133376 00002000:00100000:2.0:1746147147.625342:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2531328->2535423) req@ffff880099889500 x1830967308133376/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.625352:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889500 with x1830967308133376 ext(2531328->2535423) 00002000:00010000:2.0:1746147147.625359:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099889500 00000100:00100000:2.0:1746147147.625398:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3677 00000100:00100000:2.0:1746147147.625407:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308133376:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147147.625551:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308133376:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 144us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147147.625558:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3677 00002000:00100000:2.0:1746147147.625563:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2531328->2535423) req@ffff880099889500 x1830967308133376/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.625570:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889500 with x1830967308133376 ext(2531328->2535423) 00002000:00010000:2.0:1746147147.625573:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099889500 00000100:00100000:3.0:1746147147.625695:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.625715:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308133120 00000100:00100000:3.0:1746147147.625718:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308133120 00000100:00100000:3.0:1746147147.625743:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14903 00000100:00100000:3.0:1746147147.625748:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308133120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.625759:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.625777:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425057240 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786a5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.625827:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310735232:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.625909:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.625969:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308132992 00000100:00100000:3.0:1746147147.625972:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308132992 00000100:00100000:3.0:1746147147.626004:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15359 00000100:00100000:3.0:1746147147.626010:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32518:x1830967308132992:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147147.626020:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.626033:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562800/0x3139939425057247 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7869e expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.626145:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626161:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626172:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626184:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626194:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626200:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626207:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147147.626210:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626216:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626226:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.626229:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147147.626232:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626237:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563c00/0x313993942505724e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.626261:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562800/0x3139939425057247 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7869e expref: 25 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.626269:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562800/0x3139939425057247 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7869e expref: 25 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.626276:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562800, rc 0) 00000100:00100000:3.0:1746147147.626297:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32518:x1830967308132992:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 287us (603us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.626303:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15359 00000100:00100000:0.0:1746147147.626789:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310735104:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147147.626804:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147147.626827:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308132736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6783us (6845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.626835:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6587 00000100:00100000:1.0:1746147147.627118:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+15:2003:x1830967308132352:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10188us (10344us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147147.627125:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3676 00002000:00100000:1.0:1746147147.627133:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801305f2680 x1830967308132352/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.627142:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f2680 with x1830967308132352 ext(1048576->2097151) 00002000:00010000:1.0:1746147147.627146:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305f2680 00000100:00100000:3.0:1746147147.630611:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.630662:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308133632 00000100:00100000:0.0:1746147147.630671:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308133632 00000100:00100000:3.0:1746147147.630760:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5526 00000100:00100000:3.0:1746147147.630769:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32518:x1830967308133632:12345-192.168.204.25@tcp:35:lfs.0 00002000:00010000:2.0:1746147147.630772:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147146 -> 1746147147 00002000:00010000:2.0:1746147147.630776:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147145 -> 1746147147 00002000:00010000:2.0:1746147147.630778:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147146 -> 1746147147 00000100:00100000:2.0:1746147147.630799:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310735232:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147147.630833:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425057240 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786a5 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.630856:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425057240 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786a5 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.630874:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563600, rc 0) 00000100:00100000:2.0:1746147147.630917:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308133120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5168us (5713us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.630924:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14903 00000100:00100000:3.0:1746147147.630949:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:32518:x1830967308133632:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 181us (346us total) trans 8589936071 rc 0/0 00000100:00100000:3.0:1746147147.630955:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5526 00000100:00100000:0.0:1746147147.637993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.638037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.638081:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.638164:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308133760 00000100:00100000:2.0:1746147147.638175:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308133760 00000100:00100000:2.0:1746147147.638234:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308134144 00000100:00100000:2.0:1746147147.638237:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308134144 00000100:00100000:2.0:1746147147.638256:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14904 00000100:00100000:2.0:1746147147.638265:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+16:32512:x1830967308133760:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147147.638285:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.638305:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786ac expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638338:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638346:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147147.638348:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147147.638352:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638383:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638396:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 34 pid: 1136 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.638408:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310735360:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.638488:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.638509:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14905 00000100:00100000:2.0:1746147147.638515:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:32517:x1830967308134144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.638524:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.638530:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786b3 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638540:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147147.638542:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147147.638545:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638554:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.638563:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4600, rc 0) 00000100:00100000:2.0:1746147147.638586:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:32517:x1830967308134144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 71us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.638593:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14905 00000100:00100000:3.0:1746147147.638662:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308134016 00000100:00100000:3.0:1746147147.638666:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308134016 00000100:00100000:3.0:1746147147.638698:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5527 00000100:00100000:3.0:1746147147.638703:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+60:32513:x1830967308134016:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147147.638869:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+61:32513:x1830967308134016:12345-192.168.204.25@tcp:35:cat.0 Request processed in 166us (831us total) trans 8589936072 rc 0/0 00000100:00100000:3.0:1746147147.638875:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5527 00000100:00100000:3.0:1746147147.640377:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310735360:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.640408:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.640424:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3ec00, rc 0) 00000100:00100000:3.0:1746147147.640468:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:32512:x1830967308133760:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2203us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.640475:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14904 00000100:00100000:0.0:1746147147.642443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.642792:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308134272 00000100:00100000:2.0:1746147147.642801:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308134272 00002000:00100000:2.0:1746147147.642860:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2158591) req@ffff88009f087100 x1830967308134272/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.642871:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087100 with x1830967308134272 ext(2097152->2158591) 00010000:00010000:2.0:1746147147.642881:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 35 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.642895:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 35 pid: 1136 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746147147.642908:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f087100 00000100:00100000:1.0:1746147147.643546:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1156 00000100:00100000:1.0:1746147147.643557:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308134272:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:1.0:1746147147.646896:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147147.647273:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967308134272:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3708us (4834us total) trans 17179874255 rc 0/0 00000100:00100000:0.0:1746147147.647287:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1156 00002000:00100000:0.0:1746147147.647299:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2158591) req@ffff88009f087100 x1830967308134272/t17179874255(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.647314:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087100 with x1830967308134272 ext(2097152->2158591) 00010000:00010000:0.0:1746147147.647325:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 37 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.647340:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 37 pid: 1136 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746147147.647347:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f087100 00000100:00100000:0.0:1746147147.651985:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.652062:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308134400 00000100:00100000:2.0:1746147147.652073:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308134400 00010000:00010000:2.0:1746147147.652157:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 37 pid: 1136 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.652187:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6588 00000100:00100000:2.0:1746147147.652195:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308134400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.652209:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.652231:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 37 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.652243:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 37 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.652267:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x3139939425057159 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7860b expref: 37 pid: 1136 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.652301:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.652303:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.652310:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.652318:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.652331:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.652333:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.652336:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.652342:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.652373:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.652386:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310735488:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.652723:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.652732:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310735616:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.652755:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.656151:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310735488:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.656165:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310735616:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.656189:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.656233:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967308134400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4037us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.656245:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6588 00000100:00100000:0.0:1746147147.656774:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.656837:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308134656 00000100:00100000:1.0:1746147147.656852:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308134656 00002000:00100000:1.0:1746147147.657049:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3334144->3338239) req@ffff88009f086a00 x1830967308134656/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.657059:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086a00 with x1830967308134656 ext(3334144->3338239) 00002000:00010000:1.0:1746147147.657064:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f086a00 00000100:00100000:1.0:1746147147.657371:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3678 00000100:00100000:1.0:1746147147.657381:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308134656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.657510:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308134656:12345-192.168.204.25@tcp:3:cat.0 Request processed in 130us (737us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147147.657516:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3678 00002000:00100000:1.0:1746147147.657521:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3334144->3338239) req@ffff88009f086a00 x1830967308134656/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.657533:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f086a00 with x1830967308134656 ext(3334144->3338239) 00002000:00010000:1.0:1746147147.657536:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f086a00 00000100:00100000:0.0:1746147147.658425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.658575:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.658641:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308135040 00000100:00100000:1.0:1746147147.658647:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308135040 00002000:00100000:1.0:1746147147.658672:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009f084a80 x1830967308135040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.658681:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084a80 with x1830967308135040 ext(2097152->3145727) 00002000:00010000:1.0:1746147147.658685:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084a80 00000100:00100000:1.0:1746147147.658714:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308135168 00000100:00100000:1.0:1746147147.658717:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308135168 00002000:00100000:1.0:1746147147.658730:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2531327) req@ffff88009f085f80 x1830967308135168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.658738:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085f80 with x1830967308135168 ext(2097152->2531327) 00002000:00010000:1.0:1746147147.658742:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f085f80 00000100:00100000:1.0:1746147147.658751:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3679 00000100:00100000:3.0:1746147147.658763:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3680 00000100:00100000:3.0:1746147147.658773:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967308135168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.658898:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308135040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.662751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.663405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.663489:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308135680 00000100:00100000:2.0:1746147147.663500:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308135680 00000100:00100000:3.0:1746147147.664080:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308135424 00000100:00100000:3.0:1746147147.664085:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308135424 00000100:00100000:3.0:1746147147.664129:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5528 00000100:00100000:3.0:1746147147.664139:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+37:32512:x1830967308135424:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147147.664438:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15360 00000100:00100000:2.0:1746147147.664445:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+61:32523:x1830967308135680:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147147.664458:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.664477:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093708400/0x3139939425057263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786ba expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.664535:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.664549:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.664559:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.664571:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.664577:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.664582:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147147.665316:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+38:32512:x1830967308135424:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1177us (2574us total) trans 8589936073 rc 0/0 00000100:00100000:3.0:1746147147.665325:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5528 00010000:00010000:2.0:1746147147.665453:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665466:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665473:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147147.665485:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147147.665534:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665540:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665546:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665551:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665556:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093709a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.665756:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665763:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665774:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147147.665777:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147147.665780:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665785:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709a00/0x313993942505726a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665801:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665806:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665815:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665819:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093708200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147147.665820:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665825:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665830:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096e23100) 00010000:00010000:2.0:1746147147.665832:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147147.665834:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665839:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x3139939425057271 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.665896:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708400/0x3139939425057263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 64 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.665909:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 63 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.665915:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.665917:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147147.665919:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709200, rc 0) 00000100:00100000:2.0:1746147147.665955:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+63:32523:x1830967308135680:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1511us (2551us total) trans 8589936074 rc 0/0 00000100:00100000:2.0:1746147147.665961:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15360 00000100:00100000:3.0:1746147147.666071:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967308135168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7300us (7496us total) trans 0 rc 434176/434176 00000100:00100000:3.0:1746147147.666080:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3680 00002000:00100000:3.0:1746147147.666105:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2531327) req@ffff88009f085f80 x1830967308135168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 434176/434176 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.666114:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085f80 with x1830967308135168 ext(2097152->2531327) 00002000:00010000:3.0:1746147147.666118:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f085f80 00000100:00100000:0.0:1746147147.666124:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308135040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7365us (7699us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147147.666132:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3679 00002000:00100000:0.0:1746147147.666137:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009f084a80 x1830967308135040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.666145:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084a80 with x1830967308135040 ext(2097152->3145727) 00002000:00010000:0.0:1746147147.666149:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084a80 00000100:00100000:0.0:1746147147.677996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.678055:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.678123:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308135936 00000100:00100000:3.0:1746147147.678133:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308135936 00002000:00100000:3.0:1746147147.678182:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3338240->4194303) req@ffff880091d94700 x1830967308135936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.678192:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967308135936 ext(3338240->4194303) 00002000:00010000:3.0:1746147147.678198:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94700 00000100:00100000:3.0:1746147147.678217:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308136192 00000100:00100000:3.0:1746147147.678219:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308136192 00002000:00100000:3.0:1746147147.678232:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880091d96d80 x1830967308136192/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147147.678232:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3681 00002000:00100000:3.0:1746147147.678239:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96d80 with x1830967308136192 ext(3145728->4194303) 00002000:00010000:3.0:1746147147.678242:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d96d80 00000100:00100000:2.0:1746147147.678243:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308135936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147147.678270:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3682 00000100:00100000:3.0:1746147147.678275:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308136192:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.688544:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308135936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10290us (10546us total) trans 0 rc 856064/856064 00000100:00100000:2.0:1746147147.688558:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3681 00002000:00100000:2.0:1746147147.688570:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3338240->4194303) req@ffff880091d94700 x1830967308135936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 856064/856064 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.688579:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967308135936 ext(3338240->4194303) 00002000:00010000:2.0:1746147147.688585:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94700 00000100:00100000:3.0:1746147147.689980:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308136192:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11699us (11919us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147147.689988:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3682 00002000:00100000:3.0:1746147147.689994:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff880091d96d80 x1830967308136192/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.690002:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96d80 with x1830967308136192 ext(3145728->4194303) 00002000:00010000:3.0:1746147147.690006:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d96d80 00000100:00100000:0.0:1746147147.701212:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.701305:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308136320 00000100:00100000:3.0:1746147147.701314:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308136320 00000100:00100000:3.0:1746147147.701406:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14906 00000100:00100000:3.0:1746147147.701414:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308136320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.701433:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.701451:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425057286 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786c1 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.701507:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310735744:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.701603:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.705305:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310735744:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.705344:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425057286 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786c1 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.705358:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33000/0x3139939425057286 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786c1 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.705380:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:3.0:1746147147.705431:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308136320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4016us (4227us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.705440:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14906 00000100:00100000:0.0:1746147147.714211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.714364:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308136576 00000100:00100000:3.0:1746147147.714374:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308136576 00002000:00100000:3.0:1746147147.714422:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a4395f80 x1830967308136576/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.714431:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395f80 with x1830967308136576 ext(4194304->4919295) 00002000:00010000:3.0:1746147147.714437:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4395f80 00000100:00100000:3.0:1746147147.715085:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3683 00000100:00100000:3.0:1746147147.715113:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308136576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147147.723577:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308136576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8453us (9365us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147147.723589:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3683 00002000:00100000:3.0:1746147147.723600:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a4395f80 x1830967308136576/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.723610:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395f80 with x1830967308136576 ext(4194304->4919295) 00002000:00010000:3.0:1746147147.723616:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4395f80 00000100:00100000:0.0:1746147147.727029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.727205:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308136704 00000100:00100000:3.0:1746147147.727216:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308136704 00000100:00100000:3.0:1746147147.727295:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14907 00000100:00100000:3.0:1746147147.727306:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308136704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.727332:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.727352:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x313993942505728d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786c8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.727414:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310735872:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.727557:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.730062:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310735872:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.730130:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x313993942505728d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786c8 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.730145:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6a00/0x313993942505728d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786c8 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.730158:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6a00, rc 0) 00000100:00100000:3.0:1746147147.730612:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308136704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3306us (3594us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.730620:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14907 00000100:00100000:2.0:1746147147.736829:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.736904:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308136832 00000100:00100000:3.0:1746147147.736915:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308136832 00000100:00100000:3.0:1746147147.740264:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14908 00000100:00100000:3.0:1746147147.740287:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308136832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.740310:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.740332:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425057294 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786cf expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.740689:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736000:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.741570:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.742183:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736000:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.742211:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425057294 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786cf expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.742224:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425057294 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786cf expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.742779:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6400, rc 0) 00000100:00100000:3.0:1746147147.742822:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308136832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2545us (6002us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.742830:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14908 00000100:00100000:0.0:1746147147.744736:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.744793:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308136960 00000100:00100000:3.0:1746147147.744802:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308136960 00000100:00100000:3.0:1746147147.744861:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14909 00000100:00100000:3.0:1746147147.744869:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32523:x1830967308136960:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147147.744886:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.744903:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786d6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.744933:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.744942:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.744953:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.744960:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.744961:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147147.744965:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [327680->983039] (req 327680->983039) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.744992:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.745003:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 16 pid: 12225 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.745013:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736128:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.745130:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.745138:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 8 pid: 12225 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746147147.745146:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736256:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.745183:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.745195:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.745202:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736384:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.745219:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.747260:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736128:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.747270:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.747278:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310736384:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.747308:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [327680->983039] (req 327680->983039) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.747326:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a7c00, rc 0) 00000100:00100000:3.0:1746147147.747363:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32523:x1830967308136960:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2493us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.747372:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14909 00000100:00100000:0.0:1746147147.748452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.748501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.748570:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308137088 00000100:00100000:1.0:1746147147.748577:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308137088 00010000:00010000:1.0:1746147147.748608:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 9 pid: 12225 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746147147.748628:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308137216 00000100:00100000:1.0:1746147147.748630:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308137216 00010000:00010000:1.0:1746147147.748639:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 17 pid: 12225 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746147147.748656:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6589 00000100:00100000:1.0:1746147147.748662:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308137088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.748674:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.748693:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 9 pid: 12225 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.748702:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 9 pid: 12225 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.748723:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x31399394250570fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785cc expref: 9 pid: 12225 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.748746:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.748773:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308137088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.748778:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6589 00000100:00100000:1.0:1746147147.748790:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6590 00000100:00100000:1.0:1746147147.748794:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308137216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147147.748801:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147147.748806:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 17 pid: 12225 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.748814:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 17 pid: 12225 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.748829:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeea00/0x31399394250570a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e785a2 expref: 17 pid: 12225 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746147147.748837:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147147.748861:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:2003:x1830967308137216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.748866:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6590 00000100:00100000:0.0:1746147147.752084:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.752585:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308137344 00000100:00100000:2.0:1746147147.752596:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308137344 00010000:00010000:2.0:1746147147.752633:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.752664:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6591 00000100:00100000:2.0:1746147147.752673:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308137344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.752689:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.752712:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.752724:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.752747:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80200/0x313993942505706b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78578 expref: 37 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.752771:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.752774:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.752782:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.752790:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.752823:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.752835:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310736512:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.753268:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.754595:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310736512:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.754614:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.754938:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308137344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2264us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.754949:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6591 00000100:00100000:0.0:1746147147.756321:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.756416:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308137600 00000100:00100000:3.0:1746147147.756424:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308137600 00002000:00100000:3.0:1746147147.756467:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (327680->331775) req@ffff8800a4394380 x1830967308137600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.756478:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394380 with x1830967308137600 ext(327680->331775) 00002000:00010000:3.0:1746147147.756483:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394380 00000100:00100000:3.0:1746147147.756615:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3684 00000100:00100000:3.0:1746147147.756623:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308137600:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147147.756976:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308137600:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 352us (656us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147147.756982:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3684 00002000:00100000:3.0:1746147147.756988:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (327680->331775) req@ffff8800a4394380 x1830967308137600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.756995:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394380 with x1830967308137600 ext(327680->331775) 00002000:00010000:3.0:1746147147.756998:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394380 00000100:00100000:0.0:1746147147.764975:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.765654:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308137856 00000100:00100000:3.0:1746147147.765665:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308137856 00002000:00100000:3.0:1746147147.765714:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (978944->983039) req@ffff8800a4397100 x1830967308137856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.765724:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4397100 with x1830967308137856 ext(978944->983039) 00002000:00010000:3.0:1746147147.765729:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4397100 00000100:00100000:3.0:1746147147.765756:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3685 00000100:00100000:3.0:1746147147.765763:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308137856:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147147.765913:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308137856:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 149us (950us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147147.765918:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3685 00002000:00100000:3.0:1746147147.765923:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8c:0x0] (978944->983039) req@ffff8800a4397100 x1830967308137856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.765929:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4397100 with x1830967308137856 ext(978944->983039) 00002000:00010000:3.0:1746147147.765932:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4397100 00000100:00100000:0.0:1746147147.767784:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.768968:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308138112 00000100:00100000:2.0:1746147147.768979:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308138112 00000100:00100000:2.0:1746147147.769531:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15361 00000100:00100000:2.0:1746147147.769541:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+63:32528:x1830967308138112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.769567:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.769588:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38fe00/0x31399394250572a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786dd expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.769703:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.769719:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147147.769731:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147147.769740:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147147.769852:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38fe00/0x31399394250572a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 66 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.769883:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 65 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.769891:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147147.769894:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746147147.769897:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38f600, rc 0) 00000100:00100000:2.0:1746147147.769955:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+65:32528:x1830967308138112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 416us (2180us total) trans 8589936075 rc 0/0 00000100:00100000:2.0:1746147147.769961:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15361 00000100:00100000:0.0:1746147147.770187:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.772204:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308138368 00000100:00100000:2.0:1746147147.772215:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308138368 00000100:00100000:2.0:1746147147.772263:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5529 00000100:00100000:2.0:1746147147.772271:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+65:32523:x1830967308138368:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147147.772473:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+66:32523:x1830967308138368:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 201us (2285us total) trans 8589936076 rc 0/0 00000100:00100000:2.0:1746147147.772483:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5529 00000100:00100000:1.0:1746147147.773624:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.773657:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.774123:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308138496 00000100:00100000:0.0:1746147147.774131:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308138496 00000100:00100000:0.0:1746147147.774165:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308138624 00000100:00100000:0.0:1746147147.774167:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308138624 00000100:00100000:0.0:1746147147.774194:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14910 00000100:00100000:0.0:1746147147.774201:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308138496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147147.774215:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.774236:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8200/0x31399394250572b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786e4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147147.774291:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310736640:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147147.774358:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.774497:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14911 00000100:00100000:3.0:1746147147.774505:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308138624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.774514:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.774526:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786eb expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.774556:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310736768:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.774604:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.776730:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310736640:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147147.776761:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8200/0x31399394250572b7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786e4 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.776775:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8200/0x31399394250572b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786e4 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.776785:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8200, rc 0) 00000100:00100000:2.0:1746147147.776823:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308138496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2623us (3201us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.776831:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14910 00000100:00100000:3.0:1746147147.777787:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310736768:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.777810:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572be lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786eb expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.777820:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786eb expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.778582:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a72000, rc 0) 00000100:00100000:3.0:1746147147.778624:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308138624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4118us (4964us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.778632:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14911 00000100:00100000:0.0:1746147147.786690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.786937:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308138880 00000100:00100000:2.0:1746147147.786947:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308138880 00002000:00100000:2.0:1746147147.786994:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4394000 x1830967308138880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 504/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.787005:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394000 with x1830967308138880 ext(0->1048575) 00002000:00010000:2.0:1746147147.787011:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394000 00000100:00100000:2.0:1746147147.789453:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3686 00000100:00100000:2.0:1746147147.789473:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967308138880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.790669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.790854:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308139136 00000100:00100000:0.0:1746147147.790862:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308139136 00002000:00100000:0.0:1746147147.790895:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880093145180 x1830967308139136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.790904:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145180 with x1830967308139136 ext(1048576->2097151) 00002000:00010000:0.0:1746147147.790910:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145180 00000100:00100000:0.0:1746147147.790937:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3687 00000100:00100000:0.0:1746147147.790942:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967308139136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.798514:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967308138880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9039us (11825us total) trans 0 rc 393216/393216 00000100:00100000:2.0:1746147147.798528:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3686 00002000:00100000:2.0:1746147147.798540:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4394000 x1830967308138880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 504/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 393216/393216 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.798551:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394000 with x1830967308138880 ext(0->1048575) 00002000:00010000:2.0:1746147147.798556:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394000 00000100:00100000:2.0:1746147147.805032:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308139136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14074us (14351us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147147.805045:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3687 00002000:00100000:2.0:1746147147.805060:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880093145180 x1830967308139136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.805070:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145180 with x1830967308139136 ext(1048576->2097151) 00002000:00010000:2.0:1746147147.805077:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145180 00000100:00100000:0.0:1746147147.811718:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.811773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.811984:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308139392 00000100:00100000:3.0:1746147147.811985:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308139264 00000100:00100000:3.0:1746147147.811994:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308139264 00000100:00100000:2.0:1746147147.811994:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308139392 00000100:00100000:3.0:1746147147.812611:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14912 00000100:00100000:3.0:1746147147.812624:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308139392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.812644:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147147.812651:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14913 00000100:00100000:2.0:1746147147.812658:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308139264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.812664:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250572c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786f9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.812666:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.812674:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f390000/0x31399394250572cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e786f2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.812721:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310736896:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147147.812721:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310737024:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147147.812890:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.812895:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.817813:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310736896:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.817858:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250572c5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786f9 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.817873:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250572c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786f9 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.817900:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73c00, rc 0) 00000100:00100000:3.0:1746147147.817948:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308139392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5328us (6173us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.817957:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14912 00000100:00100000:2.0:1746147147.818140:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310737024:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147147.818160:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f390000/0x31399394250572cc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786f2 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.818174:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f390000/0x31399394250572cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786f2 expref: 37 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147147.818192:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f390000, rc 0) 00000100:00100000:2.0:1746147147.818212:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308139264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5554us (6511us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147147.818218:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14913 00000100:00100000:0.0:1746147147.821209:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.821342:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308139520 00000100:00100000:2.0:1746147147.821352:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308139520 00000100:00100000:2.0:1746147147.821413:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14914 00000100:00100000:2.0:1746147147.821421:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32528:x1830967308139520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.821441:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.821461:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78700 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.821493:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.821495:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.821505:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.821519:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.821529:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f391600, rc 0) 00000100:00100000:2.0:1746147147.821586:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32528:x1830967308139520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 164us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.821592:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14914 00000100:00100000:0.0:1746147147.825197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.825319:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308139776 00000100:00100000:2.0:1746147147.825328:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308139776 00002000:00100000:2.0:1746147147.825372:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009cd44a80 x1830967308139776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.825383:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44a80 with x1830967308139776 ext(2097152->3145727) 00002000:00010000:2.0:1746147147.825389:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd44a80 00000100:00100000:2.0:1746147147.825420:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3688 00000100:00100000:2.0:1746147147.825427:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308139776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.836064:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308139776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10625us (10865us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147147.836077:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3688 00002000:00100000:2.0:1746147147.836109:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff88009cd44a80 x1830967308139776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.836120:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44a80 with x1830967308139776 ext(2097152->3145727) 00002000:00010000:2.0:1746147147.836125:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd44a80 00000100:00100000:0.0:1746147147.844003:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.844534:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308139904 00000100:00100000:3.0:1746147147.844544:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308139904 00000100:00100000:3.0:1746147147.844598:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14915 00000100:00100000:3.0:1746147147.844608:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32528:x1830967308139904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.844629:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.844647:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78707 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.844967:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.844979:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.844982:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.844986:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.845023:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.845036:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 15 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.845048:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310737152:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.845159:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.852702:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310737152:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.852740:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.852758:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a72000, rc 0) 00000100:00100000:3.0:1746147147.853080:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32528:x1830967308139904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8471us (9085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.853307:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14915 00000100:00100000:0.0:1746147147.853545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.854814:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308140032 00000100:00100000:2.0:1746147147.854824:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308140032 00002000:00100000:2.0:1746147147.854886:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2531328->3145727) req@ffff88009cd46d80 x1830967308140032/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.854894:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46d80 with x1830967308140032 ext(2531328->3145727) 00010000:00010000:2.0:1746147147.854904:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 16 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.854919:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 16 pid: 1398 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746147147.854926:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd46d80 00000100:00100000:2.0:1746147147.854961:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1157 00000100:00100000:2.0:1746147147.854968:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2001:x1830967308140032:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147147.866384:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308140032:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11400us (12823us total) trans 21474841523 rc 0/0 00000100:00100000:3.0:1746147147.866400:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1157 00002000:00100000:3.0:1746147147.866412:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2531328->3145727) req@ffff88009cd46d80 x1830967308140032/t21474841523(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.866422:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46d80 with x1830967308140032 ext(2531328->3145727) 00010000:00010000:3.0:1746147147.866434:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.866450:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746147147.866457:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd46d80 00000100:00100000:0.0:1746147147.883682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.883760:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308140160 00000100:00100000:2.0:1746147147.883771:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308140160 00010000:00010000:2.0:1746147147.883811:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.883860:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6592 00000100:00100000:2.0:1746147147.883872:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308140160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.883888:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.883908:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.883922:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.883945:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942505721d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7867b expref: 18 pid: 1398 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.883963:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.883965:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.883972:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.883980:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.884083:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.884130:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310737280:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.884222:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.888167:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310737280:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.888198:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.888259:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308140160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4387us (4586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.888271:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6592 00000100:00100000:0.0:1746147147.897979:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.898291:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308140416 00000100:00100000:3.0:1746147147.898301:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308140416 00002000:00100000:3.0:1746147147.898344:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88011db15500 x1830967308140416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147147.898354:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15500 with x1830967308140416 ext(2097152->3145727) 00002000:00010000:3.0:1746147147.898359:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15500 00000100:00100000:3.0:1746147147.898379:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3689 00000100:00100000:3.0:1746147147.898385:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308140416:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.908182:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308140416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9783us (10199us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147147.908195:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3689 00002000:00100000:2.0:1746147147.908208:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff88011db15500 x1830967308140416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.908219:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15500 with x1830967308140416 ext(2097152->3145727) 00002000:00010000:2.0:1746147147.908225:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15500 00000100:00100000:0.0:1746147147.911512:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.911584:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308140672 00000100:00100000:3.0:1746147147.911595:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308140672 00000100:00100000:3.0:1746147147.911661:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15362 00000100:00100000:3.0:1746147147.911671:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+38:32531:x1830967308140672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147147.911699:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.911722:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x31399394250572e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7870e expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.911848:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.911864:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.911873:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 65 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.911881:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.911986:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 65 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.912000:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 65 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.912014:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310737408:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.912156:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.912165:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 24 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.912172:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310737536:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.912201:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147147.915473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.915847:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308140800 00000100:00100000:3.0:1746147147.915856:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308140800 00000100:00100000:3.0:1746147147.916083:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14916 00000100:00100000:3.0:1746147147.916121:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32528:x1830967308140800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.916147:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.916169:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78715 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.916201:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.916209:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.916210:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147147.916214:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 38 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.916245:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.916257:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 15 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.916269:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310737664:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147147.916357:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147147.917721:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310737408:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.918527:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310737664:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147147.918557:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 38 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.918574:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33400, rc 0) 00000100:00100000:0.0:1746147147.918646:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.918648:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310737536:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147147.918669:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:2.0:1746147147.918684:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32528:x1830967308140800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2592us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.918694:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14916 00000100:00100000:3.0:1746147147.918704:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308140928 00000100:00100000:3.0:1746147147.918710:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308140928 00010000:00010000:3.0:1746147147.918737:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 66 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746147147.918737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.918751:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308141056 00000100:00100000:0.0:1746147147.918753:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308141056 00000100:00100000:3.0:1746147147.918762:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6593 00010000:00010000:0.0:1746147147.918766:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746147147.918768:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+66:2000:x1830967308140928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147147.918781:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147147.918781:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6594 00000100:00100000:0.0:1746147147.918785:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:2001:x1830967308141056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147147.918786:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 66 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.918790:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147147.918792:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.918795:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 66 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.918802:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.918824:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x3139939425057278 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ba expref: 66 pid: 7238 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.918829:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425057216 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78674 expref: 25 pid: 7238 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746147147.918869:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147147.918888:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.918893:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.918904:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.918910:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147147.918910:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308141184 00000100:00100000:1.0:1746147147.918914:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308141184 00010000:00010000:0.0:1746147147.918916:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147147.918919:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147147.918924:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147147.918937:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+65:2000:x1830967308140928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 169us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.918937:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:2001:x1830967308141056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 150us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147147.918942:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6593 00002000:00100000:1.0:1746147147.918945:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3338239) req@ffff880093144380 x1830967308141184/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147147.918945:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6594 00002000:00100000:1.0:1746147147.918954:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144380 with x1830967308141184 ext(3145728->3338239) 00010000:00010000:3.0:1746147147.918956:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147147.918961:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 16 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147147.918966:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147147.918973:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 16 pid: 1854 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746147147.918980:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093144380 00000004:00200000:3.0:1746147147.918982:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:1.0:1746147147.919003:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1158 00000100:00100000:1.0:1746147147.919009:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2002:x1830967308141184:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:3.0:1746147147.919144:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x31399394250572e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.919156:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 40 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.919162:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.919164:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147147.919166:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73400, rc 0) 00000100:00100000:3.0:1746147147.919200:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+40:32531:x1830967308140672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7531us (7698us total) trans 8589936077 rc 0/0 00000100:00100000:3.0:1746147147.919206:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15362 00000100:00100000:0.0:1746147147.923945:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308141184:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4922us (5062us total) trans 17179874256 rc 0/0 00000100:00100000:0.0:1746147147.923959:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1158 00002000:00100000:0.0:1746147147.923972:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3338239) req@ffff880093144380 x1830967308141184/t17179874256(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:523/0 lens 488/448 e 0 to 0 dl 1746147158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147147.923983:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144380 with x1830967308141184 ext(3145728->3338239) 00010000:00010000:0.0:1746147147.923995:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 18 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147147.924011:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 18 pid: 1854 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746147147.924019:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093144380 00000100:00100000:0.0:1746147147.930448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.930595:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308141312 00000100:00100000:2.0:1746147147.930606:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308141312 00010000:00010000:2.0:1746147147.930665:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 18 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.930712:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6595 00000100:00100000:2.0:1746147147.930720:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308141312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147147.930735:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147147.930754:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 18 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.930766:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 18 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.930792:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x3139939425057255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786ac expref: 18 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746147147.930818:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.930820:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147147.930828:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.930849:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.930891:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147147.930904:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310737792:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147147.931008:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147147.936408:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310737792:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147147.936437:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147147.936484:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308141312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5763us (6046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147147.936495:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6595 00000100:00100000:0.0:1746147147.947404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.947471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.947561:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308141568 00000100:00100000:2.0:1746147147.947571:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308141568 00002000:00100000:2.0:1746147147.947618:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011db16680 x1830967308141568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.947627:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16680 with x1830967308141568 ext(3145728->4194303) 00002000:00010000:2.0:1746147147.947633:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db16680 00000100:00100000:2.0:1746147147.947664:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308141824 00000100:00100000:2.0:1746147147.947667:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308141824 00002000:00100000:2.0:1746147147.947680:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88011db15f80 x1830967308141824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.947686:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15f80 with x1830967308141824 ext(3145728->4194303) 00002000:00010000:2.0:1746147147.947690:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15f80 00000100:00100000:1.0:1746147147.948216:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3690 00000100:00100000:1.0:1746147147.948227:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967308141568:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147147.948449:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3691 00000100:00100000:2.0:1746147147.948457:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308141824:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147147.960602:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967308141568:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12365us (13196us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147147.960615:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3690 00002000:00100000:1.0:1746147147.960628:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011db16680 x1830967308141568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147147.960637:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16680 with x1830967308141568 ext(3145728->4194303) 00002000:00010000:1.0:1746147147.960643:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db16680 00000100:00100000:2.0:1746147147.963974:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308141824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15505us (16489us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147147.963987:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3691 00002000:00100000:2.0:1746147147.963999:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88011db15f80 x1830967308141824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.964008:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15f80 with x1830967308141824 ext(3145728->4194303) 00002000:00010000:2.0:1746147147.964014:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15f80 00000100:00100000:0.0:1746147147.981243:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147147.981304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.981387:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308141952 00000100:00100000:3.0:1746147147.981401:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308141952 00000100:00100000:3.0:1746147147.981476:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308142080 00000100:00100000:3.0:1746147147.981478:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308142080 00000100:00100000:3.0:1746147147.981496:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14917 00000100:00100000:3.0:1746147147.981504:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308141952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147147.981526:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.981546:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a6800/0x31399394250572fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7871c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147147.981607:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310737920:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147147.981681:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14918 00000100:00100000:1.0:1746147147.981688:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308142080:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147147.981694:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147147.981702:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78723 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147147.981713:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.981715:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147147.981724:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147147.981739:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147147.981745:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00010000:00010000:1.0:1746147147.981750:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:1.0:1746147147.981774:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308142080:12345-192.168.204.25@tcp:101:cat.0 Request processed in 87us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147147.981780:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14918 00000100:00100000:1.0:1746147147.982227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147147.982367:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147147.982416:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308142464 00000100:00100000:2.0:1746147147.982422:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308142464 00002000:00100000:2.0:1746147147.982452:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099013480 x1830967308142464/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/0 e 0 to 0 dl 1746147158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.982461:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013480 with x1830967308142464 ext(4194304->4919295) 00002000:00010000:2.0:1746147147.982466:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099013480 00000100:00100000:2.0:1746147147.982481:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3692 00000100:00100000:2.0:1746147147.982486:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967308142464:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147147.982544:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308142208 00000100:00100000:0.0:1746147147.982548:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308142208 00000100:00100000:0.0:1746147147.982581:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14919 00000100:00100000:0.0:1746147147.982587:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308142208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147147.982595:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147147.982606:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7872a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147147.982619:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147147.982620:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147147.982625:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147147.982635:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147147.982641:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81400, rc 0) 00000100:00100000:0.0:1746147147.982664:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308142208:12345-192.168.204.25@tcp:101:cat.0 Request processed in 78us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147147.982670:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14919 00002000:00010000:3.0:1746147147.989714:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147146 -> 1746147147 00002000:00010000:3.0:1746147147.989722:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147146 -> 1746147147 00002000:00010000:3.0:1746147147.989725:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147146 -> 1746147147 00000100:00100000:3.0:1746147147.989750:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310737920:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147147.989783:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6800/0x31399394250572fd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7871c expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.989798:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6800/0x31399394250572fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7871c expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147147.989814:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6800, rc 0) 00000100:00100000:3.0:1746147147.989888:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308141952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8382us (8656us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147147.989898:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14917 00000100:00100000:2.0:1746147147.996207:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967308142464:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13709us (13828us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147147.996219:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3692 00002000:00100000:2.0:1746147147.996230:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880099013480 x1830967308142464/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:523/0 lens 488/440 e 0 to 0 dl 1746147158 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147147.996239:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013480 with x1830967308142464 ext(4194304->4919295) 00002000:00010000:2.0:1746147147.996245:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099013480 00000100:00100000:0.0:1746147147.996855:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147147.997687:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308142720 00000100:00100000:3.0:1746147147.997695:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308142720 00000100:00100000:3.0:1746147147.997751:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15363 00000100:00100000:3.0:1746147147.997759:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+65:32536:x1830967308142720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147147.997784:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147147.997804:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x3139939425057312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78731 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147147.997850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147147.997916:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.997932:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147147.997944:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147147.997953:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147147.998053:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x3139939425057312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 68 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.998111:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 67 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147147.998120:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147147.998123:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147147.998125:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afa00, rc 0) 00000100:00100000:3.0:1746147147.998163:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:32536:x1830967308142720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 405us (1309us total) trans 8589936078 rc 0/0 00000100:00100000:3.0:1746147147.998169:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15363 00000100:00100000:2.0:1746147147.999051:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308142848 00000100:00100000:2.0:1746147147.999058:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308142848 00000100:00100000:2.0:1746147147.999115:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14920 00000100:00100000:2.0:1746147147.999122:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+18:32534:x1830967308142848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147147.999133:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147147.999146:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78738 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.999167:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.999175:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147147.999177:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147147.999180:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.999206:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147147.999218:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 37 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746147147.999229:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310738048:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147147.999291:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.005875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.006503:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310738048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.006538:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.006561:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f391400, rc 0) 00000100:00100000:2.0:1746147148.006622:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+19:32534:x1830967308142848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7500us (8784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.006631:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14920 00000100:00100000:3.0:1746147148.007480:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308142976 00000100:00100000:3.0:1746147148.007489:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308142976 00002000:00100000:3.0:1746147148.007537:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (327680->983039) req@ffff880094184700 x1830967308142976/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.007546:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184700 with x1830967308142976 ext(327680->983039) 00010000:00010000:3.0:1746147148.007554:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 38 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746147148.007567:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 38 pid: 1854 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746147148.007579:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094184700 00000100:00100000:3.0:1746147148.007596:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1159 00000100:00100000:3.0:1746147148.007604:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967308142976:12345-192.168.204.25@tcp:4:cat.0 00000100:00080000:1.0:1746147148.007639:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147148.025401:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308142976:12345-192.168.204.25@tcp:4:cat.0 Request processed in 17783us (19523us total) trans 17179874257 rc 0/0 00000100:00100000:0.0:1746147148.025416:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1159 00002000:00100000:0.0:1746147148.025429:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (327680->983039) req@ffff880094184700 x1830967308142976/t17179874257(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.025440:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184700 with x1830967308142976 ext(327680->983039) 00010000:00010000:0.0:1746147148.025451:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 40 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746147148.025469:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 40 pid: 1854 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746147148.025476:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094184700 00000100:00100000:0.0:1746147148.028674:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.028752:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308143104 00000100:00100000:2.0:1746147148.028763:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308143104 00010000:00010000:2.0:1746147148.028804:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 40 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.028859:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6596 00000100:00100000:2.0:1746147148.028872:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308143104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.028889:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.028910:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 40 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.028922:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 40 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.028947:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505729b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->983039) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786d6 expref: 40 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.028987:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.028989:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.028999:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.029013:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.029048:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.029060:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310738176:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.029183:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.035996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.036071:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308143360 00000100:00100000:1.0:1746147148.036082:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308143360 00000100:00100000:2.0:1746147148.036138:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310738176:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.036163:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147148.036169:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4998700 x1830967308143360/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.036179:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998700 with x1830967308143360 ext(0->1048575) 00002000:00010000:1.0:1746147148.036184:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998700 00000100:00100000:1.0:1746147148.036205:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3693 00000100:00100000:1.0:1746147148.036213:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308143360:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147148.036223:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308143104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7355us (7561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.036233:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6596 00000100:00080000:0.0:1746147148.036592:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147148.055358:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308143360:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19135us (19362us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147148.055371:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3693 00002000:00100000:1.0:1746147148.055383:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8800a4998700 x1830967308143360/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.055392:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998700 with x1830967308143360 ext(0->1048575) 00002000:00010000:1.0:1746147148.055398:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998700 00000100:00100000:0.0:1746147148.084318:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.084372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.084442:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308143616 00000100:00100000:2.0:1746147148.084451:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308143616 00002000:00100000:2.0:1746147148.084508:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800a4999f80 x1830967308143616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.084518:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999f80 with x1830967308143616 ext(2097152->4194303) 00002000:00010000:2.0:1746147148.084524:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4999f80 00000100:00100000:2.0:1746147148.084541:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308143872 00000100:00100000:2.0:1746147148.084543:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308143872 00002000:00100000:2.0:1746147148.084556:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a499bb80 x1830967308143872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.084563:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499bb80 with x1830967308143872 ext(3145728->4194303) 00002000:00010000:2.0:1746147148.084567:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499bb80 00000100:00100000:2.0:1746147148.084596:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3694 00000100:00100000:2.0:1746147148.084603:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308143616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147148.087694:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3695 00000100:00100000:2.0:1746147148.087710:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308143872:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:0.0:1746147148.087758:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147148.111766:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308143616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27149us (27446us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147148.111780:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3694 00002000:00100000:2.0:1746147148.111792:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8800a4999f80 x1830967308143616/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.111802:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999f80 with x1830967308143616 ext(2097152->4194303) 00002000:00010000:2.0:1746147148.111809:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4999f80 00000100:00100000:2.0:1746147148.113764:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308143872:12345-192.168.204.25@tcp:3:cat.0 Request processed in 26050us (29382us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.113774:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3695 00002000:00100000:2.0:1746147148.113783:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a499bb80 x1830967308143872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.113792:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499bb80 with x1830967308143872 ext(3145728->4194303) 00002000:00010000:2.0:1746147148.113798:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499bb80 00000100:00100000:0.0:1746147148.120136:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.120213:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144000 00000100:00100000:2.0:1746147148.120224:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144000 00000100:00100000:2.0:1746147148.120290:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14921 00000100:00100000:2.0:1746147148.120299:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+18:32531:x1830967308144000:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147148.120321:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.120341:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7873f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.120371:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.120379:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.120386:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.120388:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.120391:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.120424:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.120436:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 19 pid: 12225 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.120448:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310738304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.120562:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.120571:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 27 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.120584:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310738432:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.120603:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.129034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.129685:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310738304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.129749:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144128 00000100:00100000:3.0:1746147148.129756:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144128 00000100:00100000:0.0:1746147148.130489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.130507:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144256 00000100:00100000:0.0:1746147148.130510:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144256 00010000:00010000:3.0:1746147148.130518:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 28 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.130537:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14922 00000100:00100000:3.0:1746147148.130540:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6597 00000100:00100000:0.0:1746147148.130543:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:32534:x1830967308144256:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147148.130546:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308144128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.130559:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.130560:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.130573:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78746 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.130580:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 28 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.130591:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 28 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.130601:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.130607:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.130613:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147148.130616:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.130678:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310738432:192.168.204.25@tcp:104: 00000100:00080000:1.0:1746147148.130848:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746147148.131034:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x31399394250572da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78707 expref: 28 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.131547:0:1854:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.131560:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.131569:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81a00, rc 0) 00000100:00100000:0.0:1746147148.131610:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+21:32534:x1830967308144256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1067us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.131616:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14922 00010000:00010000:3.0:1746147148.131777:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147148.132235:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.132245:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05e00, rc 0) 00000100:00100000:2.0:1746147148.132335:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+20:32531:x1830967308144000:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12036us (12251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.132336:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308144128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1790us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.132341:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14921 00000100:00100000:3.0:1746147148.132343:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6597 00000100:00100000:0.0:1746147148.132868:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.132909:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144384 00000100:00100000:3.0:1746147148.132915:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144384 00010000:00010000:3.0:1746147148.132935:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 20 pid: 12225 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.132956:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6598 00000100:00100000:3.0:1746147148.132963:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967308144384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.132973:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.132990:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 20 pid: 12225 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.133002:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 20 pid: 12225 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.133020:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x313993942505730b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7872a expref: 20 pid: 12225 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.133029:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.133031:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.133037:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.133044:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.133070:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.133085:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.133113:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310738688:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147148.133179:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.138240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.138537:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310738688:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147148.138559:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.138709:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144640 00000100:00100000:2.0:1746147148.138716:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144640 00002000:00100000:2.0:1746147148.138762:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3952640->3956735) req@ffff880098859500 x1830967308144640/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.138771:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859500 with x1830967308144640 ext(3952640->3956735) 00010000:00010000:2.0:1746147148.138781:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 20 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.138795:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 20 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.138802:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098859500 00000100:00100000:2.0:1746147148.138827:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1160 00000100:00100000:2.0:1746147148.138847:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308144640:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147148.139129:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967308144384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6166us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.139138:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6598 00000100:00100000:2.0:1746147148.140223:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308144640:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1386us (1994us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147148.140230:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1160 00002000:00100000:2.0:1746147148.140237:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3952640->3956735) req@ffff880098859500 x1830967308144640/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.140245:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859500 with x1830967308144640 ext(3952640->3956735) 00010000:00010000:2.0:1746147148.140253:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.140265:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.140272:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098859500 00000100:00100000:0.0:1746147148.149201:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.149300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.149342:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144768 00000100:00100000:2.0:1746147148.149352:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144768 00000100:00100000:2.0:1746147148.149397:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308144896 00000100:00100000:2.0:1746147148.149400:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308144896 00000100:00100000:2.0:1746147148.149417:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14923 00000100:00100000:2.0:1746147148.149425:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308144768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.149446:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.149466:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7874d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.149489:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.149491:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.149500:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.149516:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.149526:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04000, rc 0) 00000100:00100000:2.0:1746147148.149586:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308144768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 162us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.149592:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14923 00000100:00100000:2.0:1746147148.149607:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14924 00000100:00100000:2.0:1746147148.149612:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967308144896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.149619:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.149629:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e04c00/0x3139939425057343 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78754 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.149669:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310738816:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147148.149726:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.149774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.151341:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.151563:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145152 00000100:00100000:0.0:1746147148.151569:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145152 00000100:00100000:0.0:1746147148.151601:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14925 00000100:00100000:0.0:1746147148.151606:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:32531:x1830967308145152:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147148.151618:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.151632:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7875b expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.151659:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 39 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.151668:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.151674:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.151676:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.151679:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->4849663] (req 4194304->4849663) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.151700:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.151711:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.151722:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310738944:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.151778:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 39 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.151786:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 39 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.151793:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310739072:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.151811:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.151909:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:2.0:1746147148.151987:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147147 -> 1746147148 00002000:00010000:2.0:1746147148.151990:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147147 -> 1746147148 00002000:00010000:2.0:1746147148.151993:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147147 -> 1746147148 00000100:00100000:2.0:1746147148.152011:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310738816:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.152037:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e04c00/0x3139939425057343 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78754 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.152049:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04c00/0x3139939425057343 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78754 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.152063:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04c00, rc 0) 00000100:00100000:3.0:1746147148.152443:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145280 00000100:00100000:3.0:1746147148.152448:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145280 00000100:00080000:1.0:1746147148.152496:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147148.152501:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15364 00000100:00100000:3.0:1746147148.152507:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+24:32542:x1830967308145280:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147148.152520:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.152538:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425057351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78762 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.152559:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967308144896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2945us (3257us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.152565:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14924 00010000:00010000:3.0:1746147148.152589:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152601:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152613:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152629:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152634:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152639:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152716:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152727:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.152733:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 66 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.152738:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.152756:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 66 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.152764:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 66 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.152773:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310739200:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.152831:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.152853:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 39 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.152861:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310739328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.152881:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.152960:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145408 00000100:00100000:0.0:1746147148.152964:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145408 00000100:00100000:1.0:1746147148.152989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:0.0:1746147148.152990:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3952640->4194303) req@ffff8801305f3800 x1830967308145408/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.153000:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3800 with x1830967308145408 ext(3952640->4194303) 00010000:00010000:0.0:1746147148.153007:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.153016:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 19 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746147148.153021:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305f3800 00000100:00100000:3.0:1746147148.153261:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145536 00000100:00100000:3.0:1746147148.153265:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145536 00000100:00100000:0.0:1746147148.153276:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1161 00000100:00100000:0.0:1746147148.153283:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308145408:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147148.153284:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14926 00000100:00100000:3.0:1746147148.153290:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32536:x1830967308145536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147148.153298:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.153307:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78769 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.153322:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.153329:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 41 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.153335:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.153336:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.153339:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.153355:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 41 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.153368:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 41 pid: 1398 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.153377:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310739456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.153416:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.153424:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.153431:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310739584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.153448:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.154448:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310738944:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.154458:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310739072:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.154478:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->4849663] (req 4194304->4849663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.154490:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81600, rc 0) 00000100:00100000:0.0:1746147148.154528:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:32531:x1830967308145152:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2921us (4752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.154534:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14925 00000100:00100000:0.0:1746147148.156261:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.156321:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145664 00000100:00100000:3.0:1746147148.156329:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145664 00010000:00010000:3.0:1746147148.156365:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 42 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.156405:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6599 00000100:00100000:3.0:1746147148.156413:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308145664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147148.156422:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147148.156426:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.156446:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 42 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.156458:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 42 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.156463:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145792 00000100:00100000:0.0:1746147148.156466:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145792 00010000:00010000:3.0:1746147148.156480:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x31399394250572ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78715 expref: 42 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.156480:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.156498:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.156499:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6600 00000100:00100000:0.0:1746147148.156505:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308145792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.156512:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.156520:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.156529:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308145664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (277us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147148.156529:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.156535:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6599 00010000:00010000:0.0:1746147148.156541:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425057304 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78723 expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.156561:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.156563:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.156569:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.156577:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.157301:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.157321:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310739712:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147148.158799:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.158822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.158851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.158869:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308145920 00000100:00100000:3.0:1746147148.158874:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308145920 00000100:00080000:1.0:1746147148.158903:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147148.158913:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 67 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.158933:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146048 00000100:00100000:3.0:1746147148.158935:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146048 00010000:00010000:3.0:1746147148.158946:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 40 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.158947:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310739456:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.158948:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310739200:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.158956:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310739328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.158958:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6601 00000100:00100000:3.0:1746147148.158963:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:2002:x1830967308145920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147148.158966:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6602 00000100:00100000:1.0:1746147148.158973:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+40:2002:x1830967308146048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.158974:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.158979:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 67 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.158981:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.158982:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.158988:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 67 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.158991:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 40 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.159260:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425057319 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78731 expref: 67 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.159273:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00080000:2.0:1746147148.159274:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147148.159277:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.159285:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.159290:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.159295:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.159323:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+66:2002:x1830967308145920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 359us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.159329:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6601 00000100:00100000:3.0:1746147148.159417:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310739584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.159448:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.159460:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64bc00, rc 0) 00000100:00100000:3.0:1746147148.159479:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32536:x1830967308145536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6189us (6492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.159485:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14926 00000100:00100000:3.0:1746147148.159902:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.159918:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146304 00000100:00100000:3.0:1746147148.159922:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146304 00002000:00100000:3.0:1746147148.159946:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011db17480 x1830967308146304/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.159955:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17480 with x1830967308146304 ext(0->1048575) 00002000:00010000:3.0:1746147148.159959:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17480 00000100:00100000:3.0:1746147148.159971:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3696 00000100:00100000:3.0:1746147148.159976:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967308146304:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147148.160082:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 40 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.160108:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73400/0x31399394250572e8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7870e expref: 40 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.160121:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.160124:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147148.160132:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147148.160139:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147148.160330:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.160392:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+39:2002:x1830967308146048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1418us (1539us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147148.160398:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147148.160399:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6602 00010000:00010000:2.0:1746147148.160404:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147148.160447:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147148.160451:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147148.160468:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160478:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160521:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160528:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160534:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160539:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160545:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a30c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.160548:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160554:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160563:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147148.160565:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147148.160568:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160571:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30c00/0x3139939425057358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160595:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160601:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160606:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160610:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a30a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.160613:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160617:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160624:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1900) 00010000:00010000:2.0:1746147148.160626:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147148.160628:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160633:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a30a00/0x313993942505735f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.160664:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425057351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.160675:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 25 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.160681:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.160683:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147148.160685:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31600, rc 0) 00000100:00100000:2.0:1746147148.160725:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:32542:x1830967308145280:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 8218us (9388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.160731:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15364 00000100:00100000:0.0:1746147148.165291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.165333:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.165362:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146432 00000100:00100000:1.0:1746147148.165372:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146432 00010000:00010000:1.0:1746147148.165410:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 42 pid: 1398 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.165419:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146560 00000100:00100000:0.0:1746147148.165422:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310739712:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147148.165423:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146560 00010000:00010000:3.0:1746147148.165440:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.165440:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.165459:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6603 00000100:00100000:0.0:1746147148.165481:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308145792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8975us (9059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.165534:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6604 00000100:00100000:3.0:1746147148.165542:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308146560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.165554:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.165573:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.165583:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.165606:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x31399394250571de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78651 expref: 20 pid: 1398 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.165621:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.165637:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308146560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.165643:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6604 00000100:00100000:1.0:1746147148.165757:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308146432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.165766:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.165775:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 42 pid: 1398 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.165783:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 42 pid: 1398 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.165795:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c5400/0x3139939425057239 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78690 expref: 42 pid: 1398 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.165805:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.165807:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.165814:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.165821:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.165862:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.165874:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310739840:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147148.166185:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.166646:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6600 00000100:00100000:2.0:1746147148.166781:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967308145408:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 13498us (14871us total) trans 21474841524 rc 0/0 00000100:00100000:2.0:1746147148.166790:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1161 00002000:00100000:2.0:1746147148.166801:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3952640->4194303) req@ffff8801305f3800 x1830967308145408/t21474841524(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.166811:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3800 with x1830967308145408 ext(3952640->4194303) 00010000:00010000:2.0:1746147148.166818:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.166829:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.166851:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305f3800 00000100:00100000:0.0:1746147148.167772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.167963:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.168007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.168177:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.168516:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146688 00000100:00100000:1.0:1746147148.168524:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146688 00000100:00100000:1.0:1746147148.168565:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146816 00000100:00100000:1.0:1746147148.168567:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146816 00000100:00100000:1.0:1746147148.168577:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308146944 00000100:00100000:1.0:1746147148.168578:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308146944 00000100:00100000:1.0:1746147148.168849:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308147072 00000100:00100000:1.0:1746147148.168852:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308147072 00000100:00100000:3.0:1746147148.168868:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14927 00000100:00100000:3.0:1746147148.168878:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308146688:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147148.168880:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14928 00000100:00100000:1.0:1746147148.168886:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308146816:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147148.168895:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.168895:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.168911:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78770 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.168912:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505737b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78777 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.168934:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.168936:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.168944:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.168957:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147148.168963:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310739968:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147148.168966:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6800, rc 0) 00000100:00100000:3.0:1746147148.169010:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308146688:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 133us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.169017:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14927 00000100:00100000:3.0:1746147148.169037:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14929 00000100:00100000:3.0:1746147148.169042:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308146944:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147148.169056:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14930 00000100:00100000:2.0:1746147148.169063:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308147072:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147148.169071:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.169082:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425057382 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78785 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.169126:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310740096:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147148.169177:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.169185:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7400/0x3139939425057389 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7877e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.169210:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310740224:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147148.169549:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.169616:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746147148.169631:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746147148.169633:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147148.169634:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.169892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.170017:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967308146304:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10039us (10114us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147148.170026:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3696 00002000:00100000:3.0:1746147148.170034:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88011db17480 x1830967308146304/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.170044:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17480 with x1830967308146304 ext(0->1048575) 00002000:00010000:3.0:1746147148.170048:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17480 00000100:00100000:3.0:1746147148.170064:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308147328 00000100:00100000:3.0:1746147148.170068:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308147328 00002000:00100000:3.0:1746147148.170102:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4845568->4849663) req@ffff8800a499a300 x1830967308147328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.170110:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499a300 with x1830967308147328 ext(4845568->4849663) 00002000:00010000:3.0:1746147148.170112:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499a300 00000100:00100000:3.0:1746147148.170135:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3697 00000100:00100000:3.0:1746147148.170141:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308147328:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147148.170246:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308147328:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 105us (353us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147148.170252:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3697 00002000:00100000:3.0:1746147148.170257:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4845568->4849663) req@ffff8800a499a300 x1830967308147328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.170263:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499a300 with x1830967308147328 ext(4845568->4849663) 00002000:00010000:3.0:1746147148.170266:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499a300 00000100:00100000:0.0:1746147148.171714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.171770:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308147584 00000100:00100000:3.0:1746147148.171775:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308147584 00002000:00100000:3.0:1746147148.171805:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (2043904->2047999) req@ffff880129f54380 x1830967308147584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.171814:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967308147584 ext(2043904->2047999) 00002000:00010000:3.0:1746147148.171819:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f54380 00000100:00100000:3.0:1746147148.171850:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3698 00000100:00100000:0.0:1746147148.171856:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.171857:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308147584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.171877:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308147712 00000100:00100000:0.0:1746147148.171880:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308147712 00010000:00010000:0.0:1746147148.171899:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.171917:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6605 00000100:00100000:0.0:1746147148.171923:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967308147712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.171932:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147148.171949:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308147584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 92us (241us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746147148.171950:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.171955:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3698 00002000:00100000:3.0:1746147148.171961:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (2043904->2047999) req@ffff880129f54380 x1830967308147584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147148.171963:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00002000:00100000:3.0:1746147148.171967:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967308147584 ext(2043904->2047999) 00002000:00010000:3.0:1746147148.171970:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f54380 00010000:00010000:0.0:1746147148.171986:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.171988:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.171995:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.172002:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.172032:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.172044:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310740352:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147148.172125:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310739840:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147148.172140:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.172162:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308146432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6696us (6883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.172168:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6603 00010000:00010000:2.0:1746147148.172357:0:1136:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff8801323d7480 x1830967310740096) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.172372:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505732e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7873f expref: 21 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.172386:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310740096:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.172405:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425057382 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78785 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.172414:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05000/0x3139939425057382 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78785 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.172420:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00000100:00100000:2.0:1746147148.172442:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308147072:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3380us (4266us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.172448:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14930 00002000:00010000:1.0:1746147148.172545:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147147 -> 1746147148 00002000:00010000:1.0:1746147148.172549:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147147 -> 1746147148 00002000:00010000:1.0:1746147148.172551:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147147 -> 1746147148 00000100:00100000:1.0:1746147148.172558:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310739968:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147148.172573:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505737b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78777 expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746147148.172697:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime: 1746147147 -> 1746147148 00002000:00010000:2.0:1746147148.172699:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147147 -> 1746147148 00002000:00010000:2.0:1746147148.172701:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime: 1746147147 -> 1746147148 00000100:00100000:2.0:1746147148.172709:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310740224:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.172723:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7400/0x3139939425057389 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7877e expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.172731:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7400/0x3139939425057389 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7877e expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.172738:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7400, rc 0) 00000100:00100000:2.0:1746147148.172771:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308146944:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3728us (4762us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.172776:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14929 00010000:00010000:1.0:1746147148.172814:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505737b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78777 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.172822:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a7c00, rc 0) 00000100:00100000:1.0:1746147148.172848:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308146816:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3962us (4884us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147148.172852:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14928 00000100:00100000:0.0:1746147148.173214:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.177393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.177516:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308148096 00000100:00100000:3.0:1746147148.177528:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308148096 00000100:00100000:0.0:1746147148.177583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.177601:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5530 00000100:00100000:3.0:1746147148.177612:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+39:32531:x1830967308148096:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147148.177619:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308148352 00000100:00100000:0.0:1746147148.177622:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308148352 00002000:00100000:0.0:1746147148.177651:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880134ab0000 x1830967308148352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 504/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.177661:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0000 with x1830967308148352 ext(1048576->2097151) 00002000:00010000:0.0:1746147148.177666:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0000 00000100:00100000:0.0:1746147148.177695:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3699 00000100:00100000:0.0:1746147148.177701:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308148352:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147148.177857:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+40:32531:x1830967308148096:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 248us (473us total) trans 8589936079 rc 0/0 00000100:00100000:3.0:1746147148.177864:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5530 00000100:00100000:2.0:1746147148.183753:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310740352:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.183780:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.183847:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308147712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11922us (11989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.183858:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6605 00000100:00100000:0.0:1746147148.186056:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.186116:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308148608 00000100:00100000:3.0:1746147148.186125:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308148608 00000100:00100000:3.0:1746147148.186171:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15365 00000100:00100000:3.0:1746147148.186180:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:32542:x1830967308148608:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147148.186201:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147148.186238:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308148352:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8536us (8654us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746147148.186247:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3699 00002000:00100000:0.0:1746147148.186256:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880134ab0000 x1830967308148352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 504/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.186265:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0000 with x1830967308148352 ext(1048576->2097151) 00002000:00010000:0.0:1746147148.186271:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0000 00010000:00010000:3.0:1746147148.186422:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425057390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7878c expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.186532:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.186547:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.186555:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.186584:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.186595:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 26 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.186607:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310740480:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.186668:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.186864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.186928:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308148864 00000100:00100000:0.0:1746147148.186939:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308148864 00002000:00100000:0.0:1746147148.186975:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff8801323d7480 x1830967308148864/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.186982:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7480 with x1830967308148864 ext(3145728->4194303) 00002000:00010000:0.0:1746147148.186985:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7480 00000100:00100000:0.0:1746147148.187000:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3700 00000100:00100000:0.0:1746147148.187005:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308148864:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147148.192771:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310740480:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.192792:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:2.0:1746147148.192919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.192946:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308148992 00000100:00100000:0.0:1746147148.192953:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308148992 00010000:00010000:0.0:1746147148.192988:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 27 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.193020:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6606 00000100:00100000:0.0:1746147148.193028:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+27:2001:x1830967308148992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.193042:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.193047:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 27 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.193057:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 27 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.193077:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31600/0x3139939425057366 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78762 expref: 27 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.193112:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147148.193116:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.193126:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.193133:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.193148:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.193182:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:2001:x1830967308148992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 155us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.193187:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6606 00010000:00010000:3.0:1746147148.193413:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.193420:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147148.193440:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147148.193550:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425057390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7878c expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.193564:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7878c expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.193571:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.193574:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147148.193576:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6e00, rc 0) 00000100:00100000:3.0:1746147148.193623:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:32542:x1830967308148608:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 7443us (7575us total) trans 8589936080 rc 0/0 00000100:00100000:3.0:1746147148.193630:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15365 00000100:00100000:2.0:1746147148.195553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.195729:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308149120 00000100:00100000:1.0:1746147148.195738:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308149120 00000100:00100000:1.0:1746147148.195778:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14931 00000100:00100000:1.0:1746147148.195786:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32536:x1830967308149120:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147148.195802:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.195820:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78793 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.195969:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.195976:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.195983:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147148.195984:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147148.195988:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2887679] (req 2097152->2887679) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.195999:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308148864:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8992us (9135us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147148.196008:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3700 00002000:00100000:0.0:1746147148.196017:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff8801323d7480 x1830967308148864/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.196031:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7480 with x1830967308148864 ext(3145728->4194303) 00002000:00010000:0.0:1746147148.196035:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7480 00010000:00010000:1.0:1746147148.196437:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.196527:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 40 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.196540:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310740608:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.196925:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.196934:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 17 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.196943:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310740736:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.196963:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.197303:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.197347:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308149248 00000100:00100000:2.0:1746147148.197352:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308149248 00000100:00100000:0.0:1746147148.197370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.197443:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308149376 00000100:00100000:2.0:1746147148.197447:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308149376 00000100:00100000:1.0:1746147148.197460:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14932 00000100:00100000:2.0:1746147148.197476:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14933 00000100:00100000:2.0:1746147148.197481:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967308149376:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147148.197492:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967308149248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.197493:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.197499:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.197506:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787a1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.197506:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x31399394250573b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7879a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.197521:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.197523:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.197529:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147148.197535:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310740864:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.197543:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.197553:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30c00, rc 0) 00000100:00100000:1.0:1746147148.197563:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.197568:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967308149376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.197576:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14933 00000100:00100000:0.0:1746147148.199726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.199809:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308149504 00000100:00100000:2.0:1746147148.199816:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308149504 00000100:00100000:1.0:1746147148.199843:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310740608:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.199852:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 18 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.199854:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310740736:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.199876:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6607 00010000:00010000:1.0:1746147148.199878:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->2887679] (req 2097152->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.199883:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967308149504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.199891:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a000, rc 0) 00010000:00010000:2.0:1746147148.199895:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.199915:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 18 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.199921:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32536:x1830967308149120:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4137us (4377us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147148.199923:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 18 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.199927:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14931 00010000:00010000:2.0:1746147148.199941:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4600/0x313993942505725c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786b3 expref: 18 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.199968:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.199984:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308149504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.199989:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6607 00000100:00100000:0.0:1746147148.200694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.200731:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308149632 00000100:00100000:2.0:1746147148.200735:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308149632 00010000:00010000:2.0:1746147148.200750:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.200781:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6608 00000100:00100000:2.0:1746147148.200786:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308149632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.200796:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.200804:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.200814:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.200826:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f391600/0x31399394250572d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78700 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.200844:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.200845:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.200851:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.200859:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.200888:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.200900:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310740992:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.201562:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5510000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.205038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.205135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.205465:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310740992:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.205490:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.205534:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308149632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4746us (4839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.205544:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6608 00000100:00100000:3.0:1746147148.205644:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308149888 00000100:00100000:3.0:1746147148.205651:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308149888 00000100:00100000:3.0:1746147148.205692:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15366 00000100:00100000:3.0:1746147148.205699:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:32542:x1830967308149888:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147148.205722:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.205725:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147148.205751:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425057397 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7878c expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.205767:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.205771:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147148.205783:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250573ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787a8 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.205894:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205907:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205916:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205927:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205933:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205939:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205944:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b0a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147148.205947:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205954:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205960:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.205963:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147148.205966:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205970:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250573c1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.205994:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250573ba lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a8 expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.206002:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x31399394250573ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a8 expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.206008:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1000, rc 0) 00000100:00100000:3.0:1746147148.206028:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:32542:x1830967308149888:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 330us (1002us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147148.206033:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15366 00000100:00100000:3.0:1746147148.206073:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308150144 00000100:00100000:3.0:1746147148.206076:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308150144 00000100:00100000:3.0:1746147148.206120:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14934 00000100:00100000:3.0:1746147148.206126:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308150144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.206134:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.206144:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250573c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787b6 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.206188:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310741120:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147148.206248:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.206319:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.206409:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310740864:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147148.206426:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x31399394250573b3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7879a expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.206436:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x31399394250573b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7879a expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.206446:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b200, rc 0) 00000100:00100000:1.0:1746147148.206465:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308149248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8998us (9162us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147148.206470:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14932 00000100:00100000:1.0:1746147148.206482:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308150016 00000100:00100000:1.0:1746147148.206484:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308150016 00000100:00100000:1.0:1746147148.206497:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14935 00000100:00100000:1.0:1746147148.206502:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308150016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.206508:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.206514:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250573cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787af expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.206533:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310741248:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147148.206555:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.208054:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310741248:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147148.208074:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250573cf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787af expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.208084:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822be00/0x31399394250573cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787af expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.208114:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822be00, rc 0) 00000100:00100000:1.0:1746147148.208140:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308150016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1637us (1821us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147148.208147:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14935 00000100:00100000:3.0:1746147148.208264:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310741120:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147148.208283:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250573c8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787b6 expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.208292:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250573c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787b6 expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.208299:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1e00, rc 0) 00000100:00100000:3.0:1746147148.208314:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308150144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2188us (3179us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147148.208318:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14934 00000100:00100000:0.0:1746147148.209086:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.209158:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308150400 00000100:00100000:2.0:1746147148.209165:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308150400 00002000:00100000:2.0:1746147148.209200:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2883584->2887679) req@ffff880134ab2d80 x1830967308150400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.209209:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab2d80 with x1830967308150400 ext(2883584->2887679) 00002000:00010000:2.0:1746147148.209213:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab2d80 00000100:00100000:2.0:1746147148.209233:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3701 00000100:00100000:2.0:1746147148.209239:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308150400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147148.209357:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308150400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 117us (273us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147148.209363:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3701 00002000:00100000:2.0:1746147148.209368:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2883584->2887679) req@ffff880134ab2d80 x1830967308150400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.209375:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab2d80 with x1830967308150400 ext(2883584->2887679) 00002000:00010000:2.0:1746147148.209378:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab2d80 00000100:00100000:0.0:1746147148.211743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.211848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.211903:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308150912 00000100:00100000:1.0:1746147148.211911:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308150912 00002000:00100000:1.0:1746147148.211960:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4849664->4919295) req@ffff88012e320000 x1830967308150912/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147148.211966:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308150656 00002000:00100000:1.0:1746147148.211969:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e320000 with x1830967308150912 ext(4849664->4919295) 00000100:00100000:2.0:1746147148.211970:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308150656 00002000:00010000:1.0:1746147148.211974:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e320000 00000100:00100000:1.0:1746147148.212010:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3702 00000100:00100000:1.0:1746147148.212017:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308150912:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147148.212206:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5531 00000100:00100000:2.0:1746147148.212212:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+25:32542:x1830967308150656:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147148.212389:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:32542:x1830967308150656:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 176us (655us total) trans 8589936081 rc 0/0 00000100:00100000:2.0:1746147148.212396:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5531 00000100:00100000:2.0:1746147148.217455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.217716:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308150912:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5698us (5866us total) trans 0 rc 69632/69632 00000100:00100000:1.0:1746147148.217733:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3702 00002000:00100000:1.0:1746147148.217745:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4849664->4919295) req@ffff88012e320000 x1830967308150912/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 69632/69632 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.217753:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e320000 with x1830967308150912 ext(4849664->4919295) 00002000:00010000:1.0:1746147148.217759:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e320000 00000100:00100000:0.0:1746147148.217941:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308151168 00000100:00100000:0.0:1746147148.217950:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308151168 00000100:00100000:0.0:1746147148.217998:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5532 00000100:00100000:0.0:1746147148.218006:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+66:32536:x1830967308151168:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147148.218263:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:32536:x1830967308151168:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 257us (818us total) trans 8589936082 rc 0/0 00000100:00100000:0.0:1746147148.218269:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5532 00000100:00100000:0.0:1746147148.220349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.220408:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.220481:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308151424 00000100:00100000:1.0:1746147148.220489:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308151424 00002000:00100000:1.0:1746147148.220526:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2887680->4194303) req@ffff88012e321c00 x1830967308151424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.220535:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321c00 with x1830967308151424 ext(2887680->4194303) 00002000:00010000:1.0:1746147148.220540:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e321c00 00000100:00100000:3.0:1746147148.220544:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308151680 00000100:00100000:3.0:1746147148.220550:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308151680 00000100:00100000:1.0:1746147148.220568:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3703 00002000:00100000:3.0:1746147148.220571:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880099152a00 x1830967308151680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147148.220575:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308151424:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147148.220578:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152a00 with x1830967308151680 ext(2097152->4194303) 00002000:00010000:3.0:1746147148.220582:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152a00 00000100:00100000:3.0:1746147148.220597:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3704 00000100:00100000:3.0:1746147148.220602:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967308151680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147148.224535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.224620:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.224978:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308151936 00000100:00100000:0.0:1746147148.224988:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308151936 00000100:00100000:0.0:1746147148.225037:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308151808 00000100:00100000:0.0:1746147148.225039:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308151808 00000100:00100000:0.0:1746147148.225054:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14936 00000100:00100000:0.0:1746147148.225063:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+18:2002:x1830967308151936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.225083:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.225124:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x31399394250573d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787c4 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.225181:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310741376:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147148.225262:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.225412:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14937 00000100:00100000:3.0:1746147148.225420:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308151808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.225428:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.225435:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250573dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787bd expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.225463:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310741504:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147148.225510:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.229543:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308151424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8955us (9190us total) trans 0 rc 1306624/1306624 00000100:00100000:1.0:1746147148.229555:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3703 00002000:00100000:1.0:1746147148.229567:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2887680->4194303) req@ffff88012e321c00 x1830967308151424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1306624/1306624 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.229576:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321c00 with x1830967308151424 ext(2887680->4194303) 00002000:00010000:1.0:1746147148.229583:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e321c00 00000100:00100000:2.0:1746147148.229695:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310741376:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.229726:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x31399394250573d6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787c4 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.229740:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x31399394250573d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787c4 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.229779:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260a00, rc 0) 00000100:00100000:2.0:1746147148.229799:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308151936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4737us (5277us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.229805:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14936 00000100:00100000:3.0:1746147148.229935:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310741504:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147148.229951:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250573dd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787bd expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.229959:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250573dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787bd expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.229969:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1e00, rc 0) 00000100:00100000:3.0:1746147148.230067:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2002:x1830967308151808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4572us (5370us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147148.230074:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14937 00000100:00100000:0.0:1746147148.233905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.233953:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.233997:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152064 00000100:00100000:0.0:1746147148.234005:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152064 00000100:00100000:0.0:1746147148.234058:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152192 00000100:00100000:0.0:1746147148.234061:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152192 00000100:00100000:0.0:1746147148.234074:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14938 00000100:00100000:2.0:1746147148.234208:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14939 00000100:00100000:2.0:1746147148.234217:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967308152192:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.234234:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147148.234240:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967308151680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13638us (13832us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147148.234250:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3704 00010000:00010000:2.0:1746147148.234253:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x31399394250573e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787d2 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147148.234258:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880099152a00 x1830967308151680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.234266:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152a00 with x1830967308151680 ext(2097152->4194303) 00002000:00010000:3.0:1746147148.234270:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152a00 00000100:00100000:2.0:1746147148.234307:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310741632:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147148.234373:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308152064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.234380:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.234388:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260600/0x31399394250573eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787cb expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.234413:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310741760:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147148.234450:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.234510:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.237527:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310741632:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147148.237676:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310741760:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147148.237705:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260600/0x31399394250573eb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787cb expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.237722:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260600/0x31399394250573eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787cb expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.237736:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260600, rc 0) 00000100:00100000:1.0:1746147148.237798:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308152064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3715us (3902us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147148.237806:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14938 00010000:00010000:2.0:1746147148.237883:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x31399394250573e4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787d2 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.237903:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x31399394250573e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787d2 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.237911:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b400, rc 0) 00000100:00100000:2.0:1746147148.237934:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+17:2003:x1830967308152192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3720us (3981us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.237940:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14939 00000100:00100000:0.0:1746147148.239782:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.239868:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152320 00000100:00100000:2.0:1746147148.239876:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152320 00000100:00100000:2.0:1746147148.240195:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14940 00000100:00100000:2.0:1746147148.240204:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308152320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.240222:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.240240:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9be00/0x31399394250573f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787d9 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.240297:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310741888:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147148.240389:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.242479:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310741888:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.242510:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9be00/0x31399394250573f2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787d9 expref: 40 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.242522:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9be00/0x31399394250573f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787d9 expref: 40 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.242537:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9be00, rc 0) 00000100:00100000:2.0:1746147148.242573:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308152320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2370us (2799us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.242581:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14940 00000100:00100000:0.0:1746147148.244530:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.244595:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152448 00000100:00100000:2.0:1746147148.244604:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152448 00000100:00100000:2.0:1746147148.244662:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14941 00000100:00100000:2.0:1746147148.244670:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32541:x1830967308152448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.244688:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.244795:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787e0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.244829:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.244845:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.244846:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.244849:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->4919295] (req 4194304->4919295) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.244878:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.244890:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 16 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.244906:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310742016:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.244997:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.247936:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310742016:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.247973:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->4919295] (req 4194304->4919295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.247993:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0dc00, rc 0) 00000100:00100000:2.0:1746147148.248046:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32541:x1830967308152448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3376us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.248055:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14941 00000100:00100000:0.0:1746147148.248979:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.249293:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152576 00000100:00100000:3.0:1746147148.249301:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152576 00002000:00100000:3.0:1746147148.249342:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4849663) req@ffff880091c3ea00 x1830967308152576/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.249352:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ea00 with x1830967308152576 ext(4194304->4849663) 00010000:00010000:3.0:1746147148.249360:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 17 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.249378:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 17 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.249385:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c3ea00 00000100:00100000:3.0:1746147148.249419:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1162 00000100:00100000:3.0:1746147148.249427:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308152576:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147148.254071:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308152576:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4631us (5080us total) trans 17179874258 rc 0/0 00000100:00100000:3.0:1746147148.254085:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1162 00002000:00100000:3.0:1746147148.254113:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4849663) req@ffff880091c3ea00 x1830967308152576/t17179874258(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.254122:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ea00 with x1830967308152576 ext(4194304->4849663) 00010000:00010000:3.0:1746147148.254133:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.254149:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.254157:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c3ea00 00000100:00100000:0.0:1746147148.256710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.256771:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152704 00000100:00100000:2.0:1746147148.256779:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152704 00010000:00010000:2.0:1746147148.256817:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.256864:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6609 00000100:00100000:2.0:1746147148.256872:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308152704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.256890:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.256913:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.256925:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.256954:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505734a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7875b expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.256987:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.256989:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.256996:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 39 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.257004:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 39 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.257053:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 39 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.257066:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310742144:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.257186:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.259711:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310742144:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.259736:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.259792:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308152704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2918us (3092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.259802:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6609 00000100:00100000:0.0:1746147148.260653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.260699:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308152960 00000100:00100000:3.0:1746147148.260708:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308152960 00002000:00100000:3.0:1746147148.260750:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3f800 x1830967308152960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.260759:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3f800 with x1830967308152960 ext(4194304->4919295) 00002000:00010000:3.0:1746147148.260765:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3f800 00000100:00100000:3.0:1746147148.260799:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3705 00000100:00100000:3.0:1746147148.260806:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308152960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147148.267987:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308152960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7166us (7321us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147148.268001:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3705 00002000:00100000:3.0:1746147148.268017:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3f800 x1830967308152960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.268027:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3f800 with x1830967308152960 ext(4194304->4919295) 00002000:00010000:3.0:1746147148.268034:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3f800 00000100:00100000:0.0:1746147148.274011:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.274121:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308153088 00000100:00100000:2.0:1746147148.274130:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308153088 00000100:00100000:2.0:1746147148.274730:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14942 00000100:00100000:2.0:1746147148.274740:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308153088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.274762:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.274784:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425057400 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787e7 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.274819:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425057400 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e7 expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.274837:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x3139939425057400 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e7 expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.274866:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:2.0:1746147148.274922:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308153088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 184us (923us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.274928:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14942 00000100:00100000:0.0:1746147148.280181:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.280277:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308153216 00000100:00100000:1.0:1746147148.280286:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308153216 00000100:00100000:1.0:1746147148.280345:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14943 00000100:00100000:1.0:1746147148.280354:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308153216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.280374:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.280395:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822aa00/0x3139939425057407 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787ee expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.280428:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822aa00/0x3139939425057407 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787ee expref: 41 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.280439:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822aa00/0x3139939425057407 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787ee expref: 41 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.280454:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822aa00, rc 0) 00000100:00100000:1.0:1746147148.280523:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967308153216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 169us (352us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147148.280529:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14943 00000100:00100000:0.0:1746147148.349800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.350530:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308153472 00000100:00100000:2.0:1746147148.350541:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308153472 00000100:00100000:2.0:1746147148.350609:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15367 00000100:00100000:2.0:1746147148.350618:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:32549:x1830967308153472:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147148.350647:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.350669:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505740e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787f5 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.350784:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.350800:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.350816:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147148.350827:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147148.350948:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505740e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 70 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.350969:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 69 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.350977:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.350980:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147148.350983:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d000, rc 0) 00000100:00100000:2.0:1746147148.351055:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+69:32549:x1830967308153472:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 437us (1267us total) trans 8589936083 rc 0/0 00000100:00100000:2.0:1746147148.351062:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15367 00000100:00100000:0.0:1746147148.414656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.414871:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308153728 00000100:00100000:3.0:1746147148.414884:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308153728 00000100:00100000:3.0:1746147148.415308:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15368 00000100:00100000:3.0:1746147148.415318:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+40:32551:x1830967308153728:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147148.415413:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.415434:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x3139939425057423 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e787fc expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.415537:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.415552:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.415564:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147148.415575:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147148.415678:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x3139939425057423 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 43 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.415713:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 42 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.415721:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.415724:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147148.415727:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:3.0:1746147148.415792:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+42:32551:x1830967308153728:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 476us (1149us total) trans 8589936084 rc 0/0 00000100:00100000:3.0:1746147148.415799:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15368 00000100:00100000:0.0:1746147148.467283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.467337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.467444:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308153856 00000100:00100000:2.0:1746147148.467453:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308153856 00000100:00100000:2.0:1746147148.467494:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308153984 00000100:00100000:2.0:1746147148.467495:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308153984 00000100:00100000:2.0:1746147148.467519:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14944 00000100:00100000:2.0:1746147148.467526:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308153856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.467546:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.467568:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0d200/0x3139939425057438 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78803 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.467624:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310742272:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147148.467713:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.469259:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14945 00000100:00100000:1.0:1746147148.469270:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308153984:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.469279:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.469290:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505743f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7880a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.469312:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505743f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7880a expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.469323:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822bc00/0x313993942505743f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7880a expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.469338:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:1.0:1746147148.469369:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308153984:12345-192.168.204.25@tcp:101:cat.0 Request processed in 103us (2031us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147148.469376:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14945 00000100:00100000:2.0:1746147148.473255:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310742272:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147148.473295:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0d200/0x3139939425057438 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78803 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.473308:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0d200/0x3139939425057438 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78803 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.473333:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d200, rc 0) 00000100:00100000:2.0:1746147148.473391:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:2000:x1830967308153856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5864us (6123us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147148.473399:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14944 00000100:00100000:0.0:1746147148.478999:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.479676:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308154112 00000100:00100000:2.0:1746147148.479691:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308154112 00000100:00100000:2.0:1746147148.479757:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14946 00000100:00100000:2.0:1746147148.479767:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+18:32555:x1830967308154112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.479794:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.479819:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78811 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.479869:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.479878:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.479880:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.479884:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.479926:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.479938:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 39 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.479951:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310742400:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.480054:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.481174:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.481968:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308154240 00000100:00100000:2.0:1746147148.481974:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308154240 00000100:00100000:2.0:1746147148.482030:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14947 00000100:00100000:2.0:1746147148.482037:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:32551:x1830967308154240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147148.482053:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.482071:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78818 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.482118:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.482124:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.482131:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147148.482134:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.482165:0:1854:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.482183:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.482192:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:2.0:1746147148.482242:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+21:32551:x1830967308154240:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 205us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.482248:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14947 00000100:00100000:2.0:1746147148.486682:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310742400:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.486724:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.486783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.486976:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308154368 00000100:00100000:3.0:1746147148.486985:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308154368 00002000:00100000:3.0:1746147148.487035:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (2043904->2097151) req@ffff880129f55180 x1830967308154368/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.487044:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967308154368 ext(2043904->2097151) 00010000:00010000:3.0:1746147148.487052:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 40 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.487064:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 40 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.487070:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f55180 00000100:00100000:3.0:1746147148.487144:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1163 00000100:00100000:3.0:1746147148.487157:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967308154368:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:2.0:1746147148.487181:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:2.0:1746147148.487238:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:32555:x1830967308154112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7471us (8252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.487246:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14946 00000100:00100000:3.0:1746147148.491674:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308154368:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4508us (4878us total) trans 17179874259 rc 0/0 00000100:00100000:3.0:1746147148.491690:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1163 00002000:00100000:3.0:1746147148.491702:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (2043904->2097151) req@ffff880129f55180 x1830967308154368/t17179874259(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.491712:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967308154368 ext(2043904->2097151) 00010000:00010000:3.0:1746147148.491723:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.491740:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.491747:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f55180 00000100:00100000:2.0:1746147148.504194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.504263:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308154496 00000100:00100000:3.0:1746147148.504273:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308154496 00010000:00010000:3.0:1746147148.504310:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.504341:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6610 00000100:00100000:3.0:1746147148.504349:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967308154496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.504363:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.504384:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.504397:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.504423:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64bc00/0x313993942505736d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78769 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.504443:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.504445:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.504452:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.504459:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.504497:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.504508:0:7226:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.504520:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310742656:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147148.504601:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.508454:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.508575:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310742656:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147148.508602:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.508652:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967308154496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4303us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.508665:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6610 00000100:00100000:2.0:1746147148.510228:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308154752 00000100:00100000:2.0:1746147148.510239:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308154752 00002000:00100000:2.0:1746147148.510288:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880129f56a00 x1830967308154752/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.510298:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56a00 with x1830967308154752 ext(1048576->2097151) 00010000:00010000:2.0:1746147148.510308:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 20 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.510327:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 20 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.510335:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f56a00 00000100:00100000:2.0:1746147148.510371:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1164 00000100:00100000:2.0:1746147148.510379:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308154752:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147148.527127:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.527168:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.527381:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308154752:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 16999us (18936us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147148.527394:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1164 00002000:00100000:0.0:1746147148.527406:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880129f56a00 x1830967308154752/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.527416:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56a00 with x1830967308154752 ext(1048576->2097151) 00010000:00010000:0.0:1746147148.527427:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 20 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.527442:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 20 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746147148.527449:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f56a00 00000100:00100000:0.0:1746147148.527487:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308154880 00000100:00100000:0.0:1746147148.527495:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308154880 00000100:00100000:0.0:1746147148.527525:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155008 00000100:00100000:0.0:1746147148.527528:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155008 00000100:00100000:0.0:1746147148.527552:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14948 00000100:00100000:0.0:1746147148.527559:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308154880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.527576:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.527593:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cb6c00/0x3139939425057454 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7881f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.527615:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.527626:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cb6c00/0x3139939425057454 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7881f expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.527637:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb6c00/0x3139939425057454 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7881f expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.527650:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb6c00, rc 0) 00000100:00100000:0.0:1746147148.527668:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308154880:12345-192.168.204.25@tcp:101:cat.0 Request processed in 110us (590us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147148.527674:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14948 00000100:00100000:0.0:1746147148.527686:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14949 00000100:00100000:0.0:1746147148.527694:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967308155008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.527699:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.527705:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cb7600/0x313993942505745b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78826 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.527717:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cb7600/0x313993942505745b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78826 expref: 42 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.527731:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb7600/0x313993942505745b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78826 expref: 42 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.527738:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb7600, rc 0) 00000100:00100000:0.0:1746147148.527753:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967308155008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (585us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147148.527758:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14949 00000100:00100000:0.0:1746147148.535486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.537451:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155136 00000100:00100000:3.0:1746147148.537467:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155136 00000100:00100000:3.0:1746147148.537526:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14950 00000100:00100000:3.0:1746147148.537537:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32558:x1830967308155136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.537558:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.537582:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7882d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.537615:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.537623:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.537629:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147148.537634:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.537678:0:12225:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.537690:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 42 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.537700:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80200, rc 0) 00000100:00100000:3.0:1746147148.538127:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32558:x1830967308155136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 590us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.538135:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14950 00000100:00100000:0.0:1746147148.540371:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.543895:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155264 00000100:00100000:2.0:1746147148.543910:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155264 00000100:00100000:2.0:1746147148.543989:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14951 00000100:00100000:2.0:1746147148.543997:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32560:x1830967308155264:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147148.544018:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.544038:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78834 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.544072:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.544081:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.544119:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.544122:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.544126:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.544164:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.544176:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.544187:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310742912:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.544310:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.544317:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 19 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.544325:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310743040:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.544342:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.550209:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310742912:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.550251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.550297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.550316:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310743040:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.550326:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147148.550351:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.550356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147148.550370:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:1.0:1746147148.550386:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155520 00000100:00100000:1.0:1746147148.550392:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155520 00000100:00100000:2.0:1746147148.550419:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32560:x1830967308155264:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6421us (10054us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147148.550428:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 20 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.550432:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14951 00000100:00100000:2.0:1746147148.550452:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155392 00000100:00100000:2.0:1746147148.550454:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155392 00000100:00100000:1.0:1746147148.550454:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155648 00000100:00100000:1.0:1746147148.550456:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155648 00010000:00010000:1.0:1746147148.550467:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 20 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.550476:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14952 00000100:00100000:1.0:1746147148.550480:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155776 00000100:00100000:1.0:1746147148.550482:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155776 00000100:00100000:2.0:1746147148.550483:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:32555:x1830967308155392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.550490:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.550498:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147148.550503:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6611 00010000:00010000:2.0:1746147148.550513:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7883b expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.550513:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308155520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.550525:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.550532:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.550539:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.550541:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.550544:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.550545:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 22 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.550554:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 22 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.550571:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.550572:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425057446 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78811 expref: 22 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.550581:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 41 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.550586:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.550588:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147148.550593:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310743168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.550594:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.550600:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.550634:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.550643:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00010000:00010000:1.0:1746147148.550643:0:7227:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.550652:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099012a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310743296:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.550672:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6612 00000100:00100000:2.0:1746147148.550678:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308155648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.550687:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.550698:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 20 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.550706:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 20 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.550719:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81a00/0x3139939425057335 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78746 expref: 20 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.550720:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6613 00000100:00100000:3.0:1746147148.550728:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967308155776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.550738:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147148.550743:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.550750:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.550789:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.550791:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308155648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.550796:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6612 00010000:00010000:3.0:1746147148.550853:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.550868:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x31399394250573ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787a1 expref: 29 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.550880:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.550881:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.550884:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.550889:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.550906:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.550913:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310743424:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147148.550951:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.554961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.554974:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310743168:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.555005:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.555023:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ce00, rc 0) 00000100:00100000:1.0:1746147148.555043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.555067:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308156160 00000100:00100000:1.0:1746147148.555074:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308156160 00002000:00100000:1.0:1746147148.555140:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1982464->1986559) req@ffff88009c308700 x1830967308156160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.555150:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308700 with x1830967308156160 ext(1982464->1986559) 00010000:00010000:1.0:1746147148.555156:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 22 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.555166:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 22 pid: 1854 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746147148.555173:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c308700 00000100:00100000:1.0:1746147148.555190:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308155904 00000100:00100000:1.0:1746147148.555192:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308155904 00002000:00100000:1.0:1746147148.555204:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3899391) req@ffff88009c309180 x1830967308155904/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 520/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.555212:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309180 with x1830967308155904 ext(2097152->3899391) 00010000:00010000:1.0:1746147148.555216:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 42 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.555224:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 42 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746147148.555229:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c309180 00000100:00100000:1.0:1746147148.555243:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1165 00000100:00100000:1.0:1746147148.555250:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308156160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.555557:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1166 00000100:00100000:0.0:1746147148.555565:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308155904:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147148.555836:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:32555:x1830967308155392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5343us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.555844:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14952 00000100:00100000:1.0:1746147148.556124:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308156160:12345-192.168.204.25@tcp:3:cat.0 Request processed in 872us (1173us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147148.556130:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1165 00002000:00100000:1.0:1746147148.556135:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1982464->1986559) req@ffff88009c308700 x1830967308156160/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.556143:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308700 with x1830967308156160 ext(1982464->1986559) 00010000:00010000:1.0:1746147148.556149:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.556157:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 21 pid: 1854 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746147148.556162:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c308700 00000100:00100000:0.0:1746147148.556162:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099012a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310743296:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147148.556174:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.556191:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308155520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5683us (5893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.556199:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6611 00000100:00100000:0.0:1746147148.558356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.558547:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308156416 00000100:00100000:1.0:1746147148.558557:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308156416 00002000:00100000:1.0:1746147148.558596:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2129920->2134015) req@ffff880091c3ce00 x1830967308156416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.558606:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ce00 with x1830967308156416 ext(2129920->2134015) 00002000:00010000:1.0:1746147148.558612:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3ce00 00000100:00100000:1.0:1746147148.558680:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3706 00000100:00100000:1.0:1746147148.558688:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308156416:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147148.558819:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308156416:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 131us (471us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147148.558835:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3706 00002000:00100000:1.0:1746147148.558841:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2129920->2134015) req@ffff880091c3ce00 x1830967308156416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.558847:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ce00 with x1830967308156416 ext(2129920->2134015) 00002000:00010000:1.0:1746147148.558850:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3ce00 00000100:00100000:3.0:1746147148.559675:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310743424:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147148.559695:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.559732:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967308155776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9005us (9374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.559742:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6613 00000100:00100000:1.0:1746147148.564820:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.564885:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.565886:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308156672 00000100:00100000:2.0:1746147148.565896:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308156672 00002000:00100000:2.0:1746147148.565941:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1982464->2097151) req@ffff88009c30a680 x1830967308156672/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.565955:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30a680 with x1830967308156672 ext(1982464->2097151) 00010000:00010000:2.0:1746147148.565964:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 20 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.565976:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 20 pid: 1854 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.565983:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c30a680 00000100:00100000:2.0:1746147148.566004:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1167 00000100:00100000:2.0:1746147148.566012:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308156672:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147148.566235:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308156800 00000100:00100000:3.0:1746147148.566240:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308156800 00000100:00100000:3.0:1746147148.566264:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14953 00000100:00100000:3.0:1746147148.566269:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:32551:x1830967308156800:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147148.566279:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.566294:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78842 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.566316:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147148.566321:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.566326:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147148.566328:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2473983] (req 2097152->2473983) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.566364:0:1136:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.566375:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2473983] (req 2097152->2473983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.566385:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80800, rc 0) 00000100:00100000:3.0:1746147148.566424:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+23:32551:x1830967308156800:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 154us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.566431:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14953 00000100:00100000:0.0:1746147148.577056:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308155904:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 21475us (22003us total) trans 17179874260 rc 0/0 00000100:00100000:0.0:1746147148.577072:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1166 00002000:00100000:0.0:1746147148.577086:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3899391) req@ffff88009c309180 x1830967308155904/t17179874260(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 520/456 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.577122:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309180 with x1830967308155904 ext(2097152->3899391) 00010000:00010000:0.0:1746147148.577134:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 44 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.577148:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 44 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746147148.577155:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c309180 00000100:00100000:2.0:1746147148.577198:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967308156672:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11186us (12389us total) trans 17179874261 rc 0/0 00000100:00100000:2.0:1746147148.577206:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1167 00002000:00100000:2.0:1746147148.577212:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8e:0x0] (1982464->2097151) req@ffff88009c30a680 x1830967308156672/t17179874261(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.577218:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30a680 with x1830967308156672 ext(1982464->2097151) 00010000:00010000:2.0:1746147148.577224:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 23 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.577231:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 23 pid: 1854 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.577236:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c30a680 00000100:00100000:0.0:1746147148.579289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.580160:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.580300:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308156928 00000100:00100000:1.0:1746147148.580310:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308156928 00010000:00010000:1.0:1746147148.580346:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 23 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.580383:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308157056 00000100:00100000:1.0:1746147148.580385:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308157056 00010000:00010000:1.0:1746147148.580396:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 44 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.580417:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6614 00000100:00100000:1.0:1746147148.580424:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308156928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.580437:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.580458:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 23 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.580467:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 23 pid: 1854 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.580491:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505744d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78818 expref: 23 pid: 1854 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.580504:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6615 00000100:00100000:2.0:1746147148.580517:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308157056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.580521:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.580524:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.580526:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.580531:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 44 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.580537:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 44 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.580540:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 44 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.580547:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 44 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.580559:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x31399394250573a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->2887679) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78793 expref: 44 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.580572:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.580573:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.580575:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.580579:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.580585:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310743680:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.580586:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.580606:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.580617:0:8909:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.580625:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310743808:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147148.580804:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.580815:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.585886:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.586012:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310743808:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.586037:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.586112:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308157056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5595us (5951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.586126:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6615 00000100:00100000:3.0:1746147148.586210:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308157312 00000100:00100000:3.0:1746147148.586218:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308157312 00002000:00100000:3.0:1746147148.586254:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880099150e00 x1830967308157312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.586263:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150e00 with x1830967308157312 ext(2097152->3145727) 00010000:00010000:3.0:1746147148.586272:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.586284:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.586290:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099150e00 00000100:00100000:3.0:1746147148.586304:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1168 00000100:00100000:3.0:1746147148.586310:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308157312:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.587239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.587255:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308157568 00000100:00100000:0.0:1746147148.587258:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308157568 00002000:00100000:0.0:1746147148.587278:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880099151880 x1830967308157568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.587286:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151880 with x1830967308157568 ext(1048576->2097151) 00002000:00010000:0.0:1746147148.587290:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099151880 00000100:00100000:1.0:1746147148.587354:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310743680:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147148.587369:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.587397:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308156928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6973us (8115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.587405:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6614 00000100:00100000:0.0:1746147148.587526:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3707 00000100:00100000:0.0:1746147148.587532:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308157568:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147148.601388:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967308157312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15065us (15501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147148.601402:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1168 00002000:00100000:3.0:1746147148.601414:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880099150e00 x1830967308157312/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.601423:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150e00 with x1830967308157312 ext(2097152->3145727) 00010000:00010000:3.0:1746147148.601433:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.601449:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.601461:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099150e00 00000100:00100000:2.0:1746147148.603051:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308157568:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15511us (15806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.603062:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3707 00002000:00100000:2.0:1746147148.603071:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880099151880 x1830967308157568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.603079:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151880 with x1830967308157568 ext(1048576->2097151) 00002000:00010000:2.0:1746147148.603085:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099151880 00000100:00100000:0.0:1746147148.612783:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.612837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.612881:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.612993:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308157696 00000100:00100000:2.0:1746147148.613002:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308157696 00000100:00100000:2.0:1746147148.613039:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308157824 00000100:00100000:2.0:1746147148.613041:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308157824 00000100:00100000:2.0:1746147148.613055:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14954 00000100:00100000:2.0:1746147148.613063:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32558:x1830967308157696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.613081:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.613124:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78849 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613151:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.613157:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2473983] (req 2097152->2473983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613163:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.613166:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 44 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613199:0:12225:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2473983] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613212:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 44 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613221:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d000, rc 0) 00000100:00100000:2.0:1746147148.613261:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32558:x1830967308157696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 199us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.613267:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14954 00000100:00100000:2.0:1746147148.613280:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14955 00000100:00100000:2.0:1746147148.613284:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:32555:x1830967308157824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.613291:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.613300:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78850 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613314:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613319:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.613320:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147148.613322:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613334:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.613343:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 27 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.613354:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310744064:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.613411:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.613622:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308157952 00000100:00100000:1.0:1746147148.613626:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308157952 00010000:00010000:1.0:1746147148.613643:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.613659:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6616 00000100:00100000:1.0:1746147148.613664:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308157952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.613672:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.613689:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.613697:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.613712:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425057470 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7883b expref: 22 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.613737:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.613739:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.613745:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.613756:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.613895:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.613902:0:7227:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.613910:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310744192:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147148.613936:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.615218:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310744064:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.615241:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.615253:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c200, rc 0) 00000100:00100000:2.0:1746147148.615280:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:32555:x1830967308157824:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1994us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.615287:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14955 00000100:00100000:1.0:1746147148.615358:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310744192:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147148.615370:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.615388:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308157952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1723us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.615395:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6616 00000100:00100000:0.0:1746147148.616619:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.616668:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308158080 00000100:00100000:2.0:1746147148.616674:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308158080 00002000:00100000:2.0:1746147148.616711:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2134015) req@ffff8800a4999c00 x1830967308158080/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.616720:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999c00 with x1830967308158080 ext(2097152->2134015) 00010000:00010000:2.0:1746147148.616728:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 28 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.616739:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 28 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.616750:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4999c00 00000100:00100000:2.0:1746147148.616776:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1169 00000100:00100000:2.0:1746147148.616784:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308158080:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147148.619427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.620492:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308158336 00000100:00100000:3.0:1746147148.620503:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308158336 00002000:00100000:3.0:1746147148.620545:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2469888->2473983) req@ffff8801323d5c00 x1830967308158336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.620555:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5c00 with x1830967308158336 ext(2469888->2473983) 00010000:00010000:3.0:1746147148.620565:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.620577:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.620584:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d5c00 00000100:00100000:3.0:1746147148.620611:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1170 00000100:00100000:3.0:1746147148.620620:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967308158336:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147148.620736:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967308158336:12345-192.168.204.25@tcp:3:cat.0 Request processed in 116us (1321us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147148.620742:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1170 00002000:00100000:3.0:1746147148.620747:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (2469888->2473983) req@ffff8801323d5c00 x1830967308158336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.620754:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5c00 with x1830967308158336 ext(2469888->2473983) 00010000:00010000:3.0:1746147148.620758:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.620771:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.620776:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801323d5c00 00000100:00100000:2.0:1746147148.621415:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308158080:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4628us (4797us total) trans 21474841525 rc 0/0 00000100:00100000:2.0:1746147148.621424:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1169 00002000:00100000:2.0:1746147148.621430:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2134015) req@ffff8800a4999c00 x1830967308158080/t21474841525(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.621437:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999c00 with x1830967308158080 ext(2097152->2134015) 00010000:00010000:2.0:1746147148.621444:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 30 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.621453:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 30 pid: 12225 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.621459:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4999c00 00000100:00100000:0.0:1746147148.623043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.623564:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308158464 00000100:00100000:1.0:1746147148.623572:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308158464 00010000:00010000:1.0:1746147148.623604:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 30 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.623641:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6617 00000100:00100000:1.0:1746147148.623648:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308158464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.623661:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.623682:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 30 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.623692:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 30 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.623714:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x3139939425057469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78834 expref: 30 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.623743:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.623745:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.623751:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.623759:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.623790:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.623800:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310744320:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147148.623892:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.625638:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.626239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.626289:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308158720 00000100:00100000:2.0:1746147148.626297:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308158720 00002000:00100000:2.0:1746147148.626344:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2473983) req@ffff880096cfb800 x1830967308158720/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.626353:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb800 with x1830967308158720 ext(2097152->2473983) 00010000:00010000:2.0:1746147148.626362:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.626380:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 21 pid: 1136 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.626387:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cfb800 00000100:00100000:2.0:1746147148.626418:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1171 00000100:00100000:2.0:1746147148.626426:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967308158720:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147148.626440:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308158848 00000100:00100000:3.0:1746147148.626444:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308158848 00000100:00100000:3.0:1746147148.626475:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15369 00000100:00100000:3.0:1746147148.626480:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+26:32562:x1830967308158848:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147148.626495:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.626512:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98e00/0x313993942505748c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78857 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.626563:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626574:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626584:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626594:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626599:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626605:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626677:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626689:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 68 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.626696:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.626703:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.626728:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.626736:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 41 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.626746:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744448:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.626816:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 68 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.626833:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 68 pid: 7238 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.626841:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744576:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.626866:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.631969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.632002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.632057:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744448:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.632341:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310744320:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147148.632362:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.632408:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308158464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8759us (9371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.632418:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6617 00000100:00100000:1.0:1746147148.632523:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308159104 00000100:00100000:1.0:1746147148.632529:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308159104 00002000:00100000:1.0:1746147148.632562:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880097d77480 x1830967308159104/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.632572:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77480 with x1830967308159104 ext(2097152->3145727) 00002000:00010000:1.0:1746147148.632577:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77480 00000100:00100000:1.0:1746147148.632592:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3708 00000100:00100000:1.0:1746147148.632599:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308159104:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.632675:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308159360 00000100:00100000:0.0:1746147148.632680:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308159360 00000100:00100000:0.0:1746147148.632713:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5533 00000100:00100000:0.0:1746147148.632718:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+42:26824:x1830967308159360:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147148.632856:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+43:26824:x1830967308159360:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 137us (852us total) trans 8589936085 rc 0/0 00000100:00100000:0.0:1746147148.632862:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5533 00000100:00100000:3.0:1746147148.635073:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308158720:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8638us (9430us total) trans 17179874262 rc 0/0 00000100:00100000:3.0:1746147148.635114:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1171 00002000:00100000:3.0:1746147148.635127:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2473983) req@ffff880096cfb800 x1830967308158720/t17179874262(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.635136:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb800 with x1830967308158720 ext(2097152->2473983) 00010000:00010000:3.0:1746147148.635147:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.635160:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746147148.635167:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cfb800 00000100:00100000:0.0:1746147148.637285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.637542:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744576:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.637571:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147148.639685:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.639780:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308159744 00000100:00100000:0.0:1746147148.639790:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308159744 00010000:00010000:0.0:1746147148.639836:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 43 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.639878:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6618 00000100:00100000:0.0:1746147148.639885:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+43:2000:x1830967308159744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.639899:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.639905:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 43 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.639914:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 43 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.639935:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505742a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787fc expref: 43 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.639949:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147148.639954:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.639962:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.639966:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.639970:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.640004:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+42:2000:x1830967308159744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 120us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.640009:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6618 00000100:00100000:0.0:1746147148.640175:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308159104:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7575us (8214us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147148.640182:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3708 00002000:00100000:0.0:1746147148.640190:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff880097d77480 x1830967308159104/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.640199:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77480 with x1830967308159104 ext(2097152->3145727) 00002000:00010000:0.0:1746147148.640204:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77480 00000100:00100000:0.0:1746147148.640247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.640261:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308159872 00000100:00100000:0.0:1746147148.640264:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308159872 00000100:00100000:3.0:1746147148.640518:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308159616 00000100:00100000:3.0:1746147148.640522:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308159616 00000100:00100000:3.0:1746147148.640555:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5534 00000100:00100000:3.0:1746147148.640560:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+69:30749:x1830967308159616:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147148.640733:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+70:30749:x1830967308159616:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 172us (3464us total) trans 8589936086 rc 0/0 00000100:00100000:3.0:1746147148.640738:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5534 00010000:00010000:0.0:1746147148.641793:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.643861:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6619 00000100:00100000:1.0:1746147148.643884:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308159872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.643907:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.643937:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.643952:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.643979:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80800/0x3139939425057477 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2473983) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78842 expref: 23 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.644005:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.644008:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.644015:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.644023:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.644065:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.644079:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310744704:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147148.644212:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.645410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.645658:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.645677:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308160128 00000100:00100000:2.0:1746147148.645685:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308160128 00000100:00100000:3.0:1746147148.646000:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308160000 00000100:00100000:3.0:1746147148.646005:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308160000 00010000:00010000:3.0:1746147148.646031:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 70 pid: 7238 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.646054:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6620 00000100:00100000:3.0:1746147148.646060:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+70:2001:x1830967308160000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.646078:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.646083:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 70 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.646110:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 70 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.646127:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425057415 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787f5 expref: 70 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.646139:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.646143:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.646152:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.646160:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147148.646198:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310744704:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147148.646219:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147148.646252:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147148.646258:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14956 00000100:00100000:2.0:1746147148.646265:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+23:32555:x1830967308160128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.646279:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.646291:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7885e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.646308:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147148.646308:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308159872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2434us (6059us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147148.646310:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.646316:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.646316:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6619 00010000:00010000:2.0:1746147148.646332:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.646341:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38cc00, rc 0) 00000100:00100000:2.0:1746147148.646359:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+23:32555:x1830967308160128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.646364:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14956 00010000:00010000:3.0:1746147148.646397:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.646415:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+69:2001:x1830967308160000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 355us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.646421:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6620 00010000:00010000:2.0:1746147148.646526:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646533:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147148.646583:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147148.646586:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147148.646602:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646611:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646622:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646628:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646633:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646639:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646645:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.646649:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646655:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646662:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147148.646664:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147148.646667:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646672:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425057493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646684:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646689:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646694:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646698:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.646699:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646704:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646709:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1c00) 00010000:00010000:2.0:1746147148.646710:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147148.646713:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646717:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505749a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.646744:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98e00/0x313993942505748c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.646752:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.646758:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.646760:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147148.646762:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99a00, rc 0) 00000100:00100000:2.0:1746147148.646843:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+27:32562:x1830967308158848:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 20362us (20603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.646849:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15369 00000100:00100000:2.0:1746147148.647151:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.647172:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308160384 00000100:00100000:0.0:1746147148.647177:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308160384 00002000:00100000:0.0:1746147148.647205:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097d74380 x1830967308160384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.647214:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74380 with x1830967308160384 ext(2097152->3145727) 00002000:00010000:0.0:1746147148.647219:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74380 00000100:00100000:0.0:1746147148.647232:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3709 00000100:00100000:0.0:1746147148.647237:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308160384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.658681:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.659599:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308160512 00000100:00100000:3.0:1746147148.659610:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308160512 00000100:00100000:3.0:1746147148.659668:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14957 00000100:00100000:3.0:1746147148.659677:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308160512:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147148.659755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147148.659777:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147148.659781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.659817:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308160640 00000100:00100000:0.0:1746147148.659821:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308160640 00000100:00100000:1.0:1746147148.659838:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.659850:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308160768 00000100:00100000:0.0:1746147148.659852:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308160768 00000100:00100000:1.0:1746147148.659867:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.659867:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14958 00000100:00100000:0.0:1746147148.659871:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308160640:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147148.659878:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.659889:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7886c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.659916:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.659918:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147148.659921:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14959 00000100:00100000:2.0:1746147148.659929:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308160768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147148.659929:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.659937:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.659948:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78873 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.659950:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.659959:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.659960:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.659960:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1a00, rc 0) 00010000:00010000:2.0:1746147148.659964:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.659976:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.659982:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d800, rc 0) 00000100:00100000:2.0:1746147148.660002:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308160768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.660008:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14959 00010000:00010000:3.0:1746147148.660013:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78865 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.660024:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.660026:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.660031:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147148.660035:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308161024 00000100:00100000:2.0:1746147148.660037:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308161024 00010000:00010000:3.0:1746147148.660039:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.660046:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99400, rc 0) 00002000:00100000:2.0:1746147148.660061:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012ca12680 x1830967308161024/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.660075:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12680 with x1830967308161024 ext(3145728->4194303) 00002000:00010000:2.0:1746147148.660080:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca12680 00000100:00100000:2.0:1746147148.660109:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308161280 00000100:00100000:2.0:1746147148.660111:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308161280 00002000:00100000:2.0:1746147148.660125:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012ca13480 x1830967308161280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.660131:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13480 with x1830967308161280 ext(3145728->4194303) 00002000:00010000:2.0:1746147148.660134:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca13480 00000100:00100000:2.0:1746147148.660143:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3710 00000100:00100000:2.0:1746147148.660147:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308161024:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.660178:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308160640:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 305us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.660794:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14958 00000100:00100000:0.0:1746147148.660817:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3711 00000100:00100000:0.0:1746147148.660834:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967308161280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.661628:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308160384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14387us (14474us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147148.661635:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3709 00002000:00100000:0.0:1746147148.661642:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880097d74380 x1830967308160384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.661650:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74380 with x1830967308160384 ext(2097152->3145727) 00002000:00010000:0.0:1746147148.661655:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74380 00000100:00100000:3.0:1746147148.662255:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308160512:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2576us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.662262:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14957 00000100:00100000:0.0:1746147148.676422:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.676489:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308161024:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16337us (16646us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.676501:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308161536 00000100:00100000:3.0:1746147148.676502:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3710 00000100:00100000:2.0:1746147148.676509:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308161536 00002000:00100000:3.0:1746147148.676513:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88012ca12680 x1830967308161024/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.676521:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12680 with x1830967308161024 ext(3145728->4194303) 00002000:00010000:3.0:1746147148.676527:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca12680 00000100:00100000:2.0:1746147148.676556:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15370 00000100:00100000:2.0:1746147148.676564:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+27:32562:x1830967308161536:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147148.676582:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.676601:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250574c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7887a expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.676708:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.676722:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.676730:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.676765:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.676777:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 28 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.676789:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744832:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.677131:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.677250:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.677289:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308161664 00000100:00100000:3.0:1746147148.677294:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308161664 00000100:00100000:3.0:1746147148.677323:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14960 00000100:00100000:3.0:1746147148.677330:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32558:x1830967308161664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.677339:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.677351:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78881 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.677368:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.677369:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.677376:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.677389:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.677399:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98a00, rc 0) 00000100:00100000:3.0:1746147148.677420:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32558:x1830967308161664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.677426:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14960 00000100:00100000:1.0:1746147148.677516:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967308161280:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16691us (17646us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147148.677524:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3711 00002000:00100000:1.0:1746147148.677530:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88012ca13480 x1830967308161280/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.677538:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13480 with x1830967308161280 ext(3145728->4194303) 00002000:00010000:1.0:1746147148.677541:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca13480 00000100:00100000:0.0:1746147148.680613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.680682:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308161792 00000100:00100000:3.0:1746147148.680690:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308161792 00000100:00100000:2.0:1746147148.680711:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744832:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.680724:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 29 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.680733:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:3.0:1746147148.680752:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6621 00000100:00100000:3.0:1746147148.680758:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+29:2000:x1830967308161792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.680771:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.680777:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 29 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.680788:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 29 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.680813:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x31399394250574a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78857 expref: 29 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.680867:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.680871:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.680881:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.680887:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.681533:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147148.681541:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.681547:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147148.681567:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:3.0:1746147148.681577:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+28:2000:x1830967308161792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 818us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.681584:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6621 00010000:00010000:2.0:1746147148.681706:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x31399394250574c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.681724:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.681731:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.681733:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147148.681736:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d200, rc 0) 00000100:00100000:2.0:1746147148.681776:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+28:32562:x1830967308161536:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5212us (5369us total) trans 8589936087 rc 0/0 00000100:00100000:2.0:1746147148.681783:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15370 00000100:00100000:0.0:1746147148.686481:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.686592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.686679:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308161920 00000100:00100000:2.0:1746147148.686688:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308161920 00000100:00100000:2.0:1746147148.686752:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15371 00000100:00100000:2.0:1746147148.686759:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+28:32562:x1830967308161920:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147148.686789:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.686811:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x31399394250574e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78888 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.686922:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.686936:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.686943:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.686975:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.686985:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 29 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.686997:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744960:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.687074:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.687188:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308162048 00000100:00100000:3.0:1746147148.687192:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308162048 00000100:00100000:3.0:1746147148.687379:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14961 00000100:00100000:3.0:1746147148.687388:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308162048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.687396:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.687407:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7888f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.687427:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.687429:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.687438:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 24 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.687460:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 24 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.687469:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98e00, rc 0) 00000100:00100000:3.0:1746147148.687512:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308162048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 125us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.687518:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14961 00000100:00100000:0.0:1746147148.688159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.688200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.688216:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308162432 00000100:00100000:1.0:1746147148.688220:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308162432 00002000:00100000:1.0:1746147148.688249:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a499b100 x1830967308162432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.688259:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499b100 with x1830967308162432 ext(3145728->4194303) 00002000:00010000:1.0:1746147148.688263:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499b100 00000100:00100000:1.0:1746147148.688287:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308162560 00000100:00100000:1.0:1746147148.688291:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308162560 00002000:00100000:1.0:1746147148.688305:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801323d4380 x1830967308162560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.688311:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4380 with x1830967308162560 ext(2097152->4194303) 00002000:00010000:1.0:1746147148.688314:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d4380 00000100:00100000:1.0:1746147148.688327:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3712 00000100:00100000:1.0:1746147148.688332:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308162432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147148.688416:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3713 00000100:00100000:3.0:1746147148.688422:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308162560:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.697324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.697358:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310744960:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.697361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147148.697384:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:3.0:1746147148.697397:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308162688 00000100:00100000:3.0:1746147148.697404:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308162688 00010000:00010000:3.0:1746147148.697437:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 30 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.697474:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6622 00000100:00100000:3.0:1746147148.697481:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+30:2003:x1830967308162688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.697496:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.697502:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 30 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.697512:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 30 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.697534:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x31399394250574cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7887a expref: 30 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.697567:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.697571:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.697582:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.697589:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.697605:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.697645:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+29:2003:x1830967308162688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 164us (334us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147148.697647:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:3.0:1746147148.697652:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6622 00010000:00010000:2.0:1746147148.697654:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147148.697707:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147148.697711:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147148.697730:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.697762:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542a00/0x31399394250574e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78888 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.697778:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78888 expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.697789:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.697791:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147148.697794:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543e00, rc 0) 00000100:00100000:2.0:1746147148.697839:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+29:32562:x1830967308161920:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 11081us (11370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.697846:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15371 00000100:00100000:2.0:1746147148.697935:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308162944 00000100:00100000:2.0:1746147148.697938:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308162944 00002000:00100000:2.0:1746147148.697959:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a4396a00 x1830967308162944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.697968:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396a00 with x1830967308162944 ext(4194304->4919295) 00002000:00010000:2.0:1746147148.697972:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396a00 00000100:00100000:2.0:1746147148.697985:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3714 00000100:00100000:2.0:1746147148.697990:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308162944:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147148.698163:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308162432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9828us (10005us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147148.698171:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3712 00002000:00100000:1.0:1746147148.698177:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a499b100 x1830967308162432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.698184:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499b100 with x1830967308162432 ext(3145728->4194303) 00002000:00010000:1.0:1746147148.698188:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499b100 00000100:00100000:0.0:1746147148.713995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.714530:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163200 00000100:00100000:2.0:1746147148.714540:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163200 00000100:00100000:2.0:1746147148.714597:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15372 00000100:00100000:2.0:1746147148.714606:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+28:32562:x1830967308163200:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147148.714629:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147148.714645:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308162560:12345-192.168.204.25@tcp:3:cat.0 Request processed in 26221us (26442us total) trans 0 rc 2097152/2097152 00010000:00010000:2.0:1746147148.714649:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x31399394250574f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78896 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.714654:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3713 00002000:00100000:3.0:1746147148.714663:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff8801323d4380 x1830967308162560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147148.714671:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4380 with x1830967308162560 ext(2097152->4194303) 00002000:00010000:3.0:1746147148.714677:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d4380 00010000:00010000:2.0:1746147148.714755:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.714775:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.714786:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147148.714798:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147148.714916:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x31399394250574f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 31 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.714933:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.714941:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.714944:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147148.714947:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542400, rc 0) 00000100:00100000:2.0:1746147148.715424:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+30:32562:x1830967308163200:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 752us (1375us total) trans 8589936088 rc 0/0 00000100:00100000:2.0:1746147148.715431:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15372 00000100:00100000:2.0:1746147148.715784:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308162944:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17791us (18419us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147148.715791:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3714 00002000:00100000:2.0:1746147148.715797:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff8800a4396a00 x1830967308162944/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.715806:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396a00 with x1830967308162944 ext(4194304->4919295) 00002000:00010000:2.0:1746147148.715809:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396a00 00000100:00100000:0.0:1746147148.722562:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.722609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.722627:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.722667:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163456 00000100:00100000:1.0:1746147148.722670:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163712 00000100:00100000:3.0:1746147148.722678:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163456 00000100:00100000:1.0:1746147148.722678:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163712 00000100:00100000:1.0:1746147148.722716:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163328 00000100:00100000:1.0:1746147148.722719:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163328 00000100:00100000:2.0:1746147148.722784:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14962 00000100:00100000:2.0:1746147148.722796:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308163712:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:0.0:1746147148.722812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.722844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147148.722854:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.722873:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.722873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147148.722882:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 23 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.722888:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.722895:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147148.722896:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163584 00010000:00010000:2.0:1746147148.722897:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.722899:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.722899:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163584 00000100:00100000:1.0:1746147148.722937:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163968 00000100:00100000:1.0:1746147148.722940:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163968 00000100:00100000:3.0:1746147148.722945:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308163840 00000100:00100000:3.0:1746147148.722948:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308163840 00000100:00100000:1.0:1746147148.722955:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14963 00000100:00100000:1.0:1746147148.722961:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308163328:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:3.0:1746147148.722966:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14964 00000100:00100000:3.0:1746147148.722971:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308163456:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147148.722980:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.722990:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.722995:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.722998:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.723004:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723005:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.723009:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.723011:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.723013:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.723013:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.723019:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723024:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.723025:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.723027:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.723038:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723043:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723052:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 19 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.723052:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 43 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.723065:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310745216:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.723065:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310745088:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.723142:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14965 00010000:00010000:2.0:1746147148.723143:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147148.723148:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308163968:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147148.723151:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 13 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.723160:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310745344:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.723166:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723175:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.723239:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723253:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 12 pid: 12201 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.723261:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310745472:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.723266:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723273:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.723279:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.723311:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.723319:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 13 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.723327:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310745600:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.723355:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.723358:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723380:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.723387:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 12 pid: 9585 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.723395:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310745728:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.723577:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 23 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.723591:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 23 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.723600:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310745856:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.723628:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.723640:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.723648:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310745984:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.723698:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.723707:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 29 pid: 12201 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.723709:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14966 00010000:00010000:1.0:1746147148.723713:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.723715:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310746112:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.723716:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308163840:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147148.723722:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.723729:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310746240:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.723732:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b780 going to sleep for 11 seconds 00010000:00010000:0.0:1746147148.723733:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723743:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.723745:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00010000:00010000:0.0:1746147148.723750:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.723756:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.723758:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14967 00010000:00010000:0.0:1746147148.723763:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.723764:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308163584:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147148.723773:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147148.723775:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147148.723776:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.723783:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.723784:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723789:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.723790:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.723794:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723796:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.723798:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310746368:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.723801:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147148.723804:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310746496:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.723808:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723814:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.723815:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.723816:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.723818:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.723820:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.723834:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 19 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.723838:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.723842:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310746624:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.723845:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147148.723845:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310746752:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.723853:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.723856:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.723861:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310746880:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.723861:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.723870:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 13 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.723882:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310747008:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.723885:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.723893:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 12 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.723901:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310747136:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.723916:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.723924:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.723927:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.723931:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.723935:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310747264:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.723945:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310747392:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.723948:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.723960:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.724005:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.739980:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310745344:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.740156:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.740191:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.740205:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.740227:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164864 00000100:00100000:0.0:1746147148.740233:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164864 00010000:00010000:0.0:1746147148.740268:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 44 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.740296:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164096 00000100:00100000:0.0:1746147148.740299:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164096 00010000:00010000:0.0:1746147148.740318:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.740332:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164352 00000100:00100000:0.0:1746147148.740335:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164352 00010000:00010000:0.0:1746147148.740345:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 24 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.740360:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6623 00000100:00100000:0.0:1746147148.740367:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967308164864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.740380:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.740399:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 44 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.740410:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 44 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.740436:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.740475:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967308164864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.740482:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310745856:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.740482:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6623 00000100:00100000:2.0:1746147148.740495:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310745984:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.740498:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6624 00000100:00100000:0.0:1746147148.740502:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308164096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.740510:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.740520:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.740520:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.740528:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 20 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.740540:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.740554:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308164096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.740558:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6624 00000100:00100000:0.0:1746147148.740567:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6625 00000100:00100000:0.0:1746147148.740571:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308164352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.740577:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.740585:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 24 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.740592:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 24 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.740604:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d98e00/0x31399394250574ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7888f expref: 24 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.740709:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81800/0x3139939425056e3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7840c expref: 19 pid: 1136 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.740717:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310745728:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.740725:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310745216:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.740750:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e04000/0x313993942505733c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7874d expref: 43 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.740754:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310745472:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.740763:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310746112:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.740763:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310745088:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147148.740763:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.740771:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310745600:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.740780:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2001:x1830967308164352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 208us (573us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147148.740781:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.740786:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6625 00000100:00100000:1.0:1746147148.740998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.741038:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164608 00000100:00100000:1.0:1746147148.741038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.741041:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164608 00000100:00100000:1.0:1746147148.741066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.741078:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164992 00000100:00100000:1.0:1746147148.741078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.741082:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164992 00010000:00010000:2.0:1746147148.741115:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 30 pid: 12201 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.741121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.741133:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164224 00000100:00100000:1.0:1746147148.741136:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164224 00000100:00100000:2.0:1746147148.741138:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164480 00000100:00100000:2.0:1746147148.741140:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164480 00010000:00010000:1.0:1746147148.741148:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 15 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741151:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 13 pid: 12201 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.741159:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308164736 00000100:00100000:1.0:1746147148.741160:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308164736 00000100:00100000:2.0:1746147148.741163:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6626 00000100:00100000:2.0:1746147148.741168:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308164992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.741168:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 14 pid: 9585 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741175:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147148.741177:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6627 00000100:00100000:1.0:1746147148.741181:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308164224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.741183:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 30 pid: 12201 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.741187:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.741191:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 30 pid: 12201 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.741194:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 15 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.741201:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 15 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741204:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c1a00/0x3139939425056e26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e783f7 expref: 30 pid: 12201 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.741211:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99400/0x31399394250574bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78865 expref: 15 pid: 1136 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741217:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147148.741218:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.741234:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308164224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.741237:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308164992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.741239:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6627 00000100:00100000:2.0:1746147148.741243:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6626 00000100:00100000:1.0:1746147148.741249:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6628 00000100:00100000:1.0:1746147148.741253:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308164480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147148.741254:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6629 00010000:00010000:1.0:1746147148.741258:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147148.741259:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308164736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.741263:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 14 pid: 12201 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741265:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.741270:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 14 pid: 12201 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741274:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 14 pid: 9585 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741281:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 14 pid: 9585 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.741285:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x3139939425056fc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7851d expref: 14 pid: 12201 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.741291:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x31399394250574b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78873 expref: 13 pid: 9585 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.741292:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.741293:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.741297:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741299:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147148.741304:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.741315:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308164736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.741319:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6629 00010000:00010000:1.0:1746147148.741319:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.741331:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308164480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.741335:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6628 00010000:00010000:2.0:1746147148.741341:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741348:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.741354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.741361:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165120 00010000:00010000:2.0:1746147148.741362:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.741363:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165120 00010000:00010000:2.0:1746147148.741368:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.741371:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.741374:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741386:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d98c00 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:1.0:1746147148.741388:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6630 00010000:00010000:2.0:1746147148.741389:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.741392:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308165120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.741396:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.741398:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.741403:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.741406:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741411:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425057518 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.741415:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.741424:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425057462 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7882d expref: 43 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.741430:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.741431:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.741433:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.741439:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.741447:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.741452:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308163456:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 18480us (18901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.741458:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308165120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.741459:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14964 00000100:00100000:1.0:1746147148.741463:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6630 00010000:00010000:2.0:1746147148.741477:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741483:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741495:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.741499:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967310746240:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.741501:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741507:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741512:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147148.741515:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.741518:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741521:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741529:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.741535:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x313993942505750a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.741551:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310746368:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.741570:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308163712:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 18777us (18960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.741575:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14962 00000100:00100000:1.0:1746147148.741585:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310746496:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.741617:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967310746624:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.741632:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.741648:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310746752:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.741672:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310746880:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.741861:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310747008:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.741885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147148.742024:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 12 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.742188:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165248 00000100:00100000:0.0:1746147148.742192:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165248 00000100:00100000:3.0:1746147148.742193:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6631 00000100:00100000:3.0:1746147148.742200:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308164608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.742208:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.742209:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 42 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.742218:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 12 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.742227:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 12 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.742231:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6632 00000100:00100000:0.0:1746147148.742236:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308165248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.742240:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6800/0x3139939425057374 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78770 expref: 12 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746147148.742241:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.742249:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 42 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.742254:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147148.742256:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 42 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.742266:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0dc00/0x31399394250573f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e787e0 expref: 42 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.742275:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.742276:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308164608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.742281:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6631 00000100:00100000:1.0:1746147148.742284:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.742299:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165504 00000100:00100000:1.0:1746147148.742302:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165504 00010000:00010000:1.0:1746147148.742313:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 11 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.742342:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6633 00000100:00100000:1.0:1746147148.742347:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308165504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.742354:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.742361:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 11 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.742368:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 11 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.742379:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1a00/0x31399394250574af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7886c expref: 11 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.742392:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.742406:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308165504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.742411:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6633 00000100:00100000:0.0:1746147148.742501:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308165248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 106us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.742508:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6632 00000100:00100000:3.0:1746147148.742557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.742566:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165632 00000100:00100000:0.0:1746147148.742569:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165632 00000100:00100000:3.0:1746147148.742576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147148.742580:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.742585:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165376 00000100:00100000:3.0:1746147148.742588:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165376 00000100:00100000:0.0:1746147148.742599:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6634 00010000:00010000:3.0:1746147148.742600:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.742604:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308165632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.742611:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147148.742616:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6635 00010000:00010000:0.0:1746147148.742619:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.742621:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308165376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.742626:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.742627:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746147148.742631:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.742636:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147148.742639:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.742639:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x31399394250571a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7862e expref: 19 pid: 12225 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.742645:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165760 00000100:00100000:3.0:1746147148.742647:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165760 00010000:00010000:1.0:1746147148.742648:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f391400/0x3139939425057327 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78738 expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.742648:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147148.742655:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.742656:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.742657:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.742660:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.742665:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967308165632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (108us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147148.742666:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.742670:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6636 00000100:00100000:0.0:1746147148.742673:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6634 00000100:00100000:3.0:1746147148.742675:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308165760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.742681:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.742688:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.742691:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147148.742700:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.742705:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308165376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (128us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147148.742710:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x31399394250574a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7885e expref: 23 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.742711:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6635 00000100:00100000:0.0:1746147148.742713:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310747136:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.742718:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147148.742723:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.742730:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.742734:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967308165760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.742740:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6636 00010000:00010000:1.0:1746147148.742742:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.742748:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.742754:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.742760:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a3600 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:0.0:1746147148.742760:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310747392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.742763:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.742766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147148.742769:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.742776:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308165888 00010000:00010000:1.0:1746147148.742777:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.742779:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308165888 00010000:00010000:0.0:1746147148.742779:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.742782:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x3139939425057511 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.742789:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 10 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.742802:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6637 00000100:00100000:3.0:1746147148.742806:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2003:x1830967308165888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.742812:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147148.742812:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308163328:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 19850us (20183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.742813:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.742818:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14963 00010000:00010000:3.0:1746147148.742819:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 10 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.742836:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166016 00010000:00010000:3.0:1746147148.742838:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 10 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746147148.742838:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166016 00010000:00010000:0.0:1746147148.742848:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 18 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.742851:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db80c00/0x31399394250571d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7864a expref: 10 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.742852:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310747264:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.742860:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147148.742861:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6638 00000100:00100000:0.0:1746147148.742865:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308166016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.742868:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.742871:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147148.742874:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2003:x1830967308165888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (107us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147148.742877:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 18 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.742879:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6637 00010000:00010000:0.0:1746147148.742885:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 18 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.742891:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147148.742895:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425057485 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78850 expref: 18 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.742903:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.742907:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166144 00000100:00100000:3.0:1746147148.742910:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166144 00000100:00100000:1.0:1746147148.742916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.742916:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308166016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (102us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147148.742919:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.742921:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6638 00000100:00100000:1.0:1746147148.742926:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166272 00000100:00100000:1.0:1746147148.742928:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166272 00000100:00100000:3.0:1746147148.742930:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6639 00000100:00100000:3.0:1746147148.742935:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308166144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.742937:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 41 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.742941:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.742947:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.742955:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.742956:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6640 00000100:00100000:1.0:1746147148.742960:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967308166272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.742965:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98a00/0x31399394250574d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78881 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.742966:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.742973:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.742973:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 41 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.742973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147148.742975:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.742978:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.742981:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 41 pid: 12225 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.742982:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166400 00010000:00010000:3.0:1746147148.742984:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.742984:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166400 00010000:00010000:1.0:1746147148.742991:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x313993942505747e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78849 expref: 41 pid: 12225 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.742992:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.742998:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147148.743003:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147148.743004:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6641 00010000:00010000:1.0:1746147148.743005:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.743007:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.743008:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308166400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147148.743011:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308166144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (119us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147148.743013:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.743014:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.743016:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6639 00010000:00010000:0.0:1746147148.743019:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 29 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.743024:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147148.743027:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 28 pid: 1136 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.743037:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092562c00/0x3139939425057198 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78627 expref: 28 pid: 1136 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.743038:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967308166272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (121us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147148.743043:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.743043:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6640 00010000:00010000:3.0:1746147148.743049:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743050:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.743051:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.743054:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743059:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.743060:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.743066:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743066:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743070:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147148.743072:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743072:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.743077:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f588c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147148.743079:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743082:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.743082:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308166400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.743087:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6641 00010000:00010000:1.0:1746147148.743109:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.743114:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743116:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.743123:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743125:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f381800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147148.743128:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x313993942505751f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743128:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743131:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743134:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743137:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743143:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743147:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.743148:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425057526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743152:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743157:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.743158:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308163968:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 20010us (20313us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147148.743162:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c6400 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:3.0:1746147148.743164:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14965 00010000:00010000:0.0:1746147148.743164:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743170:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.743176:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308163840:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 19461us (20303us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147148.743177:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.743181:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14966 00010000:00010000:0.0:1746147148.743196:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6400/0x313993942505752d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.743227:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2001:x1830967308163584:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 19463us (20415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.743232:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14967 00000100:00100000:1.0:1746147148.743238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.743253:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166528 00000100:00100000:0.0:1746147148.743256:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166528 00000100:00100000:0.0:1746147148.743278:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14968 00000100:00100000:0.0:1746147148.743283:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32558:x1830967308166528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.743296:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.743307:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7889d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147148.743318:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x6814174c, atime: 0x6814174c, ctime: 0x6814174c, blocks: 0x1590 00010000:00010000:0.0:1746147148.743327:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.743329:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.743333:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743343:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.743350:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4200, rc 0) 00000100:00100000:0.0:1746147148.743365:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32558:x1830967308166528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 82us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.743369:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14968 00000100:00100000:1.0:1746147148.746720:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.746818:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166784 00000100:00100000:2.0:1746147148.746839:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166784 00000100:00100000:2.0:1746147148.747258:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15373 00000100:00100000:2.0:1746147148.747269:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+30:32562:x1830967308166784:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147148.747327:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.747354:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x31399394250574e7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78888 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747376:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.747381:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147148.747410:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.747422:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 68 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747429:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747435:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 41 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747442:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 41 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747448:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 68 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747454:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 41 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747460:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 68 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747467:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 10/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.747503:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 68 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747515:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 68 pid: 7238 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747529:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747520:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.747636:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 41 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747644:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 41 pid: 9138 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747652:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747648:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.747678:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 68 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747686:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 68 pid: 9138 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747692:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747776:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.747714:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 41 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747721:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 41 pid: 16099 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747731:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747904:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.747751:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 41 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747758:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 41 pid: 9138 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747766:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310748032:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.747787:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 41 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747795:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 41 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747802:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310748160:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147148.747835:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 68 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.747843:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 68 pid: 6215 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.747850:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310748288:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.747870:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.748651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.749509:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.749530:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.749538:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308166912 00000100:00100000:3.0:1746147148.749546:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308166912 00000100:00100000:2.0:1746147148.749633:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167168 00000100:00100000:2.0:1746147148.749637:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167168 00000100:00100000:0.0:1746147148.750315:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167424 00000100:00100000:0.0:1746147148.750321:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167424 00000100:00100000:3.0:1746147148.750325:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14969 00000100:00100000:3.0:1746147148.750335:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308166912:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147148.750346:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14970 00000100:00100000:0.0:1746147148.750351:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308167168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.750353:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.750360:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.750376:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788a4 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.750376:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788b2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147148.750398:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814174b, atime: 0x6814174b, ctime: 0x6814174b, blocks: 0x7c8 00002000:00010000:0.0:1746147148.750398:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814174b, atime: 0x6814174b, ctime: 0x6814174b, blocks: 0x808 00010000:00010000:3.0:1746147148.750415:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.750415:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.750417:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.750418:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.750426:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 42 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.750426:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.750441:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.750442:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 42 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147148.750451:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182400, rc 0) 00010000:00010000:0.0:1746147148.750451:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4600, rc 0) 00000100:00100000:1.0:1746147148.750543:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14971 00000100:00100000:1.0:1746147148.750551:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308167424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.750558:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.750568:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788c0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147148.750580:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x6814174c, atime: 0x6814174c, ctime: 0x6814174c, blocks: 0x1008 00010000:00010000:1.0:1746147148.750589:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.750591:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.750595:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.750604:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.750611:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0600, rc 0) 00000100:00100000:3.0:1746147148.750760:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308166912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 425us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.750767:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14969 00000100:00100000:0.0:1746147148.751163:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308167168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 810us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.751167:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308167424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 616us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.751169:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14970 00000100:00100000:1.0:1746147148.751174:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14971 00000100:00100000:2.0:1746147148.751402:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.751437:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.751544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.751564:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167680 00000100:00100000:2.0:1746147148.751568:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167680 00000100:00100000:2.0:1746147148.751592:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5535 00000100:00100000:2.0:1746147148.751597:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+42:30749:x1830967308167680:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147148.751752:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+43:30749:x1830967308167680:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 155us (208us total) trans 8589936089 rc 0/0 00000100:00100000:2.0:1746147148.751758:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5535 00000100:00100000:1.0:1746147148.751986:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167040 00000100:00100000:1.0:1746147148.751990:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167040 00000100:00100000:1.0:1746147148.752008:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167296 00000100:00100000:1.0:1746147148.752010:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167296 00000100:00100000:1.0:1746147148.752022:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14972 00000100:00100000:1.0:1746147148.752026:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967308167040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.752034:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.752047:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788ab expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147148.752062:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x68141749, atime: 0x68141749, ctime: 0x68141749, blocks: 0x808 00010000:00010000:1.0:1746147148.752073:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.752074:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.752080:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.752117:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.752125:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0800, rc 0) 00000100:00100000:3.0:1746147148.752130:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747520:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.752142:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747648:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.752149:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308167040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 121us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.752151:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.752155:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14972 00000100:00100000:3.0:1746147148.752157:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310747904:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.752166:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14973 00000100:00100000:1.0:1746147148.752171:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308167296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.752178:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.752187:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788b9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147148.752200:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814174c, atime: 0x6814174c, ctime: 0x6814174c, blocks: 0x800 00010000:00010000:1.0:1746147148.752209:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.752211:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.752215:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.752224:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.752231:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0c00, rc 0) 00000100:00100000:1.0:1746147148.752246:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308167296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 75us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.752254:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14973 00000100:00100000:0.0:1746147148.752860:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310748032:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.753413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.753580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.753595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.753607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.753637:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.753653:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167936 00000100:00100000:3.0:1746147148.753657:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167936 00010000:00010000:3.0:1746147148.753683:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 69 pid: 9138 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.753701:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168192 00000100:00100000:3.0:1746147148.753703:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168192 00010000:00010000:3.0:1746147148.753710:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 43 pid: 9138 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.753718:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308167808 00000100:00100000:3.0:1746147148.753720:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308167808 00010000:00010000:3.0:1746147148.753726:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 70 pid: 7238 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.753732:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168064 00000100:00100000:3.0:1746147148.753734:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168064 00010000:00010000:3.0:1746147148.753739:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 44 pid: 16099 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.753745:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168320 00000100:00100000:3.0:1746147148.753747:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168320 00010000:00010000:3.0:1746147148.753753:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 45 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.753761:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6642 00000100:00100000:3.0:1746147148.753765:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+70:2001:x1830967308167936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.753775:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.753780:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 70 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753789:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 70 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753807:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425056892 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780f5 expref: 70 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753829:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.753834:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.753844:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.753868:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+69:2001:x1830967308167936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.753873:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6642 00000100:00100000:3.0:1746147148.753884:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6643 00000100:00100000:3.0:1746147148.753888:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+45:2001:x1830967308168192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.753894:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.753897:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 45 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753904:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 45 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753914:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425056868 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d2 expref: 45 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753921:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.753924:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.753928:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.753938:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+44:2001:x1830967308168192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.753943:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6643 00000100:00100000:3.0:1746147148.753950:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6644 00000100:00100000:3.0:1746147148.753953:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+68:2001:x1830967308167808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.753960:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.753963:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 68 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753969:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 68 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753977:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x31399394250572a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e786dd expref: 68 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.753984:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.753986:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.753990:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.753998:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:2001:x1830967308167808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.754001:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6644 00000100:00100000:3.0:1746147148.754007:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6645 00000100:00100000:3.0:1746147148.754010:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+43:2001:x1830967308168064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.754015:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.754017:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 43 pid: 16099 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754024:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 43 pid: 16099 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754031:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x313993942505686f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e780d9 expref: 43 pid: 16099 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754037:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.754039:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.754042:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.754050:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+42:2001:x1830967308168064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.754054:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6645 00000100:00100000:3.0:1746147148.754059:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6646 00000100:00100000:3.0:1746147148.754063:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+41:2001:x1830967308168320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.754068:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.754071:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 41 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754077:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 41 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754084:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.754104:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.754110:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.754123:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+41:2001:x1830967308168320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.754128:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6646 00000100:00100000:3.0:1746147148.754193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.754205:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168448 00000100:00100000:3.0:1746147148.754208:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168448 00010000:00010000:3.0:1746147148.754219:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 67 pid: 6215 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.754232:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6647 00000100:00100000:3.0:1746147148.754236:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:2001:x1830967308168448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.754242:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.754245:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 67 pid: 6215 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754251:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 67 pid: 6215 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.754260:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.754263:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.754268:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.754280:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+67:2001:x1830967308168448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.754284:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6647 00010000:00010000:3.0:1746147148.754414:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425056be8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e782e6 expref: 40 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.754424:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310748160:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.754432:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425056a60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78206 expref: 66 pid: 6215 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.754439:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310748288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.754474:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:3.0:1746147148.755172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.755216:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168576 00000100:00100000:2.0:1746147148.755221:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168576 00010000:00010000:2.0:1746147148.755241:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 40 pid: 9138 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746147148.755269:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6648 00000100:00100000:2.0:1746147148.755275:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+40:2001:x1830967308168576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.755283:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147148.755286:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 40 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.755294:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 40 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.755306:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x31399394250569bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e781ab expref: 40 pid: 9138 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.755315:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.755318:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.755324:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.755331:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147148.755365:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.755391:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+39:2001:x1830967308168576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.755398:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6648 00010000:00010000:3.0:1746147148.755637:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.755646:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000040:00080000:3.0:1746147148.755965:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].605, 88 off61304 00000004:00080000:3.0:1746147148.755973:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686745882692ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.756657:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].540, 88 off55576 00000004:00080000:3.0:1746147148.756665:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686746575002ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.756693:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].541, 88 off55664 00000004:00080000:3.0:1746147148.756696:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686746606641ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.756706:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].606, 88 off61392 00000004:00080000:3.0:1746147148.756709:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686746619327ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757001:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].607, 88 off61480 00000004:00080000:3.0:1746147148.757006:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686746916095ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757020:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].542, 88 off55752 00000004:00080000:3.0:1746147148.757022:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686746933076ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.757039:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].543, 88 off55840 00000004:00080000:3.0:1746147148.757042:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686746952821ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.757054:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].544, 88 off55928 00000004:00080000:3.0:1746147148.757059:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686746969630ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.757210:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].608, 88 off61568 00000004:00080000:3.0:1746147148.757214:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686747124280ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757226:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].545, 88 off56016 00000004:00080000:3.0:1746147148.757229:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686747139931ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.757238:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].609, 88 off61656 00000004:00080000:3.0:1746147148.757241:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686747151602ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757248:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].546, 88 off56104 00000004:00080000:3.0:1746147148.757251:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686747161302ns, next at 554081490131ns, rc = 0 00000040:00080000:3.0:1746147148.757257:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].610, 88 off61744 00000004:00080000:3.0:1746147148.757260:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686747170175ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757267:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].611, 88 off61832 00000004:00080000:3.0:1746147148.757270:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686747180006ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757277:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].612, 88 off61920 00000004:00080000:3.0:1746147148.757280:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686747190238ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757285:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].613, 88 off62008 00000004:00080000:3.0:1746147148.757287:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686747198036ns, next at 554081470618ns, rc = 0 00000040:00080000:3.0:1746147148.757294:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].547, 88 off56192 00000004:00080000:3.0:1746147148.757296:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686747206412ns, next at 554081490131ns, rc = 0 00000100:00100000:0.0:1746147148.758464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.759125:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168832 00000100:00100000:2.0:1746147148.759134:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168832 00002000:00100000:2.0:1746147148.759185:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095235f80 x1830967308168832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.759196:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235f80 with x1830967308168832 ext(4194304->4919295) 00002000:00010000:2.0:1746147148.759202:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095235f80 00000100:00100000:2.0:1746147148.759242:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3715 00000100:00100000:2.0:1746147148.759251:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308168832:12345-192.168.204.25@tcp:3:cat.0 00000001:00080000:2.0:1746147148.768068:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936090 is committed 00000004:00080000:2.0:1746147148.768081:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 542 committed 00000004:00080000:2.0:1746147148.768105:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 605 committed 00000004:00080000:2.0:1746147148.768119:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 604 committed 00000004:00080000:2.0:1746147148.768121:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 603 committed 00000004:00080000:2.0:1746147148.768123:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 602 committed 00000004:00080000:2.0:1746147148.768124:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 541 committed 00000004:00080000:2.0:1746147148.768126:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 601 committed 00000004:00080000:2.0:1746147148.768127:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 540 committed 00000004:00080000:2.0:1746147148.768129:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 600 committed 00000004:00080000:2.0:1746147148.768131:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 539 committed 00000004:00080000:2.0:1746147148.768133:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 538 committed 00000004:00080000:2.0:1746147148.768135:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 537 committed 00000004:00080000:2.0:1746147148.768137:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 599 committed 00000004:00080000:2.0:1746147148.768138:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 598 committed 00000004:00080000:2.0:1746147148.768140:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 536 committed 00000004:00080000:2.0:1746147148.768142:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 535 committed 00000004:00080000:2.0:1746147148.768143:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 597 committed 00000100:00100000:1.0:1746147148.768247:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1746147148.768266:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147148.768271:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310748416:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147148.768278:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147148.768285:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147148.768290:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147148.768295:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147148.768300:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147148.768308:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310748672:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147148.768321:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.768324:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147148.768327:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147148.768462:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425056876 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147148.768492:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310748928:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1746147148.768610:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936089 is committed 00000001:00080000:2.0:1746147148.768621:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936086 is committed 00000100:00100000:1.0:1746147148.768980:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.769023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.769030:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310748800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.769049:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310749184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.769051:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.769067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.769069:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310749312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.769105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.769106:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746147148.769113:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310748544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.769123:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147148.769128:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310749440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.769131:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.769149:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.769149:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310749056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.769168:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.769185:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310748416 00000100:00100000:1.0:1746147148.769190:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310748416 00000100:00100000:0.0:1746147148.769192:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310749568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.769205:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746147148.769208:0:7239:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094e58e00 reply state ffff88009522ec00 transno 8589936090 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.769221:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.769228:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:1.0:1746147148.769229:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310748672 00010000:00010000:3.0:1746147148.769230:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147148.769231:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310748672 00000100:00100000:3.0:1746147148.769233:0:7239:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147148.769233:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310748800 00000100:00100000:0.0:1746147148.769238:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310748800 00000100:00100000:1.0:1746147148.769240:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749184 00000100:00100000:1.0:1746147148.769242:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749184 00000100:00100000:1.0:1746147148.769249:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749312 00000100:00100000:1.0:1746147148.769250:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749312 00000100:00100000:1.0:1746147148.769258:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310748544 00000100:00100000:1.0:1746147148.769259:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310748544 00000100:00100000:0.0:1746147148.769260:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749440 00000100:00100000:0.0:1746147148.769263:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749440 00000100:00100000:1.0:1746147148.769266:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749056 00000100:00100000:1.0:1746147148.769267:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749056 00000100:00100000:1.0:1746147148.769272:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749568 00000100:00100000:1.0:1746147148.769274:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749568 00000100:00100000:0.0:1746147148.769279:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14974 00000100:00100000:3.0:1746147148.769283:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.769285:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967310748416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.769286:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14975 00000100:00100000:1.0:1746147148.769292:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3765:x1830967310748672:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746147148.769377:0:7239:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147148.769380:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310748928 00000100:00100000:0.0:1746147148.769383:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310748928 00000100:00100000:3.0:1746147148.769390:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308166784:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 22120us (22679us total) trans 8589936090 rc 0/0 00002000:00010000:1.0:1746147148.769397:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00000100:00100000:0.0:1746147148.769397:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14976 00000100:00100000:3.0:1746147148.769398:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15373 00002000:00010000:1.0:1746147148.769400:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.769402:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00000100:00100000:0.0:1746147148.769402:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310749184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147148.769404:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.769405:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00010000:00010000:3.0:1746147148.769420:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.769426:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147148.769426:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310748672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (405us total) trans 17179874263 rc 0/0 00010000:00010000:3.0:1746147148.769431:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147148.769431:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14975 00010000:00010000:3.0:1746147148.769440:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03d600 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:1.0:1746147148.769442:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14977 00010000:00010000:3.0:1746147148.769443:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147148.769445:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3766:x1830967310748800:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147148.769449:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.769456:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.769458:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147148.769460:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00002000:00010000:0.0:1746147148.769460:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147148.769463:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00010000:00010000:3.0:1746147148.769465:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x313993942505753b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00002000:00010000:0.0:1746147148.769465:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.769466:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147148.769468:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147148.769492:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310749184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (424us total) trans 17179874265 rc 0/0 00000100:00100000:1.0:1746147148.769495:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3766:x1830967310748800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (443us total) trans 17179874266 rc 0/0 00000100:00100000:0.0:1746147148.769498:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14976 00000100:00100000:1.0:1746147148.769501:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14977 00000100:00100000:1.0:1746147148.769512:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14978 00000100:00100000:0.0:1746147148.769515:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14979 00000100:00100000:1.0:1746147148.769516:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310749312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.769520:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310748544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147148.769547:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:1.0:1746147148.769549:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147148.769551:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147148.769553:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147148.769554:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:1.0:1746147148.769569:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3766:x1830967310749312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (480us total) trans 17179874267 rc 0/0 00000100:00100000:1.0:1746147148.769574:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14978 00000100:00100000:1.0:1746147148.769582:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14980 00000100:00100000:1.0:1746147148.769587:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310749056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147148.769588:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14981 00000100:00100000:3.0:1746147148.769596:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3766:x1830967310749440:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746147148.769598:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147148.769602:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147148.769612:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14982 00000100:00100000:1.0:1746147148.769616:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3765:x1830967310749568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.769661:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14983 00000100:00100000:3.0:1746147148.769666:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310748928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147148.769668:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147148.769671:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147147 -> 1746147147 00002000:00010000:1.0:1746147148.769672:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147147 -> 1746147147 00002000:00010000:1.0:1746147148.769674:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147147 -> 1746147147 00002000:00010000:1.0:1746147148.769675:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746147148.769690:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147148.769693:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147145 -> 1746147145 00002000:00010000:3.0:1746147148.769695:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147145 -> 1746147145 00002000:00010000:3.0:1746147148.769697:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147145 -> 1746147145 00002000:00010000:3.0:1746147148.769699:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147148.769705:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967310749568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (487us total) trans 21474841527 rc 0/0 00000100:00100000:1.0:1746147148.769710:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14982 00000100:00100000:3.0:1746147148.769720:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3766:x1830967310749440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (570us total) trans 21474841526 rc 0/0 00000100:00100000:3.0:1746147148.769725:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14981 00000004:00080000:1.0:1746147148.769746:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094187480/2, rc 0, transno 21474841526 00000100:00100000:1.0:1746147148.769752:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310749440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147148.769761:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a0700/2, rc 0, transno 17179874266 00000100:00100000:1.0:1746147148.769768:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310748800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147148.769775:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096898000/2, rc 0, transno 17179874267 00000100:00100000:1.0:1746147148.769777:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310749312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.769805:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147148.769811:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310749696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.769843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147148.769953:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310749824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147148.769975:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147148.770119:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147148.770122:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.770124:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.770126:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.770128:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147148.770153:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310748544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 632us (1020us total) trans 17179874268 rc 0/0 00000100:00100000:0.0:1746147148.770158:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14979 00000100:00100000:3.0:1746147148.770373:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310749952:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147148.771181:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147148.771185:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147147 -> 1746147147 00002000:00010000:3.0:1746147148.771187:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147147 -> 1746147147 00002000:00010000:3.0:1746147148.771188:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147147 -> 1746147147 00002000:00010000:3.0:1746147148.771190:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:3.0:1746147148.771217:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310748416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1931us (2237us total) trans 17179874264 rc 0/0 00000100:00100000:3.0:1746147148.771223:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14974 00000100:00100000:3.0:1746147148.771348:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749696 00000100:00100000:3.0:1746147148.771353:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749696 00000100:00100000:2.0:1746147148.771366:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310750336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.771372:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749824 00000100:00100000:3.0:1746147148.771374:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749824 00000100:00100000:3.0:1746147148.771385:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14984 00000100:00100000:2.0:1746147148.771386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.771390:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967310749696:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147148.771408:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095237800/2, rc 0, transno 17179874264 00000100:00100000:2.0:1746147148.771412:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310748416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.771417:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310750080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147148.771427:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310750336 00000100:00100000:2.0:1746147148.771429:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310750336 00000100:00100000:1.0:1746147148.771435:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147148.771441:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310750080 00000100:00100000:1.0:1746147148.771442:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147148.771443:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310750080 00000100:00100000:1.0:1746147148.771446:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310750208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147148.771451:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14985 00000100:00100000:2.0:1746147148.771456:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3766:x1830967310749824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147148.771458:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.771463:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3764:x1830967310749696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1620us total) trans 17179874269 rc 0/0 00000100:00100000:3.0:1746147148.771468:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14984 00000004:00080000:1.0:1746147148.771470:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e59f80/2, rc 0, transno 17179874269 00000100:00100000:1.0:1746147148.771473:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310749696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147148.771477:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310750208 00000100:00100000:3.0:1746147148.771479:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310750208 00000100:00100000:0.0:1746147148.771487:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14986 00000100:00100000:1.0:1746147148.771496:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14987 00000100:00100000:0.0:1746147148.771499:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967310750336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147148.771502:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967310750080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147148.771505:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:3.0:1746147148.771506:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14988 00002000:00010000:2.0:1746147148.771507:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00000100:00100000:3.0:1746147148.771510:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967310750208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147148.771510:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:2.0:1746147148.771512:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:2.0:1746147148.771514:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147148.771535:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967310749824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1559us total) trans 21474841528 rc 0/0 00000100:00100000:2.0:1746147148.771541:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14985 00002000:00010000:3.0:1746147148.771552:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147148.771554:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.771556:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746147148.771557:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147148.771558:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.771560:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:2.0:1746147148.771570:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310750464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.771581:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967310750208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (121us total) trans 21474841529 rc 0/0 00000100:00100000:1.0:1746147148.771581:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967310750080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (144us total) trans 21474841530 rc 0/0 00000100:00100000:2.0:1746147148.771585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.771586:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14987 00000100:00100000:3.0:1746147148.771589:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14988 00000100:00100000:3.0:1746147148.771597:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310749952 00000100:00100000:1.0:1746147148.771598:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310750464 00000100:00100000:3.0:1746147148.771599:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310749952 00000100:00100000:1.0:1746147148.771600:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310750464 00000100:00100000:3.0:1746147148.771610:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14989 00000004:00080000:2.0:1746147148.771610:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096840000/2, rc 0, transno 21474841528 00000100:00100000:3.0:1746147148.771614:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310749952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147148.771614:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310749824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147148.771616:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14990 00000100:00100000:0.0:1746147148.771619:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3766:x1830967310750336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (232us total) trans 21474841531 rc 0/0 00000100:00100000:1.0:1746147148.771620:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310750464:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147148.771622:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096840e00/2, rc 0, transno 21474841531 00000100:00100000:0.0:1746147148.771624:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14986 00000100:00100000:2.0:1746147148.771625:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310750336:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147148.771654:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147148.771656:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.771658:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147148.771660:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.771662:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000004:00080000:0.0:1746147148.771669:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095236a00/2, rc 0, transno 17179874268 00000100:00100000:0.0:1746147148.771672:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310748544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147148.771682:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094185880/2, rc 0, transno 21474841527 00000100:00100000:0.0:1746147148.771684:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310749568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147148.771690:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095236300/2, rc 0, transno 17179874263 00000100:00100000:0.0:1746147148.771692:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310748672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147148.771697:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084000/2, rc 0, transno 17179874265 00000100:00100000:0.0:1746147148.771699:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310749184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147148.771702:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310749952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (143us total) trans 21474841532 rc 0/0 00000100:00100000:1.0:1746147148.771702:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310750464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (114us total) trans 21474841533 rc 0/0 00000100:00100000:3.0:1746147148.771708:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14989 00000100:00100000:1.0:1746147148.771713:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14990 00000004:00080000:1.0:1746147148.771736:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096840a80/2, rc 0, transno 21474841529 00000100:00100000:1.0:1746147148.771740:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310750208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147148.771746:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096840700/2, rc 0, transno 21474841530 00000100:00100000:1.0:1746147148.771749:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310750080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.771773:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310749056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2187us (2605us total) trans 17179874270 rc 0/0 00000100:00100000:0.0:1746147148.771777:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14980 00000004:00080000:1.0:1746147148.771790:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011da9ce00/2, rc 0, transno 17179874270 00000100:00100000:1.0:1746147148.771793:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011da9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310749056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147148.771802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:0.0:1746147148.771816:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00000100:00100000:3.0:1746147148.771817:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308168960 00002000:00010000:0.0:1746147148.771818:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00000100:00100000:3.0:1746147148.771819:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308168960 00002000:00010000:0.0:1746147148.771819:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.771834:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.771837:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147148.771855:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310748928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2189us (2602us total) trans 17179874271 rc 0/0 00000100:00100000:3.0:1746147148.771858:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15374 00000100:00100000:0.0:1746147148.771859:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14983 00000100:00100000:3.0:1746147148.771863:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32562:x1830967308168960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147148.771878:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.771894:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788c7 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.771939:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.771951:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.771972:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.771974:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147148.771977:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03ca00, rc 0) 00000100:00100000:3.0:1746147148.772004:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308168960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 141us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.772010:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15374 00000100:00100000:0.0:1746147148.772040:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967308168832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12789us (13583us total) trans 0 rc 724992/724992 00000100:00100000:0.0:1746147148.772047:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3715 00002000:00100000:0.0:1746147148.772056:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095235f80 x1830967308168832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.772065:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235f80 with x1830967308168832 ext(4194304->4919295) 00002000:00010000:0.0:1746147148.772070:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095235f80 00000004:00080000:2.0:1746147148.772401:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096840380/2, rc 0, transno 21474841532 00000100:00100000:2.0:1746147148.772406:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310749952:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147148.772413:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096841180/2, rc 0, transno 21474841533 00000100:00100000:2.0:1746147148.772415:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310750464:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147148.772423:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a1f80/2, rc 0, transno 17179874271 00000100:00100000:2.0:1746147148.772425:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310748928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.776250:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.776347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.776496:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169088 00000100:00100000:1.0:1746147148.776507:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169088 00000100:00100000:1.0:1746147148.776546:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169216 00000100:00100000:1.0:1746147148.776548:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169216 00000100:00100000:1.0:1746147148.776572:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15375 00000100:00100000:0.0:1746147148.776578:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15376 00000100:00100000:1.0:1746147148.776580:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308169088:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147148.776587:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32558:x1830967308169216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.776599:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.776600:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.776619:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966200/0x3139939425057573 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788ce expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.776619:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x313993942505756c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788d5 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.776677:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x313993942505756c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788d5 expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.776691:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x313993942505756c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788d5 expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.776704:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966000/0x313993942505757a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.776710:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147148.776713:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147148.776716:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182c00, rc 0) 00000100:00100000:0.0:1746147148.776769:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32558:x1830967308169216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 184us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.776776:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15376 00010000:00010000:1.0:1746147148.777325:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966000/0x313993942505757a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.777337:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966000/0x313993942505757a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147148.777367:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147148.777370:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147148.777386:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966000/0x313993942505757a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.777443:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966200/0x3139939425057573 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ce expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.777624:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966000/0x313993942505757a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ce expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.777631:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.777634:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147148.777636:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f966000, rc 0) 00000100:00100000:1.0:1746147148.777673:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32562:x1830967308169088:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1094us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.777680:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15375 00000100:00100000:0.0:1746147148.780412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.780449:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.780488:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.780491:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169344 00000100:00100000:0.0:1746147148.780540:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169600 00000100:00100000:0.0:1746147148.780549:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169600 00000100:00100000:0.0:1746147148.780638:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14991 00000100:00100000:0.0:1746147148.780647:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:2001:x1830967308169600:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147148.780665:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.780688:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788ea expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.780712:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.780714:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.780723:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 8 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.780738:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 8 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.780749:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0a00, rc 0) 00000100:00100000:0.0:1746147148.780788:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308169600:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 142us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.780794:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14991 00000100:00100000:0.0:1746147148.780853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.780867:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169856 00000100:00100000:0.0:1746147148.780870:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169856 00000100:00100000:0.0:1746147148.780886:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14992 00000100:00100000:0.0:1746147148.780890:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308169856:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147148.780898:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.780909:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788f8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.780920:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.780922:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.780926:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.780936:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.780950:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542200, rc 0) 00000100:00100000:0.0:1746147148.780964:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308169856:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 74us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.780969:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14992 00000100:00100000:0.0:1746147148.781017:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.781026:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169472 00000100:00100000:0.0:1746147148.781029:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169472 00000100:00100000:0.0:1746147148.781042:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14993 00000100:00100000:0.0:1746147148.781048:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308169472:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147148.781054:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147148.781062:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308170240 00010000:00010000:0.0:1746147148.781063:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788e3 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.781067:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308170240 00010000:00010000:0.0:1746147148.781073:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.781075:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.781079:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.781110:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.781117:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008e00, rc 0) 00002000:00100000:2.0:1746147148.781118:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff880096899180 x1830967308170240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.781127:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899180 with x1830967308170240 ext(4915200->4919295) 00002000:00010000:2.0:1746147148.781132:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096899180 00000100:00100000:0.0:1746147148.781133:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308169472:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 84us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.781137:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14993 00000100:00100000:2.0:1746147148.781162:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3716 00000100:00100000:0.0:1746147148.781168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.781169:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967308170240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.781178:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169728 00000100:00100000:0.0:1746147148.781180:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169728 00000100:00100000:0.0:1746147148.781191:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14994 00000100:00100000:0.0:1746147148.781195:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308169728:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147148.781200:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.781207:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788f1 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.781217:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.781219:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.781222:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.781230:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.781236:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008a00, rc 0) 00000100:00100000:0.0:1746147148.781249:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308169728:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 54us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.781254:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169344 00000100:00100000:0.0:1746147148.781254:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14994 00000100:00100000:1.0:1746147148.781283:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14995 00000100:00100000:1.0:1746147148.781289:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308169344:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147148.781298:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.781306:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788dc expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.781315:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.781317:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.781320:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.781327:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 11 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.781332:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3600, rc 0) 00000100:00100000:1.0:1746147148.781602:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308169344:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 312us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.781607:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14995 00000100:00100000:2.0:1746147148.781611:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967308170240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 441us (1207us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147148.781617:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3716 00002000:00100000:2.0:1746147148.781623:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff880096899180 x1830967308170240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.781631:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899180 with x1830967308170240 ext(4915200->4919295) 00002000:00010000:2.0:1746147148.781634:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096899180 00000100:00100000:0.0:1746147148.781733:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.781914:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308169984 00000100:00100000:1.0:1746147148.781918:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308169984 00000100:00100000:1.0:1746147148.781939:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14996 00000100:00100000:1.0:1746147148.781944:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308169984:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147148.781951:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.781959:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e788ff expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.781970:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.781972:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.781976:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.781986:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.781993:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3800, rc 0) 00000100:00100000:1.0:1746147148.782025:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308169984:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.782032:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14996 00000100:00100000:0.0:1746147148.787270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.787484:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308170496 00000100:00100000:1.0:1746147148.787492:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308170496 00000100:00100000:1.0:1746147148.787886:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15377 00000100:00100000:1.0:1746147148.787896:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32566:x1830967308170496:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147148.787917:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.787935:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x31399394250575ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78906 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.788008:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788020:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788029:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788040:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788048:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788053:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788179:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788190:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.788196:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.788225:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.788238:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 8 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.788309:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310750592:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.788633:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.789027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.789060:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.789256:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308170752 00000100:00100000:2.0:1746147148.789261:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171008 00000100:00100000:1.0:1746147148.789261:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308170752 00000100:00100000:2.0:1746147148.789266:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171008 00000100:00100000:0.0:1746147148.789274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.789303:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171264 00000100:00100000:2.0:1746147148.789305:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171264 00000100:00100000:1.0:1746147148.789309:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14997 00000100:00100000:1.0:1746147148.789316:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308171008:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147148.789316:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14998 00000100:00100000:0.0:1746147148.789324:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308170752:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147148.789332:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14999 00000100:00100000:2.0:1746147148.789337:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308171264:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147148.789402:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308171008:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.789402:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308170752:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.789405:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308171264:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.789408:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14998 00000100:00100000:1.0:1746147148.789412:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14997 00000100:00100000:2.0:1746147148.789415:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14999 00000100:00100000:1.0:1746147148.789441:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.789482:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308170624 00000100:00100000:3.0:1746147148.789486:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308170624 00000100:00100000:3.0:1746147148.789509:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15000 00000100:00100000:3.0:1746147148.789518:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308170624:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147148.789569:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308170624:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.789574:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15000 00000100:00100000:1.0:1746147148.789577:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.789597:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308170880 00000100:00100000:3.0:1746147148.789599:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308170880 00000100:00100000:3.0:1746147148.789610:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15001 00000100:00100000:3.0:1746147148.789614:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308170880:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147148.789641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.789648:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308170880:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 33us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.789653:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15001 00000100:00100000:1.0:1746147148.789656:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171136 00000100:00100000:1.0:1746147148.789659:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171136 00000100:00100000:1.0:1746147148.789674:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15002 00000100:00100000:1.0:1746147148.789678:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308171136:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147148.789694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.789712:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171520 00000100:00100000:1.0:1746147148.789713:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308171136:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 34us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.789716:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171520 00000100:00100000:1.0:1746147148.789717:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15002 00000100:00100000:2.0:1746147148.789741:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5536 00000100:00100000:2.0:1746147148.789747:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32558:x1830967308171520:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147148.789938:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32558:x1830967308171520:12345-192.168.204.25@tcp:35:cat.0 Request processed in 190us (243us total) trans 8589936091 rc 0/0 00000100:00100000:2.0:1746147148.789949:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5536 00000100:00100000:1.0:1746147148.790792:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310750592:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.790814:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147148.790981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.791044:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171648 00000100:00100000:1.0:1746147148.791048:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171648 00010000:00010000:1.0:1746147148.791070:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.791238:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6649 00000100:00100000:1.0:1746147148.791244:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308171648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.791254:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.791261:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.791272:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.791295:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x31399394250574fc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78896 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.791307:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.791311:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.791320:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.791325:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.791340:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147148.791613:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791620:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147148.791638:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147148.791715:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791722:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791727:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791733:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a2e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147148.791737:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791742:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791750:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147148.791752:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147148.791755:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791759:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x31399394250575c0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791776:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791780:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791785:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791792:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791796:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a3c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147148.791799:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791803:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791810:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147148.791812:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147148.791815:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791831:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3c00/0x31399394250575b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791840:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791844:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791849:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791853:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a2600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147148.791855:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791860:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791869:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098239700) 00010000:00010000:0.0:1746147148.791871:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147148.791874:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791878:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2600/0x31399394250575b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.791920:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x31399394250575ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78906 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.791927:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x31399394250575ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78906 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.791935:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3200, rc 0) 00000100:00100000:1.0:1746147148.791979:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2000:x1830967308171648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 733us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.791989:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6649 00000100:00100000:0.0:1746147148.792075:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32566:x1830967308170496:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4181us (4816us total) trans 8589936092 rc 301/301 00000100:00100000:0.0:1746147148.792081:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15377 00000100:00100000:0.0:1746147148.796867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.796908:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.796937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.796952:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.796981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.797004:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171904 00000100:00100000:2.0:1746147148.797015:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171904 00000100:00100000:2.0:1746147148.797059:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172160 00000100:00100000:2.0:1746147148.797061:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172160 00000100:00100000:2.0:1746147148.797080:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172416 00000100:00100000:2.0:1746147148.797082:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172416 00000100:00100000:2.0:1746147148.797114:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308171776 00000100:00100000:2.0:1746147148.797117:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308171776 00000100:00100000:1.0:1746147148.797128:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15003 00000100:00100000:1.0:1746147148.797139:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308171904:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147148.797140:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15004 00000100:00100000:2.0:1746147148.797146:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308172160:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147148.797237:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172032 00000100:00100000:0.0:1746147148.797241:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172032 00000100:00100000:0.0:1746147148.797261:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15005 00000100:00100000:0.0:1746147148.797265:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308172416:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147148.797321:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15006 00000100:00100000:3.0:1746147148.797329:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308171776:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147148.797421:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308171904:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 283us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.797427:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15003 00000100:00100000:1.0:1746147148.797445:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15007 00000100:00100000:1.0:1746147148.797450:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308172032:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147148.797453:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308171776:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 124us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.797463:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15006 00000100:00100000:1.0:1746147148.797483:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308172032:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.797491:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15007 00000100:00100000:1.0:1746147148.797533:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.797546:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172288 00000100:00100000:1.0:1746147148.797549:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172288 00000100:00100000:1.0:1746147148.797564:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15008 00000100:00100000:1.0:1746147148.797568:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308172288:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147148.797604:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308172288:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 35us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.797606:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308172160:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 451us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.797609:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15008 00000100:00100000:2.0:1746147148.797618:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15004 00000100:00100000:0.0:1746147148.798302:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308172416:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 1035us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.798310:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15005 00000100:00100000:0.0:1746147148.801311:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.801528:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172544 00000100:00100000:2.0:1746147148.801537:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172544 00000100:00100000:2.0:1746147148.801593:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15009 00000100:00100000:2.0:1746147148.801603:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308172544:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147148.801807:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147148.801811:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147148.801813:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147148.801815:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147148.801817:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147148.801890:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308172544:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 288us (587us total) trans 21474841534 rc 0/0 00000100:00100000:2.0:1746147148.801897:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15009 00000100:00100000:2.0:1746147148.808574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.808635:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172672 00000100:00100000:0.0:1746147148.808645:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172672 00000100:00100000:0.0:1746147148.808689:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15010 00000100:00100000:0.0:1746147148.808696:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308172672:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:0.0:1746147148.808942:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147148.808945:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147148.808948:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.808950:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147148.808952:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147148.809734:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308172672:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 1035us (1170us total) trans 17179874272 rc 0/0 00000100:00100000:0.0:1746147148.809744:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15010 00000100:00100000:0.0:1746147148.816334:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.816456:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308172928 00000100:00100000:2.0:1746147148.816467:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308172928 00000100:00100000:2.0:1746147148.816545:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3717 00000100:00100000:2.0:1746147148.816554:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308172928:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147148.816597:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.816612:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.816613:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.816618:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.816632:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.822545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.822609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.822638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.822672:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308173312 00000100:00100000:0.0:1746147148.822682:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308173312 00000100:00100000:2.0:1746147148.823955:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308173568 00000100:00100000:1.0:1746147148.823960:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308173440 00000100:00100000:2.0:1746147148.823962:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308173568 00000100:00100000:1.0:1746147148.823965:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308173440 00000100:00100000:1.0:1746147148.824014:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3718 00000100:00100000:2.0:1746147148.824043:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3719 00000100:00100000:1.0:1746147148.824046:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308173312:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:2.0:1746147148.824051:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308173568:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:2.0:1746147148.824068:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3720 00000100:00100000:2.0:1746147148.824073:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308173440:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147148.824142:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.824142:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.824158:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.824158:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.824160:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.824166:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.824181:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.824470:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.824476:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.824488:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.824758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.824773:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308173824 00000100:00100000:0.0:1746147148.824776:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308173824 00000100:00100000:0.0:1746147148.824801:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3721 00000100:00100000:0.0:1746147148.824806:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308173824:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147148.824838:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.824847:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.824848:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.824851:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.824860:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.825160:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.825549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.825587:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308173952 00000100:00100000:0.0:1746147148.825590:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308173952 00000100:00100000:0.0:1746147148.825609:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308174336 00000100:00100000:0.0:1746147148.825611:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308174336 00000100:00100000:0.0:1746147148.825622:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3722 00000100:00100000:0.0:1746147148.825627:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308173952:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147148.825640:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.825648:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.825649:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.825652:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.825658:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.826367:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3723 00000100:00100000:2.0:1746147148.826376:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308174336:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147148.826399:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.826408:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.826409:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.826413:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.826422:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.827066:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.827075:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.827077:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.827080:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.827106:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830467:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830485:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830493:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830500:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57a0e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147148.830504:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830512:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830531:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.830537:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0e00/0x31399394250575ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.830623:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308172928:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 14063us (14295us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746147148.830634:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3717 00010000:00010000:1.0:1746147148.842260:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.842286:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.842293:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.842300:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5565600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147148.842305:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.842313:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.842335:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.842342:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250575dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147148.842433:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967308173312:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 18384us (19896us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147148.842448:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3718 00010000:00010000:0.0:1746147148.844065:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.844086:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.844116:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.844124:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147148.844128:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.844135:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.844153:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.844159:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250575e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.844240:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308173824:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 19428us (19477us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147148.844250:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3721 00010000:00010000:2.0:1746147148.847914:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.847935:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.847948:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.847956:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013128c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147148.847961:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.847969:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.847990:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.847997:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013128c000/0x31399394250575d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.848513:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308173440:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 24433us (25869us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.848525:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3720 00010000:00010000:3.0:1746147148.852816:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.852845:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.852853:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.852861:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147148.852865:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.852872:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.852893:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.852898:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250575f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.853002:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308174336:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 26621us (27446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147148.853013:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3723 00000100:00100000:0.0:1746147148.860203:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.860311:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308174592 00000100:00100000:2.0:1746147148.860322:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308174592 00000100:00100000:2.0:1746147148.860387:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15378 00000100:00100000:2.0:1746147148.860396:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+7:32569:x1830967308174592:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147148.860422:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.860447:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c06c00/0x31399394250575ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7890d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.860537:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860550:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860560:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860572:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860578:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860583:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860698:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860707:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860713:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147148.860721:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147148.860798:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860805:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860813:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860829:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f239e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.860833:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860840:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860851:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.860854:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147148.860859:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860863:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425057614 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860886:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860891:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860895:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860899:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860903:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ffc600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.860906:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860913:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860919:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147148.860921:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147148.860924:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860928:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425057606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860935:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860940:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860944:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860948:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ffd800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147148.860950:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860955:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860961:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823ae00) 00010000:00010000:2.0:1746147148.860962:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147148.860965:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.860969:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505760d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.861006:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c06c00/0x31399394250575ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7890d expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.861013:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c06c00/0x31399394250575ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7890d expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.861021:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c06c00, rc 0) 00000100:00100000:2.0:1746147148.861121:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:32569:x1830967308174592:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 694us (897us total) trans 8589936093 rc 301/301 00000100:00100000:2.0:1746147148.861128:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15378 00010000:00010000:0.0:1746147148.863843:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.863863:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.863872:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.863879:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147148.863883:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.863891:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.863910:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.863917:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x31399394250575ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.864012:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308173952:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 38378us (38846us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147148.864023:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3722 00010000:00010000:2.0:1746147148.866210:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.866226:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.866234:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.866240:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147148.866244:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.866250:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.866268:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.866275:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fec00/0x31399394250575f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.867679:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308173568:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 43616us (45058us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.867694:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3719 00000100:00100000:1.0:1746147148.868285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.868388:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308174848 00000100:00100000:3.0:1746147148.868396:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308174848 00000100:00100000:3.0:1746147148.868438:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15379 00000100:00100000:3.0:1746147148.868445:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:32572:x1830967308174848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.868470:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.868490:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78914 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.868573:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868584:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868595:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868607:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868612:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868617:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868734:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868742:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868747:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147148.868758:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147148.868830:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868836:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868841:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868845:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03c600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147148.868848:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868853:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868862:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.868865:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147148.868868:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868872:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c600/0x3139939425057637 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868896:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868900:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868904:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868912:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868916:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03ce00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147148.868917:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868921:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868925:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147148.868927:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147148.868929:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868932:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ce00/0x3139939425057629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868937:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868940:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868943:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868947:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03da00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147148.868949:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868953:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868960:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1600) 00010000:00010000:3.0:1746147148.868962:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147148.868964:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.868967:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03da00/0x3139939425057630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.869000:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057622 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78914 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.869006:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78914 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.869011:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03c200, rc 0) 00000100:00100000:3.0:1746147148.869050:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32572:x1830967308174848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 606us (767us total) trans 8589936094 rc 301/301 00000100:00100000:3.0:1746147148.869057:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15379 00000100:00100000:0.0:1746147148.875331:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.875530:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308174976 00000100:00100000:2.0:1746147148.875541:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308174976 00000100:00100000:2.0:1746147148.875605:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15380 00000100:00100000:2.0:1746147148.875614:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+9:32572:x1830967308174976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.875640:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.875664:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef400/0x3139939425057645 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7891b expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.875763:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.875776:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.875787:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147148.875813:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147148.875817:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147148.875848:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.875873:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef400/0x3139939425057645 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.875906:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.875914:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.875917:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147148.875920:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeee00, rc 0) 00000100:00100000:2.0:1746147148.875981:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32572:x1830967308174976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 367us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.875987:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15380 00000100:00100000:0.0:1746147148.877323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.877380:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308175232 00000100:00100000:3.0:1746147148.877387:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308175232 00000100:00100000:3.0:1746147148.877432:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15381 00000100:00100000:3.0:1746147148.877439:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308175232:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:3.0:1746147148.877476:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.877496:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f966000/0x313993942505757a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ce expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.877525:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.877530:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147148.877583:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.877595:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.877602:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.877632:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.877644:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 9 pid: 7238 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.877657:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310750720:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.877742:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.880922:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310750720:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.880951:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147148.881085:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.881159:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.881240:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.881347:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308175360 00000100:00100000:2.0:1746147148.881355:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308175360 00000100:00100000:2.0:1746147148.881398:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308175488 00000100:00100000:2.0:1746147148.881400:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308175488 00000100:00100000:2.0:1746147148.881412:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308175616 00000100:00100000:2.0:1746147148.881414:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308175616 00000100:00100000:2.0:1746147148.881428:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15011 00000100:00100000:2.0:1746147148.881436:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967308175360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147148.881454:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.881472:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78922 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.881492:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.881495:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.881504:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 22 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.881520:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 22 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.881531:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbefa00, rc 0) 00000100:00100000:3.0:1746147148.881538:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15012 00000100:00100000:3.0:1746147148.881545:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+18:2003:x1830967308175488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.881554:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.881566:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78929 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.881574:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967308175360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 138us (490us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147148.881579:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.881580:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147148.881581:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15011 00010000:00010000:3.0:1746147148.881586:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147148.881596:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15013 00010000:00010000:3.0:1746147148.881597:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147148.881601:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308175616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.881603:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03da00, rc 0) 00010000:00010000:2.0:1746147148.881607:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147148.881614:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78930 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.881621:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308175488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.881625:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15012 00010000:00010000:2.0:1746147148.881629:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.881630:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.881635:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.881644:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147148.881652:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeea00, rc 0) 00000100:00100000:2.0:1746147148.881667:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308175616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.881672:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15013 00000100:00100000:2.0:1746147148.881996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.882021:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.882041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.882061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.882116:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308175744 00000100:00100000:0.0:1746147148.882120:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308175744 00000100:00100000:0.0:1746147148.882141:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308175872 00000100:00100000:0.0:1746147148.882143:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308175872 00000100:00100000:0.0:1746147148.882153:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176000 00000100:00100000:0.0:1746147148.882155:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176000 00000100:00100000:0.0:1746147148.882166:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15014 00000100:00100000:0.0:1746147148.882171:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308175744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.882178:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.882185:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78937 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.882196:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.882197:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.882202:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.882211:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.882218:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1600, rc 0) 00000100:00100000:0.0:1746147148.882239:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308175744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.882244:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15014 00000100:00100000:0.0:1746147148.882256:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15015 00000100:00100000:0.0:1746147148.882261:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308175872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.882267:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.882273:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7893e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.882288:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.882289:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.882294:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.882302:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.882309:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1c00, rc 0) 00000100:00100000:0.0:1746147148.882326:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308175872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 64us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.882331:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15015 00000100:00100000:0.0:1746147148.882340:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15016 00000100:00100000:0.0:1746147148.882344:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308176000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147148.882349:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.882356:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78945 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.882365:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.882366:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.882369:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.882377:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147148.882388:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0000, rc 0) 00000100:00100000:0.0:1746147148.882400:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308176000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 56us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147148.882405:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15016 00000100:00100000:1.0:1746147148.882501:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176128 00000100:00100000:1.0:1746147148.882506:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176128 00010000:00010000:1.0:1746147148.882524:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 10 pid: 7238 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.882547:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6650 00000100:00100000:1.0:1746147148.882552:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+10:2001:x1830967308176128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.882566:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.882572:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 10 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.882583:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 10 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.882602:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505764c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7891b expref: 10 pid: 7238 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.882618:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.882623:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147148.882631:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147148.882637:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147148.882665:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.882683:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967308176128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 131us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.882689:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6650 00000100:00100000:2.0:1746147148.882835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.882854:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176384 00000100:00100000:0.0:1746147148.882857:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176384 00000100:00100000:0.0:1746147148.882880:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15382 00000100:00100000:0.0:1746147148.882884:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32566:x1830967308176384:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147148.882900:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147148.882902:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147148.882904:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.882910:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.882913:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x313993942505756c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788d5 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.882925:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147148.882927:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147148.882934:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425057684 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7894c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.882966:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.882975:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 7 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.882980:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.882987:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147148.882998:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.883017:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1746147148.883025:0:7239:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011db17800 reply state ffff8801373df000 transno 8589936095 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147148.883027:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 8 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.883038:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310750848:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.883111:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147148.883246:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.883253:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147148.883256:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147148.883258:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147148.883264:0:7239:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147148.883328:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32562:x1830967308175232:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 5890us (6009us total) trans 8589936095 rc 0/0 00000100:00100000:3.0:1746147148.883334:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15381 00000100:00100000:0.0:1746147148.885070:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.885176:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176512 00000100:00100000:1.0:1746147148.885183:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176512 00000100:00100000:2.0:1746147148.885219:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310750848:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.885240:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15383 00010000:00010000:2.0:1746147148.885242:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147148.885246:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:32572:x1830967308176512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147148.886003:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.886027:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78953 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.886080:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.886111:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.886129:0:6215:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.886141:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.886151:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.886154:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147148.886157:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.886163:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa800, rc 0) 00000100:00100000:1.0:1746147148.886205:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+10:32572:x1830967308176512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 958us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.886212:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15383 00000100:00100000:0.0:1746147148.886286:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.886372:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176640 00000100:00100000:1.0:1746147148.886376:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176640 00010000:00010000:1.0:1746147148.886393:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.886424:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6651 00000100:00100000:1.0:1746147148.886430:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308176640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147148.886439:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147148.886443:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.886452:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.886470:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03ca00/0x3139939425057565 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c7 expref: 9 pid: 7239 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.886482:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.886484:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.886578:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.886584:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147148.886593:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.886606:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147148.886627:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308176640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 197us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.886637:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6651 00010000:00010000:2.0:1746147148.886720:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147148.886729:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00000040:00080000:2.0:1746147148.887023:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].614, 88 off62096 00000004:00080000:2.0:1746147148.887030:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686876940431ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887062:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].548, 88 off56280 00000004:00080000:2.0:1746147148.887066:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686876976607ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887553:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].549, 88 off56368 00000004:00080000:2.0:1746147148.887558:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877468376ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887568:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].615, 88 off62184 00000004:00080000:2.0:1746147148.887570:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877480717ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887592:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].616, 88 off62272 00000004:00080000:2.0:1746147148.887595:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877505555ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887603:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].550, 88 off56456 00000004:00080000:2.0:1746147148.887605:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877515708ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887612:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].551, 88 off56544 00000004:00080000:2.0:1746147148.887615:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877525277ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887622:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].552, 88 off56632 00000004:00080000:2.0:1746147148.887625:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877535230ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887710:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].617, 88 off62360 00000004:00080000:2.0:1746147148.887714:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877624918ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887734:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].553, 88 off56720 00000004:00080000:2.0:1746147148.887737:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877647840ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887746:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].618, 88 off62448 00000004:00080000:2.0:1746147148.887749:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877659458ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887755:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].554, 88 off56808 00000004:00080000:2.0:1746147148.887758:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877668212ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147148.887764:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].619, 88 off62536 00000004:00080000:2.0:1746147148.887766:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877676785ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887775:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].620, 88 off62624 00000004:00080000:2.0:1746147148.887777:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877687527ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887792:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].621, 88 off62712 00000004:00080000:2.0:1746147148.887794:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877704768ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887803:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].622, 88 off62800 00000004:00080000:2.0:1746147148.887805:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686877716035ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147148.887814:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].555, 88 off56896 00000004:00080000:2.0:1746147148.887816:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686877726488ns, next at 554081490131ns, rc = 0 00000100:00100000:2.0:1746147148.888299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.888341:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176768 00000100:00100000:1.0:1746147148.888346:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176768 00000100:00100000:1.0:1746147148.888392:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15384 00000100:00100000:1.0:1746147148.888398:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308176768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147148.888415:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.888429:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7895a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.888467:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.888476:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.888486:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147148.888489:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147148.888492:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.888497:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbe00, rc 0) 00000100:00100000:1.0:1746147148.888527:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32562:x1830967308176768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 130us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.888533:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15384 00000001:00080000:2.0:1746147148.892775:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936096 is committed 00000004:00080000:2.0:1746147148.892790:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 550 committed 00000004:00080000:2.0:1746147148.892957:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 614 committed 00000004:00080000:2.0:1746147148.892976:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 613 committed 00000004:00080000:2.0:1746147148.892978:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 612 committed 00000004:00080000:2.0:1746147148.892980:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 611 committed 00000004:00080000:2.0:1746147148.892981:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 549 committed 00000004:00080000:2.0:1746147148.892983:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 610 committed 00000004:00080000:2.0:1746147148.892984:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 548 committed 00000004:00080000:2.0:1746147148.892985:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 609 committed 00000004:00080000:2.0:1746147148.892987:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 547 committed 00000004:00080000:2.0:1746147148.892988:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 546 committed 00000004:00080000:2.0:1746147148.892990:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 545 committed 00000004:00080000:2.0:1746147148.892991:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 608 committed 00000004:00080000:2.0:1746147148.892992:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 607 committed 00000004:00080000:2.0:1746147148.892994:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 544 committed 00000004:00080000:2.0:1746147148.892995:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 543 committed 00000004:00080000:2.0:1746147148.892996:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 606 committed 00000100:00100000:3.0:1746147148.893197:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.893255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.893283:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.893299:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.893314:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147148.893319:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.893333:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.893344:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.893356:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.893380:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751360 00000100:00100000:3.0:1746147148.893386:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751360 00000100:00100000:3.0:1746147148.893412:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751872 00000100:00100000:3.0:1746147148.893414:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751872 00000100:00100000:3.0:1746147148.893423:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751232 00000100:00100000:3.0:1746147148.893424:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751232 00000100:00100000:3.0:1746147148.893433:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751744 00000100:00100000:3.0:1746147148.893435:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751744 00000100:00100000:3.0:1746147148.893447:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15017 00000100:00100000:3.0:1746147148.893453:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310751360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147148.893555:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147148.893558:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.893560:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147148.893561:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.893563:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:3.0:1746147148.893589:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310751360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (335us total) trans 21474841535 rc 0/0 00000100:00100000:3.0:1746147148.893595:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15017 00000100:00100000:3.0:1746147148.893610:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15018 00000100:00100000:3.0:1746147148.893615:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310751872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147148.893669:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310751872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (368us total) trans 21474841536 rc 0/0 00000100:00100000:3.0:1746147148.893673:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15018 00000100:00100000:3.0:1746147148.893683:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15019 00000100:00100000:3.0:1746147148.893687:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310751232:12345-0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1746147148.893717:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936095 is committed 00000001:00080000:2.0:1746147148.893724:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936094 is committed 00002000:00010000:3.0:1746147148.893728:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147148.893731:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:3.0:1746147148.893732:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:3.0:1746147148.893734:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:3.0:1746147148.893736:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147148.893753:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310751232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (418us total) trans 21474841537 rc 0/0 00000100:00100000:3.0:1746147148.893757:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15019 00000100:00100000:3.0:1746147148.893765:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15020 00000100:00100000:3.0:1746147148.893769:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310751744:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147148.893781:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.893790:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147148.893793:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147148.893796:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.893806:0:7238:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.893811:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.893814:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967310751744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (456us total) trans 21474841538 rc 0/0 00000100:00100000:3.0:1746147148.893828:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15020 00010000:00010000:2.0:1746147148.893834:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.893841:0:7238:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.893846:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.893894:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310750976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.893929:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.893945:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310751488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.893960:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.893972:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147148.893976:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310751104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.893992:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.894003:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310751616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.894016:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.894040:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310750976 00000100:00100000:0.0:1746147148.894043:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310750976 00000100:00100000:0.0:1746147148.894055:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751488 00000100:00100000:0.0:1746147148.894057:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751488 00000100:00100000:0.0:1746147148.894062:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751104 00000100:00100000:0.0:1746147148.894064:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751104 00000100:00100000:0.0:1746147148.894068:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310751616 00000100:00100000:0.0:1746147148.894070:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310751616 00000100:00100000:0.0:1746147148.894076:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15021 00000100:00100000:0.0:1746147148.894081:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310750976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147148.894142:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147148.894144:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147145 -> 1746147145 00002000:00010000:0.0:1746147148.894145:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147145 -> 1746147145 00002000:00010000:0.0:1746147148.894147:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147145 -> 1746147145 00002000:00010000:0.0:1746147148.894149:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147148.894168:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310750976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (239us total) trans 21474841539 rc 0/0 00000100:00100000:0.0:1746147148.894173:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15021 00000100:00100000:0.0:1746147148.894196:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15022 00000100:00100000:0.0:1746147148.894200:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310751488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147148.894248:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310751488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (287us total) trans 21474841540 rc 0/0 00000100:00100000:0.0:1746147148.894253:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15022 00000100:00100000:0.0:1746147148.894261:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15023 00000100:00100000:0.0:1746147148.894265:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310751104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147148.894297:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147148.894299:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147147 -> 1746147147 00002000:00010000:0.0:1746147148.894301:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147147 -> 1746147147 00002000:00010000:0.0:1746147148.894302:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147147 -> 1746147147 00002000:00010000:0.0:1746147148.894305:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147148.894320:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310751104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (327us total) trans 21474841541 rc 0/0 00000100:00100000:0.0:1746147148.894324:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15023 00000100:00100000:0.0:1746147148.894409:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15024 00000100:00100000:0.0:1746147148.894414:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967310751616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147148.894447:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147148.894450:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147148.894451:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.894453:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147148.894454:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:0.0:1746147148.894471:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967310751616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (454us total) trans 21474841542 rc 0/0 00000100:00100000:0.0:1746147148.894476:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15024 00000004:00080000:0.0:1746147148.894504:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524e00/2, rc 0, transno 21474841541 00000100:00100000:0.0:1746147148.894508:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310751104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147148.894515:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd45f80/2, rc 0, transno 21474841542 00000100:00100000:0.0:1746147148.894517:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310751616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147148.894524:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094527b80/2, rc 0, transno 21474841539 00000100:00100000:0.0:1746147148.894526:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310750976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147148.894531:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525c00/2, rc 0, transno 21474841540 00000100:00100000:0.0:1746147148.894533:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310751488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147148.895633:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.895662:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.895679:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.895693:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.895704:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147148.895707:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.895720:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.895728:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.895741:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147148.895758:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752128 00000100:00100000:1.0:1746147148.895762:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752128 00000100:00100000:1.0:1746147148.895781:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752640 00000100:00100000:1.0:1746147148.895783:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752640 00000100:00100000:1.0:1746147148.895791:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15025 00000100:00100000:1.0:1746147148.895796:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967310752128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147148.895875:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147148.895878:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.895880:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.895881:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.895883:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147148.895906:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967310752128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (244us total) trans 17179874273 rc 0/0 00000100:00100000:1.0:1746147148.895911:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15025 00000100:00100000:1.0:1746147148.895921:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752000 00000100:00100000:1.0:1746147148.895924:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752000 00000100:00100000:1.0:1746147148.895931:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752512 00000100:00100000:1.0:1746147148.895933:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752512 00000100:00100000:0.0:1746147148.896011:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15026 00000100:00100000:0.0:1746147148.896018:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967310752640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.896081:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967310752640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (386us total) trans 17179874274 rc 0/0 00000100:00100000:0.0:1746147148.896086:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15026 00000100:00100000:0.0:1746147148.896111:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15027 00000100:00100000:0.0:1746147148.896120:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967310752000:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147148.896151:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00002000:00010000:0.0:1746147148.896162:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147148.896164:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147147 -> 1746147147 00002000:00010000:0.0:1746147148.896166:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147147 -> 1746147147 00002000:00010000:0.0:1746147148.896168:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147147 -> 1746147147 00002000:00010000:0.0:1746147148.896169:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147148.896186:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967310752000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (464us total) trans 17179874275 rc 0/0 00000100:00100000:0.0:1746147148.896190:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15027 00000100:00100000:0.0:1746147148.896200:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15028 00000100:00100000:0.0:1746147148.896204:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967310752512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147148.896247:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:0.0:1746147148.896249:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:0.0:1746147148.896251:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.896252:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147148.896253:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:0.0:1746147148.896276:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967310752512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (533us total) trans 17179874276 rc 0/0 00000100:00100000:0.0:1746147148.896280:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15028 00000004:00080000:1.0:1746147148.896357:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5bb80/2, rc 0, transno 17179874275 00000100:00100000:1.0:1746147148.896414:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147148.896425:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5b100/2, rc 0, transno 17179874276 00000100:00100000:1.0:1746147148.896427:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147148.896433:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5a300/2, rc 0, transno 17179874273 00000100:00100000:1.0:1746147148.896435:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147148.896441:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5aa00/2, rc 0, transno 17179874274 00000100:00100000:1.0:1746147148.896444:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310752640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.896527:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147148.896533:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310753024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147148.896553:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.896580:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310753024 00000100:00100000:0.0:1746147148.896584:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310753024 00000100:00100000:0.0:1746147148.896603:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15029 00000100:00100000:0.0:1746147148.896607:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967310753024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.896728:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3765:x1830967310753024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (173us total) trans 17179874277 rc 0/0 00000100:00100000:0.0:1746147148.896733:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15029 00000004:00080000:1.0:1746147148.896772:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c4000/2, rc 0, transno 17179874277 00000100:00100000:1.0:1746147148.896776:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310753024:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147148.897055:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.897061:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00000100:00100000:2.0:1746147148.897108:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147148.897134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147148.897149:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147148.897160:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147148.897182:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147148.897184:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752256 00000100:00100000:2.0:1746147148.897187:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.897188:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752256 00000100:00100000:2.0:1746147148.897201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147148.897211:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147148.897223:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147148.897281:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752768 00000100:00100000:0.0:1746147148.897284:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752768 00010000:00010000:3.0:1746147148.897288:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03c200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147148.897292:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147148.897298:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752384 00010000:00010000:3.0:1746147148.897299:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147148.897300:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752384 00000100:00100000:0.0:1746147148.897309:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15030 00010000:00010000:3.0:1746147148.897313:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:0.0:1746147148.897313:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3766:x1830967310752256:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147148.897315:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147148.897318:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147148.897323:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x3139939425057653 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00000100:00100000:3.0:1746147148.897349:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15031 00000100:00100000:3.0:1746147148.897354:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310752768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147148.897358:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147148.897360:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.897361:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.897363:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.897365:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147148.897384:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310752256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (250us total) trans 17179874278 rc 0/0 00000100:00100000:0.0:1746147148.897389:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15030 00000100:00100000:0.0:1746147148.897398:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15032 00000100:00100000:0.0:1746147148.897402:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310752384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147148.897410:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147148.897412:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.897413:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147148.897415:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147148.897417:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:3.0:1746147148.897438:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310752768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (276us total) trans 17179874279 rc 0/0 00000100:00100000:3.0:1746147148.897442:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15031 00000100:00100000:0.0:1746147148.897442:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310752384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (240us total) trans 17179874280 rc 0/0 00000100:00100000:0.0:1746147148.897446:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15032 00000004:00080000:3.0:1746147148.897468:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525880/2, rc 0, transno 21474841537 00000100:00100000:3.0:1746147148.897471:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147148.897480:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd47800/2, rc 0, transno 21474841538 00000100:00100000:3.0:1746147148.897483:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147148.897490:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094526680/2, rc 0, transno 21474841535 00000100:00100000:3.0:1746147148.897492:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147148.897498:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd44700/2, rc 0, transno 21474841536 00000100:00100000:3.0:1746147148.897500:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310751872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147148.897909:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310752896 00000100:00100000:1.0:1746147148.897913:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310752896 00000004:00080000:2.0:1746147148.897926:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5a680/2, rc 0, transno 17179874278 00000100:00100000:2.0:1746147148.897931:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147148.897937:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e58a80/2, rc 0, transno 17179874279 00000100:00100000:2.0:1746147148.897940:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147148.897946:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5ad80/2, rc 0, transno 17179874280 00000100:00100000:2.0:1746147148.897949:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752384:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147148.897971:0:7238:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 6 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.897982:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310753152:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.898036:0:7238:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.898044:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310753280:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.898058:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.901483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.901568:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308176896 00000100:00100000:2.0:1746147148.901575:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308176896 00000100:00100000:2.0:1746147148.901616:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5537 00000100:00100000:2.0:1746147148.901622:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:32572:x1830967308176896:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:1.0:1746147148.901652:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15033 00000100:00100000:1.0:1746147148.901660:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310752896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147148.901712:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:32572:x1830967308176896:12345-192.168.204.25@tcp:49:cat.0 Request processed in 89us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.901717:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5537 00000100:00100000:2.0:1746147148.901776:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310753152:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.901783:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310753280:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.901808:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425057684 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 28 pid: 7238 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147148.901837:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 27 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.901851:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0a00, rc 0) 00000100:00100000:2.0:1746147148.901866:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32566:x1830967308176384:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 18982us (19031us total) trans 8589936096 rc 0/0 00000100:00100000:2.0:1746147148.901872:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15382 00002000:00010000:1.0:1746147148.901924:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:1.0:1746147148.901927:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147148.901929:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147148.901960:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147148.901961:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:1.0:1746147148.901992:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310752896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (4767us total) trans 17179874281 rc 0/0 00000100:00100000:1.0:1746147148.901997:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15033 00000004:00080000:2.0:1746147148.902041:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e59500/2, rc 0, transno 17179874281 00000100:00100000:2.0:1746147148.902046:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310752896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147148.902932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.903020:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177024 00000100:00100000:3.0:1746147148.903025:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177024 00000100:00100000:3.0:1746147148.903060:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5538 00000100:00100000:3.0:1746147148.903066:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32562:x1830967308177024:12345-192.168.204.25@tcp:49:lfs.0 00000100:00100000:3.0:1746147148.903173:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32562:x1830967308177024:12345-192.168.204.25@tcp:49:lfs.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.903178:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5538 00000100:00100000:0.0:1746147148.905242:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147148.905275:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310753408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147148.905336:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147148.905388:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310753408 00000100:00100000:3.0:1746147148.905395:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310753408 00000100:00080000:1.0:1746147148.905478:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147148.905833:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1746147148.905841:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310753408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1746147148.905860:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1220777024 pending 4501504 free 3909718016 avail 3678195712 00000100:00100000:3.0:1746147148.905925:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967310753408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.905930:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1746147148.905977:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967310753408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147148.906872:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.906903:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.906927:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177152 00000100:00100000:0.0:1746147148.906931:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.906933:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177152 00000100:00100000:0.0:1746147148.906946:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.906968:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177408 00000100:00100000:1.0:1746147148.906971:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177408 00000100:00100000:0.0:1746147148.906972:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.906989:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177664 00000100:00100000:1.0:1746147148.906991:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177664 00000100:00100000:0.0:1746147148.906999:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.907004:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177280 00000100:00100000:1.0:1746147148.907006:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177280 00000100:00100000:0.0:1746147148.907014:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177536 00000100:00100000:1.0:1746147148.907015:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177792 00000100:00100000:0.0:1746147148.907016:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177536 00000100:00100000:1.0:1746147148.907017:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177792 00000100:00100000:1.0:1746147148.907029:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15034 00000100:00100000:0.0:1746147148.907034:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15035 00000100:00100000:1.0:1746147148.907035:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308177152:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:0.0:1746147148.907039:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308177408:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147148.907148:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147148.907148:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147148.907151:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147147 -> 1746147148 00002000:00010000:0.0:1746147148.907151:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147147 -> 1746147148 00002000:00010000:1.0:1746147148.907152:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147147 -> 1746147148 00002000:00010000:0.0:1746147148.907153:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147147 -> 1746147148 00002000:00010000:1.0:1746147148.907154:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147147 -> 1746147148 00002000:00010000:0.0:1746147148.907154:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147147 -> 1746147148 00002000:00010000:1.0:1746147148.907156:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00002000:00010000:0.0:1746147148.907156:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147148.907187:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308177408:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 147us (283us total) trans 21474841543 rc 0/0 00000100:00100000:1.0:1746147148.907188:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308177152:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 153us (318us total) trans 17179874282 rc 0/0 00000100:00100000:0.0:1746147148.907193:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15035 00000100:00100000:1.0:1746147148.907196:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15034 00000100:00100000:0.0:1746147148.907205:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15036 00000100:00100000:1.0:1746147148.907209:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15037 00000100:00100000:0.0:1746147148.907210:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308177664:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147148.907213:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308177280:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147148.907247:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147148.907249:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147145 -> 1746147148 00002000:00010000:1.0:1746147148.907251:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147145 -> 1746147148 00002000:00010000:1.0:1746147148.907252:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147145 -> 1746147148 00002000:00010000:0.0:1746147148.907253:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147148.907254:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746147148.907256:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.907258:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.907259:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.907261:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:1.0:1746147148.907267:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308177280:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 54us (321us total) trans 21474841544 rc 0/0 00000100:00100000:1.0:1746147148.907272:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15037 00000100:00100000:0.0:1746147148.907279:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308177664:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 68us (346us total) trans 17179874283 rc 0/0 00000100:00100000:1.0:1746147148.907281:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15038 00000100:00100000:0.0:1746147148.907284:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15036 00000100:00100000:1.0:1746147148.907285:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308177792:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:0.0:1746147148.907294:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15039 00000100:00100000:0.0:1746147148.907298:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308177536:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147148.907333:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147148.907336:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.907337:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.907339:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:0.0:1746147148.907340:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147148.907357:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308177536:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 58us (384us total) trans 17179874284 rc 0/0 00000100:00100000:0.0:1746147148.907362:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15039 00002000:00010000:1.0:1746147148.907427:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147148.907430:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.907431:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.907433:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147148 -> 1746147148 00002000:00010000:1.0:1746147148.907435:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147148.907453:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308177792:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 168us (454us total) trans 21474841545 rc 0/0 00000100:00100000:0.0:1746147148.907457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.907458:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15038 00000100:00100000:1.0:1746147148.907468:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308177920 00000100:00100000:1.0:1746147148.907471:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308177920 00000100:00100000:1.0:1746147148.907493:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15040 00000100:00100000:1.0:1746147148.907497:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32566:x1830967308177920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147148.907506:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.907517:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78961 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.907537:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 44 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.907544:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.907555:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.907560:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.907561:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.907564:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1179648->1888255] (req 1179648->1888255) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.907587:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.907597:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.907608:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310753536:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.907667:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.907674:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 23 pid: 9586 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.907681:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310753664:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.907700:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 44 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.907711:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 44 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.907717:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310753792:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.907729:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.910438:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.910486:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308178176 00000100:00100000:2.0:1746147148.910495:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308178176 00000100:00100000:2.0:1746147148.910624:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5539 00000100:00100000:2.0:1746147148.910633:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32562:x1830967308178176:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147148.911501:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308178176:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 868us (1068us total) trans 8589936097 rc 0/0 00000100:00100000:2.0:1746147148.911509:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5539 00000100:00100000:0.0:1746147148.913382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.913405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.913437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.913493:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308178304 00000100:00100000:2.0:1746147148.913499:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308178304 00010000:00010000:2.0:1746147148.913524:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 24 pid: 9586 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.913545:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308178560 00000100:00100000:2.0:1746147148.913547:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308178560 00010000:00010000:2.0:1746147148.913554:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.913565:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308178432 00000100:00100000:2.0:1746147148.913567:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308178432 00000100:00100000:3.0:1746147148.913570:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6652 00010000:00010000:2.0:1746147148.913574:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 15 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.913578:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308178304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147148.913586:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6653 00010000:00010000:3.0:1746147148.913590:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147148.913592:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308178560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147148.913600:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.913609:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 24 pid: 9586 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.913609:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.913619:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.913874:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310753536:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.913883:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310753664:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.913889:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310753792:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.914069:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147148.914210:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 24 pid: 9586 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.914228:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1600/0x313993942505766f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78937 expref: 24 pid: 9586 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.914388:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.914420:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2001:x1830967308178304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 843us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.914426:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6652 00000100:00100000:3.0:1746147148.914440:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6654 00000100:00100000:3.0:1746147148.914445:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308178432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.914451:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.914457:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 15 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.914466:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 15 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.914475:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425057596 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f1 expref: 15 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.914481:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.914493:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308178432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.914500:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6654 00000100:00100000:3.0:1746147148.914525:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308178816 00000100:00100000:3.0:1746147148.914528:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308178816 00000100:00100000:3.0:1746147148.914545:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5540 00000100:00100000:3.0:1746147148.914549:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32562:x1830967308178816:12345-192.168.204.25@tcp:35:lfs.0 00010000:00010000:2.0:1746147148.914661:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x313993942505755e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b9 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.914670:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.914672:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.914677:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.914680:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32562:x1830967308178816:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 129us (611us total) trans 8589936098 rc 0/0 00010000:00010000:2.0:1746147148.914684:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147148.914685:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5540 00010000:00010000:2.0:1746147148.914709:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.914726:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310753920:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147148.914734:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.914742:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372dc00, rc 0) 00000100:00100000:1.0:1746147148.914761:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32566:x1830967308177920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7264us (7304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147148.914766:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15040 00000100:00100000:2.0:1746147148.914774:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.918928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.918983:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.919270:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308179072 00000100:00100000:0.0:1746147148.919285:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308179072 00000100:00100000:1.0:1746147148.919842:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308179328 00000100:00100000:1.0:1746147148.919851:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308179328 00002000:00100000:0.0:1746147148.919865:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880096842300 x1830967308179072/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.919880:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096842300 with x1830967308179072 ext(0->1048575) 00002000:00010000:0.0:1746147148.919887:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096842300 00002000:00100000:1.0:1746147148.919890:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009f3e6450 x1830967308179328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.919899:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6450 with x1830967308179328 ext(1048576->2097151) 00002000:00010000:1.0:1746147148.919904:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e6450 00000100:00100000:2.0:1746147148.920128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.920420:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308179584 00000100:00100000:0.0:1746147148.920426:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308179584 00000100:00100000:2.0:1746147148.920445:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3724 00002000:00100000:0.0:1746147148.920450:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880096842a00 x1830967308179584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147148.920456:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308179072:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:0.0:1746147148.920457:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096842a00 with x1830967308179584 ext(1048576->2097151) 00002000:00010000:0.0:1746147148.920462:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096842a00 00000100:00100000:0.0:1746147148.920484:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3725 00000100:00100000:0.0:1746147148.920492:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967308179328:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147148.921467:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3726 00000100:00100000:0.0:1746147148.921476:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+22:2003:x1830967308179584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147148.922693:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310753920:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147148.922712:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.922750:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308178560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9158us (9343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.922760:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6653 00000100:00100000:0.0:1746147148.929853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.929937:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308179840 00000100:00100000:1.0:1746147148.929948:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308179840 00002000:00100000:1.0:1746147148.929990:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1179648->1183743) req@ffff88011e4c7100 x1830967308179840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.929999:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c7100 with x1830967308179840 ext(1179648->1183743) 00002000:00010000:1.0:1746147148.930004:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e4c7100 00000100:00100000:1.0:1746147148.930039:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3727 00000100:00100000:1.0:1746147148.930046:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967308179840:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147148.930222:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967308179840:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 175us (377us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147148.930229:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3727 00002000:00100000:1.0:1746147148.930234:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1179648->1183743) req@ffff88011e4c7100 x1830967308179840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.930241:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c7100 with x1830967308179840 ext(1179648->1183743) 00002000:00010000:1.0:1746147148.930244:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e4c7100 00000100:00100000:0.0:1746147148.934288:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308179072:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13821us (15353us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147148.934301:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3724 00002000:00100000:0.0:1746147148.934313:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880096842300 x1830967308179072/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.934323:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096842300 with x1830967308179072 ext(0->1048575) 00002000:00010000:0.0:1746147148.934330:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096842300 00000100:00100000:0.0:1746147148.940416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147148.941336:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967308179328:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20841us (22348us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147148.941341:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:2003:x1830967308179584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19857us (21203us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.941348:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3725 00002000:00100000:2.0:1746147148.941360:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009f3e6450 x1830967308179328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.941371:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6450 with x1830967308179328 ext(1048576->2097151) 00002000:00010000:2.0:1746147148.941377:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e6450 00000100:00100000:3.0:1746147148.941488:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308179968 00000100:00100000:3.0:1746147148.941495:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308179968 00000100:00100000:3.0:1746147148.941543:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15041 00000100:00100000:3.0:1746147148.941551:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+23:32569:x1830967308179968:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147148.941567:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.941581:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78968 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.941608:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.941614:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147148.941617:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147148.941620:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.941646:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.941658:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 42 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.941668:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310754048:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147148.941734:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.942173:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3726 00002000:00100000:1.0:1746147148.942183:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880096842a00 x1830967308179584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.942191:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096842a00 with x1830967308179584 ext(1048576->2097151) 00002000:00010000:1.0:1746147148.942195:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096842a00 00000100:00100000:0.0:1746147148.946145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.946316:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310754048:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.946342:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308180224 00010000:00010000:3.0:1746147148.946347:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.946351:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308180224 00010000:00010000:3.0:1746147148.946364:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6000, rc 0) 00002000:00100000:2.0:1746147148.946399:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1884160->1888255) req@ffff88011e4c7800 x1830967308180224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.946410:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c7800 with x1830967308180224 ext(1884160->1888255) 00010000:00010000:2.0:1746147148.946419:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 43 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.946423:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+24:32569:x1830967308179968:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4871us (6018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.946431:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15041 00010000:00010000:2.0:1746147148.946434:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 43 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.946440:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e4c7800 00000100:00100000:2.0:1746147148.946462:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1172 00000100:00100000:2.0:1746147148.946470:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308180224:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147148.947117:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308180224:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 646us (982us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147148.947124:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1172 00002000:00100000:2.0:1746147148.947129:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1884160->1888255) req@ffff88011e4c7800 x1830967308180224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.947137:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c7800 with x1830967308180224 ext(1884160->1888255) 00010000:00010000:2.0:1746147148.947143:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 43 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.947153:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 43 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.947159:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e4c7800 00000100:00100000:0.0:1746147148.949916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.950007:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308180736 00000100:00100000:3.0:1746147148.950017:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308180736 00000100:00100000:3.0:1746147148.950117:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5541 00000100:00100000:3.0:1746147148.950126:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32566:x1830967308180736:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147148.950319:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32566:x1830967308180736:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 193us (411us total) trans 8589936099 rc 0/0 00000100:00100000:3.0:1746147148.950328:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5541 00000100:00100000:2.0:1746147148.951641:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.951708:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308180608 00000100:00100000:0.0:1746147148.951713:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308180608 00002000:00100000:0.0:1746147148.951739:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1179648->1888255) req@ffff880096842300 x1830967308180608/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.951747:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096842300 with x1830967308180608 ext(1179648->1888255) 00010000:00010000:0.0:1746147148.951754:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 43 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.951766:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 43 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746147148.951772:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096842300 00000100:00100000:0.0:1746147148.951795:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1173 00000100:00100000:0.0:1746147148.951802:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308180608:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147148.953770:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.954199:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308180864 00000100:00100000:3.0:1746147148.954208:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308180864 00000100:00100000:3.0:1746147148.954261:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15042 00000100:00100000:3.0:1746147148.954270:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+24:32572:x1830967308180864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147148.954291:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147148.954314:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7896f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.954344:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147148.954350:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.954356:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147148.954360:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.954399:0:1853:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.954412:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.954422:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6e00, rc 0) 00000100:00100000:3.0:1746147148.954471:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:32572:x1830967308180864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 201us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.954478:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15042 00000100:00100000:2.0:1746147148.959162:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308180608:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7348us (7511us total) trans 17179874285 rc 0/0 00000100:00100000:2.0:1746147148.959176:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1173 00002000:00100000:2.0:1746147148.959188:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1179648->1888255) req@ffff880096842300 x1830967308180608/t17179874285(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.959198:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096842300 with x1830967308180608 ext(1179648->1888255) 00010000:00010000:2.0:1746147148.959207:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 45 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.959223:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 45 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.959230:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096842300 00000100:00100000:0.0:1746147148.962319:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.962359:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308180992 00000100:00100000:3.0:1746147148.962368:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308180992 00010000:00010000:3.0:1746147148.962400:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 45 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.962429:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6655 00000100:00100000:3.0:1746147148.962435:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967308180992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.962446:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.962463:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 45 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.962472:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 45 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.962492:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250576a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1179648->1888255) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78961 expref: 45 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.962513:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.962515:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147148.962520:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.962526:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.962556:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.962572:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 24 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.962611:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310754304:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147148.962694:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147148.964920:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310754304:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147148.964937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147148.964946:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.964987:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967308180992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2550us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.964997:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6655 00000100:00100000:2.0:1746147148.965020:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308181248 00000100:00100000:2.0:1746147148.965026:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308181248 00002000:00100000:2.0:1746147148.965065:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1679360->1683455) req@ffff880096899180 x1830967308181248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.965075:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899180 with x1830967308181248 ext(1679360->1683455) 00010000:00010000:2.0:1746147148.965084:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.965122:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.965130:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096899180 00000100:00100000:2.0:1746147148.965158:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1174 00000100:00100000:2.0:1746147148.965164:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967308181248:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147148.965290:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+25:2001:x1830967308181248:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 126us (353us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147148.965296:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1174 00002000:00100000:2.0:1746147148.965301:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x8e:0x0] (1679360->1683455) req@ffff880096899180 x1830967308181248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.965308:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899180 with x1830967308181248 ext(1679360->1683455) 00010000:00010000:2.0:1746147148.965313:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.965322:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746147148.965328:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096899180 00000100:00100000:0.0:1746147148.976213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.976286:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308181504 00000100:00100000:1.0:1746147148.976297:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308181504 00002000:00100000:1.0:1746147148.976349:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1679360->2097151) req@ffff88009689b480 x1830967308181504/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.976665:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689b480 with x1830967308181504 ext(1679360->2097151) 00010000:00010000:1.0:1746147148.976676:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.976692:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746147148.976700:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689b480 00000100:00100000:1.0:1746147148.976736:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1175 00000100:00100000:1.0:1746147148.976745:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967308181504:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147148.977656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.977700:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308181632 00000100:00100000:1.0:1746147148.977705:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308181632 00000100:00100000:1.0:1746147148.977739:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15043 00000100:00100000:1.0:1746147148.977742:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:32569:x1830967308181632:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147148.977751:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147148.977767:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78976 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.977792:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 43 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.977800:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.977807:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.977913:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.977915:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147148.977918:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2314239] (req 2097152->2314239) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.977950:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.977960:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 13 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.977973:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310754432:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.978458:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147148.978466:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 28 pid: 9586 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746147148.978476:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310754560:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147148.978622:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 43 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147148.978631:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 43 pid: 9586 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746147148.978644:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310754688:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147148.978798:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147148.979598:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310754432:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147148.979913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.979978:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308181760 00000100:00100000:3.0:1746147148.979987:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308181760 00010000:00010000:3.0:1746147148.980020:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.980056:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6656 00000100:00100000:3.0:1746147148.980064:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308181760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.980074:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.980115:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.980125:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.980153:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425057588 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788f8 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746147148.980175:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.980210:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308181760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 143us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.980216:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6656 00000100:00100000:2.0:1746147148.981273:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310754560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147148.983813:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.983891:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308181504:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7145us (7687us total) trans 17179874286 rc 0/0 00000100:00100000:1.0:1746147148.983905:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1175 00002000:00100000:1.0:1746147148.983919:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1679360->2097151) req@ffff88009689b480 x1830967308181504/t17179874286(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/448 e 0 to 0 dl 1746147159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147148.983929:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689b480 with x1830967308181504 ext(1679360->2097151) 00010000:00010000:1.0:1746147148.983941:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 29 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746147148.983954:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 29 pid: 1853 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746147148.983960:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689b480 00000100:00100000:2.0:1746147148.983982:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308181888 00000100:00100000:2.0:1746147148.983991:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308181888 00010000:00010000:2.0:1746147148.984018:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 29 pid: 9586 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746147148.984042:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6657 00000100:00100000:2.0:1746147148.984049:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308181888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147148.984126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147148.984165:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308182016 00000100:00100000:3.0:1746147148.984170:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308182016 00010000:00010000:3.0:1746147148.984187:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 44 pid: 9586 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746147148.984193:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147148.984206:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6658 00010000:00010000:2.0:1746147148.984211:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 29 pid: 9586 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746147148.984212:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308182016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147148.984219:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147148.984227:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 44 pid: 9586 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.984235:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 44 pid: 9586 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746147148.984262:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147148.984300:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308182016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.984305:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6658 00010000:00010000:3.0:1746147148.984353:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4200/0x3139939425057534 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7889d expref: 43 pid: 9586 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746147148.984365:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310754688:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147148.984395:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->2314239] (req 2097152->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147148.984405:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:3.0:1746147148.984424:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:32569:x1830967308181632:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6680us (6771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147148.984429:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15043 00010000:00010000:2.0:1746147148.984705:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 28 pid: 9586 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.984720:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x3139939425057676 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7893e expref: 28 pid: 9586 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746147148.984745:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.984748:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147148.984759:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.984768:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147148.984799:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147148.984824:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096843100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310754816:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147148.984891:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147148.986153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.986176:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308182144 00000100:00100000:0.0:1746147148.986181:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308182144 00010000:00010000:0.0:1746147148.986206:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 28 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746147148.986235:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6659 00000100:00100000:0.0:1746147148.986243:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308182144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147148.986254:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147148.986272:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 28 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.986284:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 28 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.986301:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x31399394250576a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78968 expref: 28 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746147148.986329:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.986332:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147148.986337:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.986345:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147148.986369:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147148.986380:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310754944:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147148.986449:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147148.988642:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096843100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310754816:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.988667:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.988725:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308181888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4673us (4919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.988737:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6657 00000100:00100000:0.0:1746147148.989949:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147148.990012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147148.990015:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308182400 00000100:00100000:1.0:1746147148.990023:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308182400 00000100:00100000:0.0:1746147148.990041:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308182656 00000100:00100000:0.0:1746147148.990044:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308182656 00002000:00100000:0.0:1746147148.990078:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880096899f80 x1830967308182656/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/0 e 0 to 0 dl 1746147159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147148.990109:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899f80 with x1830967308182656 ext(1048576->2097151) 00002000:00010000:0.0:1746147148.990116:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096899f80 00000100:00100000:0.0:1746147148.990133:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3728 00000100:00100000:0.0:1746147148.990141:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308182656:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147148.990322:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310754944:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147148.990336:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147148.990364:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308182144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4123us (4217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147148.990372:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6659 00000100:00100000:1.0:1746147148.990617:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5542 00000100:00100000:1.0:1746147148.990624:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+8:32569:x1830967308182400:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147148.991065:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32569:x1830967308182400:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 442us (1120us total) trans 8589936100 rc 0/0 00000100:00100000:1.0:1746147148.991077:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5542 00000100:00100000:2.0:1746147148.996337:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2001:x1830967308182656:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 6181us (6309us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147148.996351:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3728 00002000:00100000:2.0:1746147148.996399:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880096899f80 x1830967308182656/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:524/0 lens 488/440 e 0 to 0 dl 1746147159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147148.996411:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899f80 with x1830967308182656 ext(1048576->2097151) 00002000:00010000:2.0:1746147148.996418:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096899f80 00000100:00100000:0.0:1746147149.008788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.008853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.009533:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308183040 00000100:00100000:2.0:1746147149.009543:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308183040 00000100:00100000:3.0:1746147149.009575:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308183168 00000100:00100000:3.0:1746147149.009580:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308183168 00002000:00100000:3.0:1746147149.009623:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009689aa00 x1830967308183168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.009633:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689aa00 with x1830967308183168 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.009638:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009689aa00 00000100:00100000:3.0:1746147149.009658:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3729 00000100:00100000:3.0:1746147149.009666:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308183168:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:2.0:1746147149.010449:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2314240->4194303) req@ffff88009689a680 x1830967308183040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.010459:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689a680 with x1830967308183040 ext(2314240->4194303) 00002000:00010000:2.0:1746147149.010464:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689a680 00000100:00100000:2.0:1746147149.010489:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3730 00000100:00100000:2.0:1746147149.010496:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308183040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.020219:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.020295:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308183424 00000100:00100000:3.0:1746147149.020305:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308183424 00000100:00100000:3.0:1746147149.020366:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15385 00000100:00100000:3.0:1746147149.020374:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32579:x1830967308183424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.020402:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.020423:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x31399394250576bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7897d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.020501:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020515:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020527:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020539:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020544:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020548:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020652:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.020660:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021359:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147149.021368:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.021448:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021454:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021463:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021469:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021474:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.021477:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021483:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021491:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.021494:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.021498:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021502:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250576c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021527:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021531:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021535:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021539:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.021540:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021548:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021553:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1500) 00010000:00010000:3.0:1746147149.021555:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.021556:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021560:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.021600:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x31399394250576bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.021610:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.021615:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.021616:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147149.021618:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372dc00, rc 0) 00000100:00100000:3.0:1746147149.022829:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32579:x1830967308183424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2439us (2606us total) trans 8589936101 rc 0/0 00000100:00100000:3.0:1746147149.022839:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15385 00000100:00100000:2.0:1746147149.023113:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308183168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13446us (14259us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147149.023123:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3729 00002000:00100000:2.0:1746147149.023133:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009689aa00 x1830967308183168/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.023143:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689aa00 with x1830967308183168 ext(2097152->4194303) 00002000:00010000:2.0:1746147149.023149:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009689aa00 00000100:00100000:2.0:1746147149.031992:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308183040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21484us (23204us total) trans 0 rc 1880064/1880064 00000100:00100000:2.0:1746147149.032004:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3730 00002000:00100000:2.0:1746147149.032016:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2314240->4194303) req@ffff88009689a680 x1830967308183040/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1880064/1880064 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.032025:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689a680 with x1830967308183040 ext(2314240->4194303) 00002000:00010000:2.0:1746147149.032032:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689a680 00000100:00100000:1.0:1746147149.035998:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.036054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.036130:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308183552 00000100:00100000:2.0:1746147149.036140:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308183552 00000100:00100000:2.0:1746147149.036183:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308183680 00000100:00100000:2.0:1746147149.036185:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308183680 00000100:00100000:2.0:1746147149.036201:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15044 00000100:00100000:2.0:1746147149.036209:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308183552:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147149.036253:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15045 00000100:00100000:0.0:1746147149.036260:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308183680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147149.036284:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147149.036302:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x31399394250576df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7898b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.036365:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755072:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147149.036452:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00010000:00010000:2.0:1746147149.036660:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.036669:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78984 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.036691:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.036693:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.036702:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.036720:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.036731:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715000, rc 0) 00000100:00100000:2.0:1746147149.036767:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308183552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 558us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.036773:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15044 00000100:00100000:2.0:1746147149.038573:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755072:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.038605:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x31399394250576df lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7898b expref: 45 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.038616:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x31399394250576df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7898b expref: 45 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.038631:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57600, rc 0) 00000100:00100000:2.0:1746147149.038672:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308183680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2413us (2618us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.038679:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15045 00000100:00100000:0.0:1746147149.044670:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.044740:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308183936 00000100:00100000:2.0:1746147149.044750:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308183936 00002000:00100000:2.0:1746147149.044800:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009689b800 x1830967308183936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.044811:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689b800 with x1830967308183936 ext(4194304->4919295) 00002000:00010000:2.0:1746147149.044825:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689b800 00000100:00100000:2.0:1746147149.045442:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3731 00000100:00100000:2.0:1746147149.045451:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308183936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.049007:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.049074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.049112:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.049134:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308184192 00000100:00100000:3.0:1746147149.049142:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308184192 00000100:00100000:1.0:1746147149.049148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.049163:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308184448 00000100:00100000:1.0:1746147149.049166:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308184448 00002000:00100000:3.0:1746147149.049184:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009689bb80 x1830967308184192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.049185:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880134ab3b80 x1830967308184448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.049193:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689bb80 with x1830967308184192 ext(0->1048575) 00002000:00100000:1.0:1746147149.049194:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab3b80 with x1830967308184448 ext(1048576->2097151) 00002000:00010000:3.0:1746147149.049199:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689bb80 00002000:00010000:1.0:1746147149.049199:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab3b80 00000100:00100000:2.0:1746147149.049203:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308184704 00000100:00100000:2.0:1746147149.049208:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308184704 00000100:00100000:1.0:1746147149.049225:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3732 00002000:00100000:2.0:1746147149.049230:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880134ab2300 x1830967308184704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147149.049232:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308184448:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147149.049236:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308184960 00002000:00100000:2.0:1746147149.049237:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab2300 with x1830967308184704 ext(1048576->2097151) 00000100:00100000:3.0:1746147149.049238:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308184960 00002000:00010000:2.0:1746147149.049241:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab2300 00002000:00100000:3.0:1746147149.049248:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880134ab0a80 x1830967308184960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.049255:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0a80 with x1830967308184960 ext(1048576->2097151) 00002000:00010000:3.0:1746147149.049258:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0a80 00000100:00100000:2.0:1746147149.049259:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3733 00000100:00100000:2.0:1746147149.049265:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308184192:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147149.049270:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3734 00000100:00100000:3.0:1746147149.049275:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308184704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147149.050023:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3735 00000100:00100000:3.0:1746147149.050029:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308184960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.050191:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308183936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4740us (5531us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147149.050198:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3731 00002000:00100000:2.0:1746147149.050204:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009689b800 x1830967308183936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.050212:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689b800 with x1830967308183936 ext(4194304->4919295) 00002000:00010000:2.0:1746147149.050216:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689b800 00000100:00100000:1.0:1746147149.061522:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967308184448:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12276us (12433us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147149.061535:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3732 00002000:00100000:1.0:1746147149.061549:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880134ab3b80 x1830967308184448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.061559:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab3b80 with x1830967308184448 ext(1048576->2097151) 00002000:00010000:1.0:1746147149.061565:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab3b80 00000100:00100000:2.0:1746147149.061718:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308184192:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12452us (12886us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147149.061733:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3733 00002000:00100000:2.0:1746147149.061740:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff88009689bb80 x1830967308184192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.061747:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689bb80 with x1830967308184192 ext(0->1048575) 00002000:00010000:2.0:1746147149.061751:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689bb80 00000100:00100000:0.0:1746147149.063657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.063721:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308185216 00000100:00100000:1.0:1746147149.063730:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308185216 00000100:00100000:1.0:1746147149.063788:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5543 00000100:00100000:1.0:1746147149.063797:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32572:x1830967308185216:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147149.064041:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+10:32572:x1830967308185216:12345-192.168.204.25@tcp:35:cat.0 Request processed in 243us (390us total) trans 8589936102 rc 0/0 00000100:00100000:1.0:1746147149.064049:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5543 00000100:00100000:3.0:1746147149.070567:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308184704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21275us (21436us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147149.070583:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3734 00002000:00100000:3.0:1746147149.070595:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880134ab2300 x1830967308184704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.070605:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab2300 with x1830967308184704 ext(1048576->2097151) 00002000:00010000:3.0:1746147149.070612:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab2300 00000100:00100000:3.0:1746147149.071506:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308184960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21474us (22355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147149.071513:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3735 00002000:00100000:3.0:1746147149.071518:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880134ab0a80 x1830967308184960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.071533:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0a80 with x1830967308184960 ext(1048576->2097151) 00002000:00010000:3.0:1746147149.071537:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0a80 00000100:00100000:0.0:1746147149.078998:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.079654:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308185344 00000100:00100000:2.0:1746147149.079665:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308185344 00000100:00100000:2.0:1746147149.080229:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15046 00000100:00100000:2.0:1746147149.080239:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32579:x1830967308185344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.080261:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.080282:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78992 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.080314:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.080322:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147149.080324:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147149.080327:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 45 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.080359:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.080371:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 25 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.080384:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755200:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.080485:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.082444:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.082595:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755200:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147149.082626:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 45 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.082643:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:3.0:1746147149.082785:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308185472 00000100:00100000:3.0:1746147149.082793:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308185472 00002000:00100000:3.0:1746147149.082848:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2314239) req@ffff88009689ad80 x1830967308185472/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.082858:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689ad80 with x1830967308185472 ext(2097152->2314239) 00010000:00010000:3.0:1746147149.082866:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 26 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.082879:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 26 pid: 9586 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.082886:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689ad80 00000100:00100000:3.0:1746147149.082918:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1176 00000100:00100000:3.0:1746147149.082925:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308185472:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147149.082964:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32579:x1830967308185344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2725us (3977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.082971:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15046 00000100:00100000:3.0:1746147149.088473:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308185472:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5534us (6022us total) trans 17179874287 rc 0/0 00000100:00100000:3.0:1746147149.088486:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1176 00002000:00100000:3.0:1746147149.088500:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2314239) req@ffff88009689ad80 x1830967308185472/t17179874287(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/448 e 0 to 0 dl 1746147160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.088509:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689ad80 with x1830967308185472 ext(2097152->2314239) 00010000:00010000:3.0:1746147149.088520:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.088542:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.088549:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689ad80 00000100:00100000:0.0:1746147149.094233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.094300:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308185600 00000100:00100000:2.0:1746147149.094310:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308185600 00010000:00010000:2.0:1746147149.094348:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.094387:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6660 00000100:00100000:2.0:1746147149.094394:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308185600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.094408:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.094428:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.094441:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.094464:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250576b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78976 expref: 28 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.094501:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.094503:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.094511:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 44 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.094519:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 44 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.094551:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 44 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.094562:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310755328:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147149.094641:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.097495:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310755328:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147149.097526:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.097587:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308185600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3192us (3364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.097598:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6660 00000100:00100000:0.0:1746147149.105007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.105076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.105214:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308185856 00000100:00100000:2.0:1746147149.105224:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308185856 00000100:00100000:3.0:1746147149.105225:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308186112 00000100:00100000:3.0:1746147149.105230:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308186112 00002000:00100000:3.0:1746147149.105270:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880091c3d880 x1830967308186112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.105270:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880091c3dc00 x1830967308185856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.105279:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3d880 with x1830967308186112 ext(2097152->4194303) 00002000:00100000:2.0:1746147149.105279:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3dc00 with x1830967308185856 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.105285:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3d880 00002000:00010000:2.0:1746147149.105285:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3dc00 00000100:00100000:3.0:1746147149.105320:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3736 00000100:00100000:2.0:1746147149.105327:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3737 00000100:00100000:3.0:1746147149.105328:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308186112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.105333:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308185856:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.116860:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308185856:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11513us (11853us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147149.116874:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3737 00002000:00100000:2.0:1746147149.116886:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880091c3dc00 x1830967308185856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.116895:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3dc00 with x1830967308185856 ext(2097152->4194303) 00002000:00010000:2.0:1746147149.116901:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3dc00 00000100:00100000:3.0:1746147149.121429:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308186112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16088us (16338us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147149.121473:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3736 00002000:00100000:3.0:1746147149.121486:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880091c3d880 x1830967308186112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.121496:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3d880 with x1830967308186112 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.121503:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3d880 00000100:00100000:0.0:1746147149.133774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.133958:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308186368 00000100:00100000:3.0:1746147149.133968:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308186368 00002000:00100000:3.0:1746147149.134017:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3fb80 x1830967308186368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.134035:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3fb80 with x1830967308186368 ext(4194304->4919295) 00002000:00010000:3.0:1746147149.134041:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3fb80 00000100:00100000:3.0:1746147149.134077:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3738 00000100:00100000:3.0:1746147149.134086:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308186368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147149.139911:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308186368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5817us (6140us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147149.139923:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3738 00002000:00100000:3.0:1746147149.139933:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3fb80 x1830967308186368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.139942:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3fb80 with x1830967308186368 ext(4194304->4919295) 00002000:00010000:3.0:1746147149.139947:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3fb80 00000100:00100000:0.0:1746147149.147574:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.147793:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308186624 00000100:00100000:3.0:1746147149.147802:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308186624 00000100:00100000:3.0:1746147149.147868:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5544 00000100:00100000:3.0:1746147149.147875:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32579:x1830967308186624:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147149.148127:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32579:x1830967308186624:12345-192.168.204.25@tcp:35:cat.0 Request processed in 215us (523us total) trans 8589936103 rc 0/0 00000100:00100000:3.0:1746147149.148135:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5544 00000100:00100000:0.0:1746147149.172391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.172499:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308186880 00000100:00100000:3.0:1746147149.172509:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308186880 00000100:00100000:3.0:1746147149.172560:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15386 00000100:00100000:3.0:1746147149.172568:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32584:x1830967308186880:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147149.172592:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.172610:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x31399394250576f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78999 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.172700:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.172714:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.172721:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.172747:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.172757:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 32 pid: 7238 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.172769:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310755456:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147149.172878:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.175443:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310755456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147149.175473:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147149.176551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.176751:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308187008 00000100:00100000:2.0:1746147149.176762:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308187008 00010000:00010000:2.0:1746147149.176798:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 33 pid: 7238 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.176849:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6661 00000100:00100000:2.0:1746147149.176856:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308187008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.176868:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.176873:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 33 pid: 7238 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.176883:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 33 pid: 7238 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.176903:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009372dc00/0x31399394250576d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7897d expref: 33 pid: 7238 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.176935:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.176939:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147149.176947:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147149.176953:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147149.176987:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.177043:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308187008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 186us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.177049:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6661 00010000:00010000:3.0:1746147149.177247:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.177254:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147149.177271:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.177379:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x31399394250576f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.177397:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.177402:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.177405:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147149.177406:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7400, rc 0) 00000100:00100000:3.0:1746147149.177431:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32584:x1830967308186880:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4864us (5049us total) trans 8589936104 rc 0/0 00000100:00100000:3.0:1746147149.177436:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15386 00000100:00100000:0.0:1746147149.184457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.184591:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308187264 00000100:00100000:3.0:1746147149.184604:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308187264 00000100:00100000:3.0:1746147149.184655:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15387 00000100:00100000:3.0:1746147149.184663:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+10:32587:x1830967308187264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.184688:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.184706:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789a0 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.184768:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184779:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184788:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184799:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184805:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184809:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184899:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184907:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184913:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147149.184920:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.184976:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184982:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184986:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184991:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.184996:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.184999:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185005:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185017:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.185020:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.185023:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185027:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185053:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185058:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185063:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185067:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091e31a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.185069:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185073:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185079:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1500) 00010000:00010000:3.0:1746147149.185081:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.185083:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185087:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31a00/0x3139939425057717 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.185412:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 13 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.185426:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.185432:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.185434:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147149.185436:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbef000, rc 0) 00000100:00100000:3.0:1746147149.187697:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:32587:x1830967308187264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3026us (3243us total) trans 8589936105 rc 0/0 00000100:00100000:3.0:1746147149.187707:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15387 00000100:00100000:3.0:1746147149.193861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.194543:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308187392 00000100:00100000:2.0:1746147149.194552:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308187392 00000100:00100000:2.0:1746147149.194601:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15047 00000100:00100000:2.0:1746147149.194608:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308187392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.194624:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.194640:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789a7 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.194662:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.194663:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.194670:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.194684:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.194694:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714800, rc 0) 00000100:00100000:2.0:1746147149.194971:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308187392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 362us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.194978:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15047 00000100:00100000:0.0:1746147149.208423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.208552:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308187648 00000100:00100000:3.0:1746147149.208564:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308187648 00002000:00100000:3.0:1746147149.208614:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880091c3df80 x1830967308187648/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.208621:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3df80 with x1830967308187648 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.208625:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3df80 00000100:00100000:3.0:1746147149.208659:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3739 00000100:00100000:3.0:1746147149.208666:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308187648:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.211931:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.212084:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308187904 00000100:00100000:3.0:1746147149.212109:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308187904 00000100:00100000:3.0:1746147149.212148:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15388 00000100:00100000:3.0:1746147149.212156:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+12:32589:x1830967308187904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147149.212177:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.212195:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425057733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789ae expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.212253:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212263:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212271:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212282:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212287:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212292:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212363:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057748 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212370:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057748 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212375:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057748 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147149.212382:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.212431:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212437:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212446:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212451:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212456:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbee800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.212459:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212464:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212471:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.212473:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.212476:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212480:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x313993942505773a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212507:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212512:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212516:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212520:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.212522:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212530:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212535:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1500) 00010000:00010000:3.0:1746147149.212537:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.212539:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212543:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x3139939425057741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.212572:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425057733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ae expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.212581:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057748 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ae expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.212587:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.212588:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147149.212590:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6600, rc 0) 00000100:00100000:3.0:1746147149.212633:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+14:32589:x1830967308187904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 477us (708us total) trans 8589936106 rc 0/0 00000100:00100000:3.0:1746147149.212639:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15388 00000100:00100000:3.0:1746147149.218583:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308187648:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9907us (10163us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147149.218593:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3739 00002000:00100000:3.0:1746147149.218606:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880091c3df80 x1830967308187648/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.218618:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3df80 with x1830967308187648 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.218623:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3df80 00000100:00100000:0.0:1746147149.223557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.223650:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308188032 00000100:00100000:2.0:1746147149.223666:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308188032 00000100:00100000:2.0:1746147149.223742:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 825 00000100:00100000:2.0:1746147149.223750:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+14:2002:x1830967308188032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.223761:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.223782:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425057748 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ae expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.223824:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.223828:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.223878:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:2002:x1830967308188032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.223883:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 825 00000100:00100000:0.0:1746147149.235799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.235925:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308188288 00000100:00100000:3.0:1746147149.235935:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308188288 00002000:00100000:3.0:1746147149.235978:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3d500 x1830967308188288/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.235988:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3d500 with x1830967308188288 ext(4194304->4919295) 00002000:00010000:3.0:1746147149.235993:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3d500 00000100:00100000:3.0:1746147149.236056:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3740 00000100:00100000:3.0:1746147149.236064:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308188288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147149.242540:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308188288:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6467us (6741us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147149.242551:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3740 00002000:00100000:3.0:1746147149.242560:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880091c3d500 x1830967308188288/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.242569:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3d500 with x1830967308188288 ext(4194304->4919295) 00002000:00010000:3.0:1746147149.242574:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3d500 00000100:00100000:0.0:1746147149.249560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.249751:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308188544 00000100:00100000:3.0:1746147149.249760:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308188544 00000100:00100000:3.0:1746147149.249862:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5545 00000100:00100000:3.0:1746147149.249870:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+13:32587:x1830967308188544:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147149.250060:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:32587:x1830967308188544:12345-192.168.204.25@tcp:35:cat.0 Request processed in 190us (507us total) trans 8589936107 rc 0/0 00000100:00100000:3.0:1746147149.250070:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5545 00000100:00100000:0.0:1746147149.263524:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.263646:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308188800 00000100:00100000:3.0:1746147149.263656:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308188800 00000100:00100000:3.0:1746147149.263718:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15389 00000100:00100000:3.0:1746147149.263730:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32593:x1830967308188800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.263760:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.263787:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef400/0x3139939425057756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789b5 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.263888:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.263905:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.263917:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.263931:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.263938:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.263943:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264059:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264070:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264078:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147149.264135:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.264232:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264240:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264246:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264251:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264257:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.264261:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264267:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264280:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.264283:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.264288:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264293:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x313993942505775d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264341:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264350:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264354:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264359:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbee800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.264361:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264366:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264373:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1d00) 00010000:00010000:3.0:1746147149.264375:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.264377:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264382:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee800/0x3139939425057764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147149.264426:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef400/0x3139939425057756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.264440:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.264446:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.264448:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147149.264450:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee600, rc 0) 00000100:00100000:3.0:1746147149.264513:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32593:x1830967308188800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 783us (998us total) trans 8589936108 rc 0/0 00000100:00100000:3.0:1746147149.264521:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15389 00000100:00100000:0.0:1746147149.299267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.299593:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189056 00000100:00100000:3.0:1746147149.299774:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189056 00000100:00100000:3.0:1746147149.299856:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5546 00000100:00100000:3.0:1746147149.299866:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32593:x1830967308189056:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147149.299887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.300193:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189184 00000100:00100000:2.0:1746147149.300198:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189184 00000100:00100000:2.0:1746147149.300226:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15048 00000100:00100000:2.0:1746147149.300231:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32584:x1830967308189184:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147149.300242:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.300260:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789bc expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.300287:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.300326:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32593:x1830967308189056:12345-192.168.204.25@tcp:35:cat.0 Request processed in 461us (1069us total) trans 8589936109 rc 0/0 00000100:00100000:3.0:1746147149.300333:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5546 00010000:00010000:2.0:1746147149.301002:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 27 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.301010:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.301011:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.301015:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3747840->4194303] (req 3747840->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.301050:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 27 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.301063:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 27 pid: 17600 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.301143:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755584:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147149.301312:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.301320:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.301329:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.301397:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.302000:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.302133:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189312 00000100:00100000:1.0:1746147149.302139:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189312 00000100:00100000:1.0:1746147149.302185:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15049 00000100:00100000:1.0:1746147149.302191:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+28:32589:x1830967308189312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147149.302202:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.302215:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789c3 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.302237:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.302244:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.302249:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.302251:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.302253:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.302270:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.302278:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 46 pid: 1853 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.302287:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310755840:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.302341:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.302348:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.302355:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310755968:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.302373:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.303014:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147149.303021:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310755712:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147149.303046:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3747840->4194303] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.303055:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715c00, rc 0) 00000100:00100000:3.0:1746147149.303079:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32584:x1830967308189184:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2847us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.303085:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15048 00000100:00100000:0.0:1746147149.306447:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.306524:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189568 00000100:00100000:2.0:1746147149.306539:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189568 00010000:00010000:2.0:1746147149.306576:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.306591:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310755840:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147149.306597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.306604:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310755968:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.306613:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189440 00000100:00100000:2.0:1746147149.306615:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189440 00010000:00010000:2.0:1746147149.306625:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 30 pid: 17600 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746147149.306631:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.306639:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6662 00000100:00100000:2.0:1746147149.306646:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967308189568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147149.306647:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6663 00010000:00010000:1.0:1746147149.306648:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dce200, rc 0) 00000100:00100000:0.0:1746147149.306652:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308189440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.306659:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147149.306659:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.306678:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746147149.306678:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 30 pid: 17600 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.306687:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.306693:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+30:32589:x1830967308189312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4501us (4694us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147149.306695:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 30 pid: 17600 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.306700:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15049 00010000:00010000:2.0:1746147149.306720:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250576ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78992 expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746147149.306724:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714800/0x313993942505772c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a7 expref: 29 pid: 17600 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.306736:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147149.306738:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147149.306744:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 45 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.306751:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 45 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.306759:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.306777:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967308189568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 132us (342us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147149.306778:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 45 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.306783:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6662 00000100:00100000:0.0:1746147149.306788:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310756096:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147149.306888:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.308693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.308779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.308843:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189696 00000100:00100000:3.0:1746147149.308850:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189696 00000100:00100000:2.0:1746147149.308854:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308189824 00000100:00100000:2.0:1746147149.308857:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308189824 00010000:00010000:3.0:1746147149.308878:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 45 pid: 1853 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.308878:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.308900:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6664 00000100:00100000:2.0:1746147149.308905:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6665 00000100:00100000:3.0:1746147149.308906:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308189696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147149.308910:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308189824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.308918:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.308918:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.308932:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 45 pid: 1853 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.308932:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.308941:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.309167:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 45 pid: 1853 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.309188:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x31399394250576ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7896f expref: 29 pid: 1853 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.309192:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250576e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78984 expref: 45 pid: 1853 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.309205:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.309207:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.309212:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.309293:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.309455:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147149.309472:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.309483:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310756224:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.309490:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308189696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 584us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147149.309490:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310756096:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.309496:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6664 00010000:00010000:0.0:1746147149.309502:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147149.309518:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308189440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2866us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.309522:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.309524:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6663 00000100:00100000:0.0:1746147149.310351:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.310423:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308190080 00000100:00100000:3.0:1746147149.310428:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308190080 00002000:00100000:3.0:1746147149.310465:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3747840->3751935) req@ffff8800a897f480 x1830967308190080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.310474:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f480 with x1830967308190080 ext(3747840->3751935) 00002000:00010000:3.0:1746147149.310478:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897f480 00000100:00100000:3.0:1746147149.310597:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3741 00000100:00100000:3.0:1746147149.310604:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308190080:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147149.310738:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967308190080:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 134us (389us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147149.310745:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3741 00002000:00100000:3.0:1746147149.310751:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3747840->3751935) req@ffff8800a897f480 x1830967308190080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.310757:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f480 with x1830967308190080 ext(3747840->3751935) 00002000:00010000:3.0:1746147149.310760:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897f480 00000100:00100000:2.0:1746147149.311703:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310756224:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147149.311721:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.311759:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308189824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2848us (2979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.311767:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6665 00000100:00100000:0.0:1746147149.312495:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.312582:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308190336 00000100:00100000:2.0:1746147149.312588:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308190336 00002000:00100000:2.0:1746147149.312625:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1855488->1859583) req@ffff8800a897d180 x1830967308190336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.312634:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d180 with x1830967308190336 ext(1855488->1859583) 00002000:00010000:2.0:1746147149.312639:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897d180 00000100:00100000:2.0:1746147149.312662:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3742 00000100:00100000:2.0:1746147149.312669:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308190336:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147149.312770:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308190336:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 101us (276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.312776:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3742 00002000:00100000:2.0:1746147149.312781:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8e:0x0] (1855488->1859583) req@ffff8800a897d180 x1830967308190336/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.312793:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897d180 with x1830967308190336 ext(1855488->1859583) 00002000:00010000:2.0:1746147149.312795:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897d180 00000100:00100000:0.0:1746147149.315915:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.316018:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308190464 00000100:00100000:1.0:1746147149.316029:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308190464 00000100:00100000:1.0:1746147149.316082:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15050 00000100:00100000:1.0:1746147149.316120:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+27:32589:x1830967308190464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147149.316141:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.316162:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789ca expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.316293:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 43 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.316300:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147149.316302:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147149.316306:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->2580479] (req 2097152->2580479) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.316338:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 43 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.316351:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 43 pid: 17600 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.316364:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310756352:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.316454:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.317466:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310756352:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.317490:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->2580479] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.317502:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeee00, rc 0) 00000100:00100000:1.0:1746147149.317534:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+28:32589:x1830967308190464:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1444us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.317541:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15050 00000100:00100000:0.0:1746147149.318526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.318588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.318627:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308190720 00000100:00100000:3.0:1746147149.318634:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308190720 00002000:00100000:3.0:1746147149.318673:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3747840->4194303) req@ffff8800a897c380 x1830967308190720/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.318682:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c380 with x1830967308190720 ext(3747840->4194303) 00010000:00010000:3.0:1746147149.318690:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 44 pid: 17600 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.318707:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 44 pid: 17600 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.318714:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a897c380 00000100:00100000:1.0:1746147149.318720:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308190848 00000100:00100000:1.0:1746147149.318724:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308190848 00000100:00100000:3.0:1746147149.318741:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1177 00000100:00100000:1.0:1746147149.318755:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15051 00000100:00100000:1.0:1746147149.318762:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32584:x1830967308190848:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:3.0:1746147149.318766:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308190720:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:1.0:1746147149.318777:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.318794:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789d1 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.318828:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.318837:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.318845:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.318851:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.318852:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.318855:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [3145728->3563519] (req 3145728->3563519) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.318881:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.318890:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 13 pid: 12225 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.318901:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310756480:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.318988:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.318999:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 19 pid: 9586 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.319008:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310756608:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.319035:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.319043:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 31 pid: 1854 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.319051:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310756736:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.319068:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.323267:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308190720:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4506us (4732us total) trans 17179874288 rc 0/0 00000100:00100000:3.0:1746147149.323279:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1177 00002000:00100000:3.0:1746147149.323290:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3747840->4194303) req@ffff8800a897c380 x1830967308190720/t17179874288(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/448 e 0 to 0 dl 1746147160 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.323299:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897c380 with x1830967308190720 ext(3747840->4194303) 00010000:00010000:3.0:1746147149.323310:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.323324:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.323331:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a897c380 00000100:00100000:1.0:1746147149.323902:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310756480:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147149.324246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.324254:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310756608:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.324317:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308190976 00000100:00100000:2.0:1746147149.324324:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308190976 00010000:00010000:2.0:1746147149.324352:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 14 pid: 12225 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.324394:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6666 00000100:00100000:2.0:1746147149.324401:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308190976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.324415:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.324433:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 14 pid: 12225 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.324443:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 14 pid: 12225 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.324467:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3800/0x31399394250575a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ff expref: 14 pid: 12225 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.324496:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.324522:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308190976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 121us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.324528:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6666 00000100:00100000:0.0:1746147149.324696:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.324729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.325078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.325146:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308191104 00000100:00100000:1.0:1746147149.325150:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308191104 00010000:00010000:1.0:1746147149.325166:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 20 pid: 9586 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.325182:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308191232 00000100:00100000:1.0:1746147149.325184:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308191232 00010000:00010000:1.0:1746147149.325194:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 32 pid: 1854 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.325209:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308191360 00000100:00100000:1.0:1746147149.325211:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308191360 00010000:00010000:1.0:1746147149.325221:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.325234:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6667 00000100:00100000:1.0:1746147149.325238:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308191104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147149.325245:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147149.325254:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 20 pid: 9586 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746147149.325262:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 20 pid: 9586 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746147149.325276:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505767d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78945 expref: 20 pid: 9586 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746147149.325284:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6668 00010000:00010000:1.0:1746147149.325290:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147149.325291:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308191232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147149.325298:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147149.325306:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 32 pid: 1854 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.325308:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308191104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.325314:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6667 00010000:00010000:0.0:1746147149.325315:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 32 pid: 1854 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.325328:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147149.325330:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147149.325336:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.325344:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.325352:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6669 00000100:00100000:1.0:1746147149.325357:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308191360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147149.325364:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147149.325373:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147148 -> 1746147149 00010000:00010000:0.0:1746147149.325375:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147149.325376:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147148 -> 1746147149 00010000:00010000:1.0:1746147149.325380:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746147149.325387:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310756864:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147149.325389:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746147149.325401:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425057779 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789bc expref: 46 pid: 17600 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746147149.325410:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.325412:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.325415:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.325422:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.325428:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00010000:00010000:1.0:1746147149.325440:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.325448:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310756992:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147149.325651:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147149.326055:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0600/0x3139939425057550 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788c0 expref: 32 pid: 1854 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.326066:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310756736:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.326131:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.326140:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dce800, rc 0) 00000100:00100000:1.0:1746147149.326169:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32584:x1830967308190848:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7408us (7581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.326177:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15051 00000100:00100000:2.0:1746147149.330058:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310756992:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147149.330080:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.330140:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308191360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4781us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.330151:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6669 00000100:00100000:1.0:1746147149.330229:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310756864:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147149.330239:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147149.330253:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308191232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4964us (5524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.330259:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6668 00000100:00100000:1.0:1746147149.330746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.330947:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308191616 00000100:00100000:3.0:1746147149.330956:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308191616 00002000:00100000:3.0:1746147149.330999:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3559424->3563519) req@ffff880134ab0000 x1830967308191616/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.331009:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0000 with x1830967308191616 ext(3559424->3563519) 00002000:00010000:3.0:1746147149.331013:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab0000 00000100:00100000:3.0:1746147149.331432:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3743 00000100:00100000:3.0:1746147149.331442:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308191616:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147149.331602:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308191616:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 162us (857us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147149.331608:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3743 00002000:00100000:3.0:1746147149.331613:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (3559424->3563519) req@ffff880134ab0000 x1830967308191616/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.331620:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0000 with x1830967308191616 ext(3559424->3563519) 00002000:00010000:3.0:1746147149.331623:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab0000 00000100:00100000:0.0:1746147149.331837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.331893:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308191872 00000100:00100000:3.0:1746147149.331897:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308191872 00002000:00100000:3.0:1746147149.331913:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2576384->2580479) req@ffff8800a897ca80 x1830967308191872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.331927:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ca80 with x1830967308191872 ext(2576384->2580479) 00002000:00010000:3.0:1746147149.331930:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897ca80 00000100:00100000:3.0:1746147149.331951:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3744 00000100:00100000:3.0:1746147149.331956:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308191872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147149.332438:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308191872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 480us (599us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147149.332445:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3744 00002000:00100000:3.0:1746147149.332450:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2576384->2580479) req@ffff8800a897ca80 x1830967308191872/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.332457:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ca80 with x1830967308191872 ext(2576384->2580479) 00002000:00010000:3.0:1746147149.332460:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897ca80 00000100:00100000:0.0:1746147149.335521:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.335622:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308192128 00000100:00100000:3.0:1746147149.335630:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308192128 00000100:00100000:3.0:1746147149.335863:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5547 00000100:00100000:3.0:1746147149.335871:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+14:32589:x1830967308192128:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147149.336151:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:90095e6f-8cef-455a-9171-4caf9b613254+15:32589:x1830967308192128:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 281us (642us total) trans 8589936110 rc 0/0 00000100:00100000:3.0:1746147149.336158:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5547 00000100:00100000:0.0:1746147149.477532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.477907:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308192384 00000100:00100000:2.0:1746147149.477918:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308192384 00000100:00100000:2.0:1746147149.477983:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15390 00000100:00100000:2.0:1746147149.477992:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+15:32599:x1830967308192384:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.478017:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.478036:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425057795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789d8 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.478146:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.478160:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.478173:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.478185:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.478191:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.478196:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479744:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250577aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479765:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250577aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479776:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250577aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147149.479786:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147149.479870:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479881:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479886:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479892:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147149.479895:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479900:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479910:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147149.479913:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147149.479916:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479920:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x313993942505779c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479950:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479955:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479959:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479963:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147149.479965:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479973:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479978:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a300) 00010000:00010000:2.0:1746147149.479980:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147149.479982:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.479986:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x31399394250577a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.480041:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425057795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d8 expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.480052:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250577aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d8 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.480057:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.480059:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147149.480061:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714e00, rc 0) 00000100:00100000:2.0:1746147149.480152:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+17:32599:x1830967308192384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2160us (2631us total) trans 8589936111 rc 0/0 00000100:00100000:2.0:1746147149.480160:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15390 00000100:00100000:2.0:1746147149.485789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.485855:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.485888:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308192512 00000100:00100000:1.0:1746147149.485900:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308192512 00000100:00100000:3.0:1746147149.486199:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308192640 00000100:00100000:3.0:1746147149.486207:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308192640 00000100:00100000:3.0:1746147149.486267:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 826 00000100:00100000:3.0:1746147149.486276:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+17:2000:x1830967308192640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.486290:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.486322:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250577aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d8 expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.486400:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15052 00000100:00100000:1.0:1746147149.486408:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308192512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.486427:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.486445:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097035e00/0x31399394250577b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789df expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.486505:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310757120:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.486596:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147149.488492:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.488499:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.488557:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+16:2000:x1830967308192640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2279us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.488566:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 826 00002000:00010000:1.0:1746147149.492369:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime: 1746147148 -> 1746147149 00002000:00010000:1.0:1746147149.492379:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime: 1746147148 -> 1746147149 00002000:00010000:1.0:1746147149.492381:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime: 1746147148 -> 1746147149 00000100:00100000:1.0:1746147149.492411:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310757120:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.492454:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097035e00/0x31399394250577b8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789df expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.492471:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097035e00/0x31399394250577b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789df expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.493255:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097035e00, rc 0) 00000100:00100000:1.0:1746147149.493321:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+19:2002:x1830967308192512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6912us (7537us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.493329:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15052 00000100:00100000:0.0:1746147149.507772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.507849:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308192896 00000100:00100000:2.0:1746147149.507859:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308192896 00002000:00100000:2.0:1746147149.507909:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1855487) req@ffff8800a897df80 x1830967308192896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.507925:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897df80 with x1830967308192896 ext(1048576->1855487) 00002000:00010000:2.0:1746147149.507930:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897df80 00000100:00100000:2.0:1746147149.507972:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3745 00000100:00100000:2.0:1746147149.507981:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308192896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.518158:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308192896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10164us (10384us total) trans 0 rc 806912/806912 00000100:00100000:2.0:1746147149.518175:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3745 00002000:00100000:2.0:1746147149.518188:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1855487) req@ffff8800a897df80 x1830967308192896/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 806912/806912 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.518198:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897df80 with x1830967308192896 ext(1048576->1855487) 00002000:00010000:2.0:1746147149.518204:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897df80 00000100:00100000:0.0:1746147149.534798:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.535737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.535849:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308193408 00000100:00100000:3.0:1746147149.535860:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308193408 00000100:00100000:3.0:1746147149.535926:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15391 00000100:00100000:3.0:1746147149.535937:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32602:x1830967308193408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.535968:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.535995:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x31399394250577bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789e6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.536118:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536132:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536144:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536157:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536162:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536167:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536263:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250577d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536272:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250577d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536278:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250577d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147149.536285:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.536355:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536361:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536367:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536371:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c11800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.536375:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536381:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536391:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.536393:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.536397:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536401:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11800/0x31399394250577c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536420:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536424:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536429:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536432:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c10e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.536433:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536437:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536441:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096bb1d00) 00010000:00010000:3.0:1746147149.536442:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.536444:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536447:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10e00/0x31399394250577cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.536481:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c11400/0x31399394250577bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789e6 expref: 38 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.536492:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250577d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789e6 expref: 37 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.536498:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.536500:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147149.536503:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c10400, rc 0) 00000100:00100000:3.0:1746147149.536567:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32602:x1830967308193408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 631us (832us total) trans 8589936112 rc 0/0 00000100:00100000:3.0:1746147149.536574:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15391 00000100:00100000:2.0:1746147149.536865:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308193152 00000100:00100000:2.0:1746147149.536871:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308193152 00002000:00100000:2.0:1746147149.536903:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2580480->3145727) req@ffff8800a897ea00 x1830967308193152/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.536914:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ea00 with x1830967308193152 ext(2580480->3145727) 00002000:00010000:2.0:1746147149.536918:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897ea00 00000100:00100000:2.0:1746147149.536932:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3746 00000100:00100000:2.0:1746147149.536938:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308193152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.542571:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308193152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5619us (7773us total) trans 0 rc 565248/565248 00000100:00100000:2.0:1746147149.542585:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3746 00002000:00100000:2.0:1746147149.542599:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2580480->3145727) req@ffff8800a897ea00 x1830967308193152/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.542611:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897ea00 with x1830967308193152 ext(2580480->3145727) 00002000:00010000:2.0:1746147149.542618:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a897ea00 00000100:00100000:0.0:1746147149.542641:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.542691:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308193536 00000100:00100000:1.0:1746147149.542701:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308193536 00000100:00100000:1.0:1746147149.542734:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15053 00000100:00100000:1.0:1746147149.542743:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967308193536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.542762:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.542783:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097034800/0x31399394250577e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789ed expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.542856:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310757248:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.544076:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.544345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.545063:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308193664 00000100:00100000:2.0:1746147149.545076:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308193664 00000100:00100000:2.0:1746147149.545280:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15054 00000100:00100000:2.0:1746147149.545292:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2003:x1830967308193664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.545317:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.545346:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250577e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789f4 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.545415:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310757376:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147149.546468:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.566263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.566342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.566371:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.566389:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.566412:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308194304 00000100:00100000:3.0:1746147149.566420:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308194304 00000100:00100000:3.0:1746147149.566458:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15055 00000100:00100000:3.0:1746147149.566466:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:32599:x1830967308194304:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.566485:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.566504:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a09 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.566537:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.566544:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147149.566546:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147149.566549:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.566578:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.566596:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 29 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.566608:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310757504:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147149.566688:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.566707:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308193920 00000100:00100000:3.0:1746147149.566709:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308193920 00000100:00100000:3.0:1746147149.566733:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 827 00000100:00100000:3.0:1746147149.566738:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308193920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.566749:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.566769:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c10400/0x31399394250577d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789e6 expref: 37 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.566787:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.566790:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.566820:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308193920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.566826:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 827 00000100:00100000:2.0:1746147149.566907:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308194176 00000100:00100000:2.0:1746147149.566912:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308194176 00000100:00100000:2.0:1746147149.566944:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308193792 00000100:00100000:2.0:1746147149.566947:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308193792 00000100:00100000:3.0:1746147149.566952:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15392 00000100:00100000:3.0:1746147149.566957:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+16:32606:x1830967308194176:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:2.0:1746147149.566963:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15393 00000100:00100000:2.0:1746147149.566968:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32603:x1830967308193792:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147149.566971:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.566983:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x31399394250577f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a02 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.566983:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.566991:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250577fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e789fb expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.567040:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.567048:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147149.567051:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567061:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567071:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567076:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567080:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567170:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567181:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.567186:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.567205:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.567213:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 35 pid: 7238 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.567221:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310757632:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.567256:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e86c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147149.567295:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime: 1746147148 -> 1746147149 00000100:00100000:2.0:1746147149.567311:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310757376:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.567337:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250577e9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789f4 expref: 48 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.567347:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250577e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789f4 expref: 48 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.567360:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:2.0:1746147149.567386:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2003:x1830967308193664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 22093us (23039us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.567393:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15054 00002000:00010000:2.0:1746147149.567440:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime: 1746147148 -> 1746147149 00002000:00010000:2.0:1746147149.567442:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime: 1746147148 -> 1746147149 00002000:00010000:2.0:1746147149.567444:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime: 1746147148 -> 1746147149 00000100:00100000:2.0:1746147149.567451:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310757248:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.567466:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097034800/0x31399394250577e2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ed expref: 46 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.567475:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097034800/0x31399394250577e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ed expref: 46 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.567482:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034800, rc 0) 00000100:00100000:2.0:1746147149.567499:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967308193536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 24758us (24861us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.567505:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15053 00010000:00010000:3.0:1746147149.568644:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568658:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568672:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568679:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568685:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568770:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057828 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568778:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057828 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568783:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057828 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147149.568791:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.568876:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568883:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568893:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568899:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568905:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.568908:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568915:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568924:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.568926:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.568929:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568932:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91c00/0x313993942505780c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568942:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568946:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568950:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568954:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.568957:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568965:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568970:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a600) 00010000:00010000:3.0:1746147149.568972:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.568974:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.568978:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91600/0x3139939425057821 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.569021:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x31399394250577f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a02 expref: 19 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.569031:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057828 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a02 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.569038:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.569040:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147149.569043:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.569047:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.569051:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91400, rc 0) 00000100:00100000:3.0:1746147149.570347:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+18:32606:x1830967308194176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3382us (4086us total) trans 8589936113 rc 0/0 00000100:00100000:3.0:1746147149.570357:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15392 00000100:00100000:0.0:1746147149.570934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.571001:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308194560 00000100:00100000:3.0:1746147149.571010:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308194560 00000100:00100000:3.0:1746147149.571043:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15394 00000100:00100000:3.0:1746147149.571050:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32607:x1830967308194560:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147149.571070:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.571086:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91000/0x3139939425057836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a10 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.571183:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571194:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571203:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571213:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571218:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571224:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571306:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446400/0x313993942505784b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571315:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098446400/0x313993942505784b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571321:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446400/0x313993942505784b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147149.571332:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147149.571409:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571416:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571421:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571426:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571431:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098446000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.571434:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571440:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571449:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147149.571452:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.571455:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571459:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446000/0x313993942505783d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571468:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571473:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571481:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571485:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098446c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147149.571487:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571491:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571496:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a600) 00010000:00010000:3.0:1746147149.571498:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147149.571500:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571504:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446c00/0x3139939425057844 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147149.571531:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91000/0x3139939425057836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a10 expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.571541:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446400/0x313993942505784b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a10 expref: 38 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.571545:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.571547:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147149.571549:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.571553:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.571561:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446400, rc 0) 00000100:00100000:3.0:1746147149.571616:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32607:x1830967308194560:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 566us (682us total) trans 8589936114 rc 0/0 00000100:00100000:3.0:1746147149.571622:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15394 00000100:00100000:0.0:1746147149.576293:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.576314:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310757504:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147149.576330:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147149.576347:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.576366:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c10e00, rc 0) 00000100:00100000:3.0:1746147149.576414:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32599:x1830967308194304:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9947us (10022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.576423:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15055 00000100:00100000:2.0:1746147149.576467:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308194816 00000100:00100000:2.0:1746147149.576475:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308194816 00000100:00100000:3.0:1746147149.576479:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308194688 00000100:00100000:3.0:1746147149.576483:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308194688 00002000:00100000:3.0:1746147149.576513:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3563519) req@ffff8800a897f100 x1830967308194688/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147149.576518:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 828 00002000:00100000:3.0:1746147149.576521:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f100 with x1830967308194688 ext(3145728->3563519) 00010000:00010000:3.0:1746147149.576527:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.576530:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:2001:x1830967308194816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.576538:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.576544:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a897f100 00010000:00010000:2.0:1746147149.576544:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147149.576563:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1178 00010000:00010000:2.0:1746147149.576567:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425057828 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a02 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.576570:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308194688:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:2.0:1746147149.576582:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.576588:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.576595:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.576600:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.576605:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.576623:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+17:2001:x1830967308194816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.576628:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 828 00000100:00100000:1.0:1746147149.581398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.581467:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195072 00000100:00100000:0.0:1746147149.581478:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195072 00000100:00100000:1.0:1746147149.581486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.581643:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310757632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147149.581674:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5548 00010000:00010000:2.0:1746147149.581675:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147149.581677:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195200 00000100:00100000:0.0:1746147149.581682:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:30749:x1830967308195072:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147149.581683:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195200 00000100:00100000:3.0:1746147149.581800:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15056 00000100:00100000:3.0:1746147149.581820:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32602:x1830967308195200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.581836:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147149.581843:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147149.581854:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a17 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.581870:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195328 00000100:00100000:2.0:1746147149.581876:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195328 00000100:00100000:0.0:1746147149.581880:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:30749:x1830967308195072:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 198us (495us total) trans 8589936115 rc 0/0 00010000:00010000:3.0:1746147149.581881:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.581888:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5548 00010000:00010000:3.0:1746147149.581889:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147149.581890:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147149.581893:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.581919:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 829 00010000:00010000:3.0:1746147149.581921:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.581927:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967308195328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.581932:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 27 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.581939:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147149.581943:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310757760:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147149.581965:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446400/0x313993942505784b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a10 expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.581982:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.581987:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.581995:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.582000:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.582005:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.582006:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.582040:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967308195328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.582047:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 829 00000100:00100000:0.0:1746147149.586610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.586888:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195456 00000100:00100000:2.0:1746147149.586900:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195456 00010000:00010000:2.0:1746147149.586953:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 38 pid: 7238 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.586959:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310757760:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.586989:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6670 00000100:00100000:2.0:1746147149.586998:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967308195456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.586999:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.587011:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.587017:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447200, rc 0) 00010000:00010000:2.0:1746147149.587017:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 38 pid: 7238 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.587026:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 38 pid: 7238 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.587050:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x31399394250576fb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78999 expref: 38 pid: 7238 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.587067:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.587071:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.587080:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.587110:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.587131:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.587171:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967308195456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 173us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.587177:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6670 00010000:00010000:1.0:1746147149.587262:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587279:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147149.587318:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147149.587322:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147149.587336:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587347:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587355:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587360:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587365:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587369:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.587372:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587377:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587387:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147149.587389:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.587392:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587396:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425057805 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587412:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587416:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587420:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587423:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714200 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:3.0:1746147149.587425:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32602:x1830967308195200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5618us (5940us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147149.587425:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587429:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147149.587433:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15056 00010000:00010000:1.0:1746147149.587434:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823a600) 00010000:00010000:1.0:1746147149.587436:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.587438:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587442:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714200/0x3139939425057813 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.587473:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250577fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.587485:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.587491:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.587493:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147149.587495:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f960a00, rc 0) 00000100:00100000:1.0:1746147149.587539:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32603:x1830967308193792:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 20569us (21195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.587547:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15393 00000100:00100000:0.0:1746147149.590102:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.590156:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195584 00000100:00100000:2.0:1746147149.590165:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195584 00002000:00100000:2.0:1746147149.590209:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1855488->2097151) req@ffff88011db16300 x1830967308195584/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.590219:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16300 with x1830967308195584 ext(1855488->2097151) 00010000:00010000:2.0:1746147149.590228:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 28 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.590242:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 28 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746147149.590254:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db16300 00000100:00100000:2.0:1746147149.590291:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1179 00000100:00100000:2.0:1746147149.590301:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+28:2000:x1830967308195584:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147149.590648:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a897f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967308194688:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 14073us (14361us total) trans 21474841546 rc 0/0 00000100:00100000:1.0:1746147149.590658:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1178 00002000:00100000:1.0:1746147149.590666:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->3563519) req@ffff8800a897f100 x1830967308194688/t21474841546(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/448 e 0 to 0 dl 1746147160 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.590675:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a897f100 with x1830967308194688 ext(3145728->3563519) 00010000:00010000:1.0:1746147149.590683:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746147149.590693:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746147149.590699:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a897f100 00000100:00100000:0.0:1746147149.596894:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.597442:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308195584:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7140us (7360us total) trans 17179874289 rc 0/0 00000100:00100000:2.0:1746147149.597454:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1179 00002000:00100000:2.0:1746147149.597466:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1855488->2097151) req@ffff88011db16300 x1830967308195584/t17179874289(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/448 e 0 to 0 dl 1746147160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.597475:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16300 with x1830967308195584 ext(1855488->2097151) 00010000:00010000:2.0:1746147149.597486:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.597499:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746147149.597507:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db16300 00000100:00100000:3.0:1746147149.597579:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195712 00000100:00100000:3.0:1746147149.597589:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195712 00000100:00100000:3.0:1746147149.597636:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15057 00000100:00100000:3.0:1746147149.597644:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308195712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147149.597659:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147149.597839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.597861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.597877:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308196096 00000100:00100000:2.0:1746147149.597880:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308196096 00010000:00010000:2.0:1746147149.597897:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746147149.597927:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195840 00000100:00100000:2.0:1746147149.597931:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6671 00000100:00100000:0.0:1746147149.597931:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195840 00000100:00100000:2.0:1746147149.597937:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308196096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.597949:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147149.597952:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15058 00000100:00100000:0.0:1746147149.597957:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308195840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147149.597964:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.597967:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746147149.597975:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425057860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a25 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.597977:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.597999:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091dce800/0x313993942505778e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789d1 expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.598013:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.598015:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.598023:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.598027:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310757888:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.598030:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.598053:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.598061:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310758016:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147149.598085:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.598085:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.598159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147149.598160:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098447400/0x3139939425057867 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a1e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.598171:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308195968 00000100:00100000:2.0:1746147149.598173:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308195968 00000100:00100000:3.0:1746147149.598188:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310758144:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147149.598191:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15059 00000100:00100000:2.0:1746147149.598196:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308195968:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147149.598203:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.598210:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a2c expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.598220:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.598222:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.598226:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.598236:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147149.598242:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147149.598244:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20a00, rc 0) 00000100:00100000:2.0:1746147149.598265:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308195968:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 69us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.598271:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15059 00000100:00100000:3.0:1746147149.606924:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310758016:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147149.606936:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310758144:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147149.606950:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147149.606961:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098447400/0x3139939425057867 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a1e expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.606973:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098447400/0x3139939425057867 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a1e expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.606987:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447400, rc 0) 00000100:00100000:2.0:1746147149.607066:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310757888:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.607081:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425057860 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a25 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.607117:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425057860 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a25 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.607128:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e600, rc 0) 00000100:00100000:3.0:1746147149.607546:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967308196096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9606us (9681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147149.607559:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308195712:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9917us (10676us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147149.607567:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15057 00000100:00100000:3.0:1746147149.607660:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6671 00000100:00100000:2.0:1746147149.607660:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308195840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9702us (9820us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.607665:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15058 00000100:00100000:2.0:1746147149.610580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.610835:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308196224 00000100:00100000:3.0:1746147149.610844:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308196224 00010000:00010000:3.0:1746147149.610879:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.610919:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6672 00000100:00100000:3.0:1746147149.610926:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+30:2001:x1830967308196224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.610939:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.610958:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.610969:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.610991:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091dce200/0x3139939425057780 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789c3 expref: 30 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.611008:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.611010:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.611016:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.611024:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.611053:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.611063:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310758272:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.611159:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.615114:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.615464:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310758272:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147149.615488:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147149.615495:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308196480 00000100:00100000:1.0:1746147149.615502:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308196480 00000100:00100000:3.0:1746147149.615531:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+29:2001:x1830967308196224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4605us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.615541:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6672 00000100:00100000:1.0:1746147149.615547:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15395 00000100:00100000:1.0:1746147149.615553:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32603:x1830967308196480:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147149.615574:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.615594:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425057875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a33 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.615696:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.615712:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.615724:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.615758:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.615770:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 11 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.615781:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310758400:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.615857:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.616293:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.616320:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.616489:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308196736 00000100:00100000:2.0:1746147149.616491:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308196992 00000100:00100000:2.0:1746147149.616494:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308196992 00000100:00100000:1.0:1746147149.616494:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308196736 00002000:00100000:2.0:1746147149.616523:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011db15880 x1830967308196992/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.616523:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011db14a80 x1830967308196736/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.616533:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15880 with x1830967308196992 ext(3145728->4194303) 00002000:00100000:1.0:1746147149.616533:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967308196736 ext(2097152->4194303) 00002000:00010000:2.0:1746147149.616537:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db15880 00002000:00010000:1.0:1746147149.616537:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14a80 00000100:00100000:2.0:1746147149.616552:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3747 00000100:00100000:2.0:1746147149.616558:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308196992:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147149.616585:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3748 00000100:00100000:1.0:1746147149.616589:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308196736:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.621897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.622151:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308197248 00000100:00100000:2.0:1746147149.622162:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308197248 00002000:00100000:2.0:1746147149.622213:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db14700 x1830967308197248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.622224:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967308197248 ext(1048576->2097151) 00002000:00010000:2.0:1746147149.622230:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14700 00000100:00100000:2.0:1746147149.622271:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3749 00000100:00100000:2.0:1746147149.622279:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308197248:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.627736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.627822:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308197376 00000100:00100000:0.0:1746147149.627829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.627833:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308197376 00000100:00100000:2.0:1746147149.627901:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15060 00000100:00100000:2.0:1746147149.627910:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32607:x1830967308197376:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147149.627936:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.627959:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a3a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.627991:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.628000:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.628008:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 13 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.628014:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.628016:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.628020:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1200128->1724415] (req 1200128->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.628060:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 13 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.628072:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 13 pid: 1398 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.628126:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310758528:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147149.628240:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308197504 00000100:00100000:3.0:1746147149.628244:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308197504 00010000:00010000:3.0:1746147149.628267:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 12 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.628287:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6673 00000100:00100000:3.0:1746147149.628292:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308197504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.628303:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.628310:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 12 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.628319:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 12 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.628356:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310758400:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.628684:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.628774:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f960a00/0x313993942505781a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789fb expref: 12 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.628795:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.628800:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.628816:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.628825:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.629152:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147149.629156:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.629163:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147149.629182:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308197504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 888us (1351us total) trans 0 rc 0/0 00000004:00200000:1.0:1746147149.629183:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:3.0:1746147149.629188:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6673 00000100:00100000:3.0:1746147149.629291:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+29:2000:x1830967308196992:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12733us (12970us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147149.629299:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3747 00002000:00100000:3.0:1746147149.629309:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88011db15880 x1830967308196992/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147149.629317:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425057875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147149.629318:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15880 with x1830967308196992 ext(3145728->4194303) 00002000:00010000:3.0:1746147149.629322:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db15880 00010000:00010000:1.0:1746147149.629335:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.629340:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.629343:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147149.629345:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097035800, rc 0) 00000100:00100000:1.0:1746147149.629374:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32603:x1830967308196480:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 13820us (16880us total) trans 8589936116 rc 0/0 00000100:00100000:1.0:1746147149.629380:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15395 00010000:00010000:2.0:1746147149.629560:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.629577:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 21 pid: 1136 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.629594:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310758656:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147149.629644:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.629651:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.629659:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310758784:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.629679:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.630715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.631260:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308197632 00000100:00100000:0.0:1746147149.631268:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308197632 00000100:00100000:0.0:1746147149.631313:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15061 00000100:00100000:0.0:1746147149.631320:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+29:32606:x1830967308197632:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147149.631338:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147149.631354:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a41 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.631380:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.631387:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147149.631389:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147149.631393:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1388544->1900543] (req 1388544->1900543) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.631417:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.631426:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746147149.631437:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310758912:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147149.631516:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.637017:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310758528:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147149.637017:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310758912:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.637033:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a897c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310758656:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.637041:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310758784:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147149.637050:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1388544->1900543] (req 1388544->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.637064:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1200128->1724415] (req 1200128->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147149.637067:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e800, rc 0) 00010000:00010000:2.0:1746147149.637075:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d600, rc 0) 00000100:00100000:2.0:1746147149.637425:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:32607:x1830967308197376:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9514us (9701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147149.637425:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:32606:x1830967308197632:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6104us (6711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.637434:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15060 00000100:00100000:0.0:1746147149.637439:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15061 00000100:00100000:1.0:1746147149.637763:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308196736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21171us (21469us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147149.637774:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3748 00002000:00100000:1.0:1746147149.637785:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88011db14a80 x1830967308196736/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.637795:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967308196736 ext(2097152->4194303) 00002000:00010000:1.0:1746147149.637800:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14a80 00000100:00100000:2.0:1746147149.639289:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308197248:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17003us (17396us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147149.639299:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3749 00002000:00100000:2.0:1746147149.639307:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88011db14700 x1830967308197248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.639315:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967308197248 ext(1048576->2097151) 00010000:00010000:2.0:1746147149.639324:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 46 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.639336:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 46 pid: 9586 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746147149.639343:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db14700 00000100:00100000:0.0:1746147149.639570:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.639640:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308197888 00000100:00100000:2.0:1746147149.639648:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308197888 00000100:00100000:0.0:1746147149.639656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147149.639674:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 20 pid: 1136 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.639694:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308197760 00000100:00100000:2.0:1746147149.639697:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308197760 00010000:00010000:2.0:1746147149.639708:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 14 pid: 1398 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746147149.639712:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6674 00000100:00100000:0.0:1746147149.639720:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308197888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147149.639723:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6675 00000100:00100000:2.0:1746147149.639727:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308197760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.639733:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147149.639733:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.639749:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 14 pid: 1398 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.639750:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 20 pid: 1136 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.639757:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 14 pid: 1398 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.640988:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 20 pid: 1136 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.641024:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0a00/0x3139939425057581 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ea expref: 14 pid: 1398 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.641033:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeea00/0x3139939425057668 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78930 expref: 20 pid: 1136 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.641038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147149.641057:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.641165:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308197760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1434us (1506us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147149.641171:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.641172:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6675 00000100:00100000:1.0:1746147149.641183:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198144 00000100:00100000:1.0:1746147149.641188:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198144 00000100:00100000:1.0:1746147149.641212:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308197888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1492us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.641217:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6674 00000100:00100000:2.0:1746147149.641233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.641250:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198016 00000100:00100000:2.0:1746147149.641253:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198016 00000100:00100000:1.0:1746147149.641256:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15396 00000100:00100000:1.0:1746147149.641261:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32603:x1830967308198144:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147149.641270:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.641286:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6676 00010000:00010000:1.0:1746147149.641287:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147149.641291:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967308198016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.641302:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147149.641305:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425057898 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a48 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.641316:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.641325:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.641336:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4600/0x3139939425057549 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788b2 expref: 32 pid: 9586 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746147149.641349:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.641351:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.641358:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.641366:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.641398:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.641402:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147149.641411:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310759040:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147149.641418:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.641425:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.641443:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.641452:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 12 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.641459:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310759168:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.641478:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.641479:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.646687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.647656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.647762:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310759040:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147149.647762:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310759168:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147149.647781:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147149.647782:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147149.647833:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308198016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6540us (6598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.647845:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6676 00000100:00100000:1.0:1746147149.647869:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198272 00000100:00100000:1.0:1746147149.647876:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198272 00000100:00100000:1.0:1746147149.647912:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198400 00000100:00100000:1.0:1746147149.647914:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198400 00000100:00100000:1.0:1746147149.647928:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15062 00000100:00100000:1.0:1746147149.647934:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308198272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.647951:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.647968:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dce200/0x31399394250578a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a4f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.648014:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310759296:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.648059:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.648078:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15063 00000100:00100000:1.0:1746147149.648083:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308198400:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.648108:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.648118:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250578ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a56 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.648130:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.648140:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250578ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a56 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.648150:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372dc00/0x31399394250578ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a56 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.648163:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372dc00, rc 0) 00000100:00100000:1.0:1746147149.648179:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+30:2002:x1830967308198400:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (525us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.648187:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15063 00010000:00010000:2.0:1746147149.648399:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147149.648543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.648575:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.648593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.648609:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198784 00000100:00100000:3.0:1746147149.648613:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198784 00000100:00100000:3.0:1746147149.648634:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198656 00000100:00100000:3.0:1746147149.648636:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198656 00000100:00100000:0.0:1746147149.648638:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.648655:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198912 00000100:00100000:3.0:1746147149.648658:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198912 00000100:00100000:3.0:1746147149.648673:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15064 00000100:00100000:3.0:1746147149.648678:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2002:x1830967308198784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.648686:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.648694:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250578b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a64 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.648721:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310759424:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.648783:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15065 00000100:00100000:1.0:1746147149.648789:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2002:x1830967308198656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.648796:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.648802:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250578bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a5d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.648821:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.648826:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250578bb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a5d expref: 49 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.648834:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250578bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a5d expref: 49 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.648841:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:3.0:1746147149.648855:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.648857:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2002:x1830967308198656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 69us (263us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.648862:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15065 00000100:00100000:3.0:1746147149.648874:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15066 00000100:00100000:3.0:1746147149.648880:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967308198912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.648887:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.648895:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a6b expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.648905:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.648906:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.648913:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147149.648925:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147149.648933:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:3.0:1746147149.648948:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967308198912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.649317:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15066 00000100:00100000:2.0:1746147149.649349:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308198528 00000100:00100000:2.0:1746147149.649353:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308198528 00010000:00010000:2.0:1746147149.649370:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 13 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.649399:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6677 00000100:00100000:2.0:1746147149.649404:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308198528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.649414:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.649419:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 13 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.649428:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 13 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.649442:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x313993942505787c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a33 expref: 13 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.649454:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.649458:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.649466:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.649472:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.649485:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.649505:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308198528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.649510:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6677 00010000:00010000:1.0:1746147149.649725:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.649732:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147149.649782:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147149.649787:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147149.649813:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.649843:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x3139939425057898 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.649854:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.649859:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.649861:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147149.649863:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034e00, rc 0) 00000100:00100000:1.0:1746147149.649896:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32603:x1830967308198144:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8634us (8859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.649902:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15396 00000100:00100000:0.0:1746147149.650055:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.650216:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308199168 00000100:00100000:2.0:1746147149.650220:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308199168 00002000:00100000:2.0:1746147149.650244:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1200128->1204223) req@ffff88011db15c00 x1830967308199168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.650258:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15c00 with x1830967308199168 ext(1200128->1204223) 00002000:00010000:2.0:1746147149.650262:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15c00 00000100:00100000:2.0:1746147149.650275:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3750 00000100:00100000:2.0:1746147149.650280:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967308199168:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147149.650377:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967308199168:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 96us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.650385:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3750 00002000:00100000:2.0:1746147149.650389:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1200128->1204223) req@ffff88011db15c00 x1830967308199168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.650395:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15c00 with x1830967308199168 ext(1200128->1204223) 00002000:00010000:2.0:1746147149.650398:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15c00 00002000:00010000:1.0:1746147149.650598:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746147148 -> 1746147149 00002000:00010000:1.0:1746147149.650602:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147148 -> 1746147149 00002000:00010000:1.0:1746147149.650604:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746147148 -> 1746147149 00000100:00100000:1.0:1746147149.650613:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310759296:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.650631:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091dce200/0x31399394250578a6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a4f expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.650641:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091dce200/0x31399394250578a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a4f expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.650649:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dce200, rc 0) 00000100:00100000:1.0:1746147149.650671:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308198272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2737us (3999us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.650676:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15062 00000100:00100000:1.0:1746147149.651422:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.651623:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308199296 00000100:00100000:3.0:1746147149.651629:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308199296 00010000:00010000:3.0:1746147149.651649:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 48 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.651667:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6678 00000100:00100000:3.0:1746147149.651672:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308199296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.651680:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.651692:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 48 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.651702:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 48 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.651723:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098447200/0x3139939425057859 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a17 expref: 48 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.651738:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.651739:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.651746:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.651752:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.651775:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.651785:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310759552:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.651838:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.651964:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310759424:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.651979:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250578b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a64 expref: 47 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.651987:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250578b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a64 expref: 47 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.651995:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33200, rc 0) 00000100:00100000:2.0:1746147149.652017:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308198784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3338us (3440us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.652022:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15064 00000100:00100000:0.0:1746147149.652314:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.652358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.652377:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.652397:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308199424 00000100:00100000:0.0:1746147149.652400:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308199424 00000100:00100000:0.0:1746147149.652420:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308199680 00000100:00100000:0.0:1746147149.652422:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308199680 00000100:00100000:0.0:1746147149.652433:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308199552 00000100:00100000:0.0:1746147149.652434:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308199552 00000100:00100000:0.0:1746147149.652444:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15067 00000100:00100000:0.0:1746147149.652450:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308199424:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147149.652461:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147149.652474:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a1e000/0x31399394250578c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a72 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.652498:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310759680:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147149.652523:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.652539:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15068 00000100:00100000:0.0:1746147149.652543:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308199680:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147149.652549:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147149.652557:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a1ec00/0x31399394250578d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a80 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.652577:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310759808:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147149.652593:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.652656:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15069 00000100:00100000:3.0:1746147149.652662:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308199552:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147149.652667:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.652673:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250578d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a79 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.652694:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310759936:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147149.652727:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.655723:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310759552:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147149.655747:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.655802:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967308199296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4128us (4379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.655823:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6678 00000100:00100000:0.0:1746147149.657316:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.657363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.657402:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308199936 00000100:00100000:2.0:1746147149.657413:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308199936 00000100:00100000:3.0:1746147149.657486:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308200192 00000100:00100000:3.0:1746147149.657489:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308200192 00000100:00100000:1.0:1746147149.657513:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310759680:192.168.204.25@tcp:106: 00002000:00100000:3.0:1746147149.657514:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88011db17480 x1830967308200192/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.657529:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17480 with x1830967308200192 ext(4194304->4919295) 00002000:00010000:3.0:1746147149.657535:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17480 00010000:00010000:1.0:1746147149.657546:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a1e000/0x31399394250578c9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a72 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746147149.657556:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1896448->1900543) req@ffff88011db16680 x1830967308199936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147149.657559:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a1e000/0x31399394250578c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a72 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147149.657560:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3751 00002000:00100000:2.0:1746147149.657563:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16680 with x1830967308199936 ext(1896448->1900543) 00002000:00010000:2.0:1746147149.657567:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db16680 00000100:00100000:3.0:1746147149.657568:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967308200192:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147149.657571:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e000, rc 0) 00000100:00100000:2.0:1746147149.657579:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3752 00000100:00100000:2.0:1746147149.657583:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308199936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147149.657609:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308199424:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5159us (5295us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.657617:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15067 00000100:00100000:2.0:1746147149.657684:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308199936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 100us (383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.657689:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3752 00002000:00100000:2.0:1746147149.657695:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1896448->1900543) req@ffff88011db16680 x1830967308199936/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.657702:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16680 with x1830967308199936 ext(1896448->1900543) 00002000:00010000:2.0:1746147149.657705:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db16680 00000100:00100000:0.0:1746147149.658258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.658353:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308200320 00000100:00100000:1.0:1746147149.658356:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308200320 00000100:00100000:1.0:1746147149.658703:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15070 00000100:00100000:1.0:1746147149.658817:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:32602:x1830967308200320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.658910:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.658929:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a87 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.658953:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.658962:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147149.658964:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147149.658967:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.659000:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.659013:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 31 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.659025:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310760064:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.659077:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.660414:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310759808:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147149.660442:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a1ec00/0x31399394250578d0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a80 expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.660456:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1ec00/0x31399394250578d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a80 expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.660472:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1ec00, rc 0) 00000100:00100000:0.0:1746147149.660500:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308199680:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7955us (8140us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147149.660506:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15068 00000100:00100000:3.0:1746147149.660543:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310759936:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147149.660560:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250578d7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a79 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147149.660570:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x31399394250578d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a79 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147149.661077:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:3.0:1746147149.661269:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308199552:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8605us (8888us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147149.661275:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15069 00000100:00100000:1.0:1746147149.662200:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310760064:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.662226:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.662239:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dce800, rc 0) 00000100:00100000:1.0:1746147149.662275:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32602:x1830967308200320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3469us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.662281:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15070 00000100:00100000:0.0:1746147149.663454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.663502:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.663521:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308200448 00000100:00100000:3.0:1746147149.663530:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308200448 00002000:00100000:3.0:1746147149.663577:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2580479) req@ffff88011db14000 x1830967308200448/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.663586:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14000 with x1830967308200448 ext(2097152->2580479) 00010000:00010000:3.0:1746147149.663594:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.663609:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.663616:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db14000 00000100:00100000:1.0:1746147149.663686:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308200704 00000100:00100000:1.0:1746147149.663690:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308200704 00000100:00100000:1.0:1746147149.663725:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5549 00000100:00100000:1.0:1746147149.663732:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+17:32606:x1830967308200704:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147149.663937:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:90095e6f-8cef-455a-9171-4caf9b613254+18:32606:x1830967308200704:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 204us (433us total) trans 8589936117 rc 0/0 00000100:00100000:1.0:1746147149.663948:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5549 00000100:00100000:3.0:1746147149.663990:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1180 00000100:00100000:3.0:1746147149.663995:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+32:2003:x1830967308200448:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147149.664476:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967308200192:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6908us (7111us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147149.664483:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3751 00002000:00100000:2.0:1746147149.664489:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88011db17480 x1830967308200192/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.664495:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17480 with x1830967308200192 ext(4194304->4919295) 00010000:00010000:2.0:1746147149.664500:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.664510:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746147149.664516:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db17480 00000100:00100000:1.0:1746147149.670880:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.670930:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.671006:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.671065:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308201344 00000100:00100000:0.0:1746147149.671074:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308201344 00000100:00100000:0.0:1746147149.671120:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308201472 00000100:00100000:0.0:1746147149.671122:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308201472 00000100:00100000:0.0:1746147149.671139:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15071 00000100:00100000:0.0:1746147149.671147:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308201344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147149.671168:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147149.671187:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447000/0x31399394250578e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a95 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.671243:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310760192:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147149.671320:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.671437:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15072 00000100:00100000:2.0:1746147149.671446:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+32:2003:x1830967308201472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.671454:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.671465:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250578ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a9c expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.671491:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310760320:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147149.671519:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.671532:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308200960 00000100:00100000:2.0:1746147149.671536:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308200960 00002000:00100000:2.0:1746147149.671559:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->1724415) req@ffff880091c3c000 x1830967308200960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.671567:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c000 with x1830967308200960 ext(1720320->1724415) 00002000:00010000:2.0:1746147149.671571:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3c000 00000100:00100000:2.0:1746147149.671583:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3753 00000100:00100000:2.0:1746147149.671588:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308200960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.671701:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308200960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 112us (833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.671707:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3753 00002000:00100000:2.0:1746147149.671712:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->1724415) req@ffff880091c3c000 x1830967308200960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.671719:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3c000 with x1830967308200960 ext(1720320->1724415) 00002000:00010000:2.0:1746147149.671721:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3c000 00000100:00100000:0.0:1746147149.673356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.673412:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308201216 00000100:00100000:1.0:1746147149.673417:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308201216 00000100:00100000:1.0:1746147149.673464:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15397 00000100:00100000:1.0:1746147149.673470:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32603:x1830967308201216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147149.673482:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.673499:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x31399394250578f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78a8e expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.673585:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673602:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673613:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673624:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673629:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673634:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673642:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097035400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.673645:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673654:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673664:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.673667:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147149.673671:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673675:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035400/0x31399394250578fa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.673703:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x31399394250578f3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a8e expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.673710:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034800/0x31399394250578f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a8e expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.673717:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034800, rc 0) 00000100:00100000:1.0:1746147149.673750:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32603:x1830967308201216:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 280us (399us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.673756:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15397 00000100:00100000:1.0:1746147149.673819:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310760192:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.673840:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447000/0x31399394250578e5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a95 expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.673850:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447000/0x31399394250578e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a95 expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.673861:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447000, rc 0) 00000100:00100000:1.0:1746147149.673878:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2003:x1830967308201344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2733us (2947us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.673884:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15071 00000100:00100000:3.0:1746147149.674557:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+34:2003:x1830967308200448:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10559us (11107us total) trans 17179874290 rc 0/0 00000100:00100000:3.0:1746147149.674567:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1180 00002000:00100000:3.0:1746147149.674576:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->2580479) req@ffff88011db14000 x1830967308200448/t17179874290(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/448 e 0 to 0 dl 1746147160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.674584:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14000 with x1830967308200448 ext(2097152->2580479) 00000100:00100000:2.0:1746147149.674586:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310760320:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147149.674591:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.674603:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.674605:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250578ec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a9c expref: 34 pid: 1398 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147149.674609:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db14000 00010000:00010000:2.0:1746147149.674614:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250578ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a9c expref: 34 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.674641:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ae00, rc 0) 00000100:00100000:2.0:1746147149.674665:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+32:2003:x1830967308201472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3221us (3659us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.674671:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15072 00000100:00100000:0.0:1746147149.676302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.676433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.676511:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.676594:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308202112 00000100:00100000:3.0:1746147149.676602:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308202112 00000100:00100000:2.0:1746147149.676612:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308201728 00000100:00100000:2.0:1746147149.676619:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308201728 00000100:00100000:3.0:1746147149.676653:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15073 00000100:00100000:2.0:1746147149.676655:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308201984 00000100:00100000:2.0:1746147149.676657:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308201984 00000100:00100000:3.0:1746147149.676662:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+32:32599:x1830967308202112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147149.676678:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147149.676683:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5550 00000100:00100000:1.0:1746147149.676690:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32603:x1830967308201728:12345-192.168.204.25@tcp:35:lfs.0 00010000:00010000:3.0:1746147149.676696:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78aa3 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.676710:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5551 00000100:00100000:0.0:1746147149.676716:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32607:x1830967308201984:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:3.0:1746147149.676722:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147149.676724:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147149.676729:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.676740:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.676749:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:3.0:1746147149.676785:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+33:32599:x1830967308202112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 125us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.676790:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15073 00000100:00100000:1.0:1746147149.676942:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32603:x1830967308201728:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 252us (645us total) trans 8589936118 rc 0/0 00000100:00100000:1.0:1746147149.676949:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5550 00000100:00100000:0.0:1746147149.677034:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32607:x1830967308201984:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 318us (599us total) trans 8589936119 rc 0/0 00000100:00100000:0.0:1746147149.677040:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5551 00000100:00100000:0.0:1746147149.680295:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.680363:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308202240 00000100:00100000:3.0:1746147149.680371:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308202240 00010000:00010000:3.0:1746147149.680408:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 33 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.680437:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6679 00000100:00100000:3.0:1746147149.680444:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+33:2003:x1830967308202240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.680460:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.680481:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 33 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.680492:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 33 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.680515:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeee00/0x3139939425057787 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789ca expref: 33 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.680547:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.680549:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.680557:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.680565:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.680577:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.680578:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.680581:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.680588:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.680620:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.680632:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310760448:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147149.681373:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.681384:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310760576:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.681437:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.684151:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310760448:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.684165:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310760576:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147149.684185:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.684244:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2003:x1830967308202240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3798us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.684255:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6679 00000100:00100000:0.0:1746147149.684334:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.684385:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308202368 00000100:00100000:1.0:1746147149.684393:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308202368 00000100:00100000:1.0:1746147149.684428:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15074 00000100:00100000:1.0:1746147149.684436:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308202368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.684453:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.684475:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097034800/0x3139939425057908 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78aaa expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.684527:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310760704:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.684573:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.685657:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310760704:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.685682:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097034800/0x3139939425057908 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aaa expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.685698:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034800/0x3139939425057908 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aaa expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.685708:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034800, rc 0) 00000100:00100000:1.0:1746147149.685748:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2001:x1830967308202368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1312us (1415us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.685754:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15074 00000100:00100000:0.0:1746147149.689366:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.690016:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308202624 00000100:00100000:3.0:1746147149.690027:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308202624 00002000:00100000:3.0:1746147149.690070:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff88009cd45180 x1830967308202624/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.690080:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45180 with x1830967308202624 ext(4915200->4919295) 00002000:00010000:3.0:1746147149.690085:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd45180 00000100:00100000:3.0:1746147149.690149:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3754 00000100:00100000:3.0:1746147149.690156:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967308202624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147149.690298:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967308202624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 141us (940us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147149.690304:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3754 00002000:00100000:3.0:1746147149.690309:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff88009cd45180 x1830967308202624/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.690316:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd45180 with x1830967308202624 ext(4915200->4919295) 00002000:00010000:3.0:1746147149.690318:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd45180 00000100:00100000:0.0:1746147149.692175:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.692252:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308203008 00000100:00100000:2.0:1746147149.692261:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308203008 00002000:00100000:2.0:1746147149.692294:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009cd47480 x1830967308203008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.692302:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47480 with x1830967308203008 ext(2097152->4194303) 00002000:00010000:2.0:1746147149.692306:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47480 00000100:00100000:2.0:1746147149.692335:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3755 00000100:00100000:2.0:1746147149.692341:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308203008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.692457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.692522:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308203136 00000100:00100000:3.0:1746147149.692525:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308203136 00002000:00100000:3.0:1746147149.692542:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd44380 x1830967308203136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.692548:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44380 with x1830967308203136 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.692551:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd44380 00000100:00100000:3.0:1746147149.692573:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3756 00000100:00100000:3.0:1746147149.692578:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967308203136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.695864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.696014:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308203392 00000100:00100000:1.0:1746147149.696026:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308203392 00000100:00100000:1.0:1746147149.696117:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5552 00000100:00100000:1.0:1746147149.696125:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+18:32599:x1830967308203392:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147149.696363:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+19:32599:x1830967308203392:12345-192.168.204.25@tcp:35:cat.0 Request processed in 238us (503us total) trans 8589936120 rc 0/0 00000100:00100000:1.0:1746147149.696370:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5552 00000100:00100000:3.0:1746147149.706175:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967308203136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13586us (13708us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147149.706190:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3756 00002000:00100000:3.0:1746147149.706201:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009cd44380 x1830967308203136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.706210:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44380 with x1830967308203136 ext(2097152->4194303) 00002000:00010000:3.0:1746147149.706215:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd44380 00000100:00100000:2.0:1746147149.712297:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308203008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19942us (20117us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147149.712309:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3755 00002000:00100000:2.0:1746147149.712322:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009cd47480 x1830967308203008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.712331:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd47480 with x1830967308203008 ext(2097152->4194303) 00002000:00010000:2.0:1746147149.712337:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd47480 00000100:00100000:0.0:1746147149.722350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.722464:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308203520 00000100:00100000:1.0:1746147149.722475:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308203520 00000100:00100000:1.0:1746147149.723289:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15075 00000100:00100000:1.0:1746147149.723299:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308203520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.723316:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.723333:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8200/0x313993942505790f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ab1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.723380:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310760832:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.723471:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.725865:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310760832:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.725903:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8200/0x313993942505790f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ab1 expref: 47 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.725918:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8200/0x313993942505790f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ab1 expref: 47 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.725947:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8200, rc 0) 00000100:00100000:1.0:1746147149.725994:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308203520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2696us (3654us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.726002:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15075 00000100:00100000:0.0:1746147149.729241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.729272:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308203776 00000100:00100000:2.0:1746147149.729282:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308203776 00002000:00100000:2.0:1746147149.729332:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009cd46d80 x1830967308203776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.729342:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46d80 with x1830967308203776 ext(4194304->4919295) 00002000:00010000:2.0:1746147149.729348:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd46d80 00000100:00100000:2.0:1746147149.729370:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3757 00000100:00100000:2.0:1746147149.729378:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308203776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147149.736527:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308203776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7136us (7285us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147149.736541:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3757 00002000:00100000:2.0:1746147149.736553:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009cd46d80 x1830967308203776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.736562:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd46d80 with x1830967308203776 ext(4194304->4919295) 00002000:00010000:2.0:1746147149.736568:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd46d80 00000100:00100000:0.0:1746147149.746141:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.746191:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308203904 00000100:00100000:1.0:1746147149.746202:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308203904 00000100:00100000:1.0:1746147149.746269:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15076 00000100:00100000:1.0:1746147149.746277:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308203904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.746293:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.746310:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9000/0x3139939425057916 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ab8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.746360:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310760960:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.746457:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.748314:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310760960:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.748351:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9000/0x3139939425057916 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ab8 expref: 47 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.748366:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9000/0x3139939425057916 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ab8 expref: 47 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.748399:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9000, rc 0) 00000100:00100000:1.0:1746147149.748992:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308203904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2714us (2861us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.749002:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15076 00000100:00100000:0.0:1746147149.753014:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.753132:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308204032 00000100:00100000:1.0:1746147149.753142:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308204032 00000100:00100000:1.0:1746147149.753218:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15077 00000100:00100000:1.0:1746147149.753227:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308204032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.753538:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.753559:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x313993942505791d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78abf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.753614:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310761088:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.753886:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.757058:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310761088:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.757162:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x313993942505791d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78abf expref: 47 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.757177:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9c00/0x313993942505791d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78abf expref: 47 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.757240:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9c00, rc 0) 00000100:00100000:2.0:1746147149.757463:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308204032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4235us (4459us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.757475:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15077 00000100:00100000:0.0:1746147149.766316:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.766509:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308204288 00000100:00100000:1.0:1746147149.766520:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308204288 00000100:00100000:1.0:1746147149.766579:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5553 00000100:00100000:1.0:1746147149.766588:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32602:x1830967308204288:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147149.766822:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32602:x1830967308204288:12345-192.168.204.25@tcp:35:cat.0 Request processed in 235us (518us total) trans 8589936121 rc 0/0 00000100:00100000:1.0:1746147149.766830:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5553 00000100:00100000:0.0:1746147149.796595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.796662:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308204544 00000100:00100000:1.0:1746147149.796672:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308204544 00000100:00100000:1.0:1746147149.796740:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15398 00000100:00100000:1.0:1746147149.796750:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:32614:x1830967308204544:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147149.796779:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.796828:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ac6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.796912:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.796925:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.796937:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.796948:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.796953:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.796959:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797062:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797071:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797076:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147149.797084:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147149.797202:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797212:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797217:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797223:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.797226:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797233:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797244:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147149.797246:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.797250:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797254:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505792b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797274:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797279:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797283:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797287:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.797289:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797297:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797303:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f027e00) 00010000:00010000:1.0:1746147149.797305:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.797307:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797312:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x3139939425057932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.797351:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 42 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.797362:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 41 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.797368:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.797370:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147149.797373:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9400, rc 0) 00000100:00100000:1.0:1746147149.797434:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32614:x1830967308204544:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 685us (852us total) trans 8589936122 rc 0/0 00000100:00100000:1.0:1746147149.797441:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15398 00000100:00100000:0.0:1746147149.817192:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.817286:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308204672 00000100:00100000:2.0:1746147149.817294:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308204672 00000100:00100000:2.0:1746147149.817343:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15078 00000100:00100000:2.0:1746147149.817353:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32614:x1830967308204672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147149.817372:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.817391:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78acd expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.817422:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.817432:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.817438:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.817440:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.817443:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2674688->2981887] (req 2674688->2981887) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.817473:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.817486:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 31 pid: 1398 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.817498:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310761216:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147149.817686:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.817694:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.817702:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310761344:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.818018:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.821266:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310761216:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.821279:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310761344:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147149.821309:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2674688->2981887] (req 2674688->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.821326:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01b000, rc 0) 00000100:00100000:0.0:1746147149.821408:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.821906:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32614:x1830967308204672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4552us (4722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.821916:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15078 00000100:00100000:3.0:1746147149.822329:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308204800 00000100:00100000:3.0:1746147149.822337:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308204800 00010000:00010000:3.0:1746147149.822371:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.822582:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6680 00000100:00100000:3.0:1746147149.822590:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967308204800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.822605:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.822625:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.822636:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.822661:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057901 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78aa3 expref: 32 pid: 1398 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.822685:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.822720:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308204800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 131us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.822730:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6680 00000100:00100000:0.0:1746147149.823775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.823831:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308204928 00000100:00100000:3.0:1746147149.823835:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308204928 00010000:00010000:3.0:1746147149.823851:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.823874:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6681 00000100:00100000:3.0:1746147149.823879:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967308204928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.823893:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.823903:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.823914:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.823928:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091dce800/0x31399394250578de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a87 expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.823937:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.823939:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147149.823946:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.823953:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147149.823986:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.824000:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310761472:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147149.824387:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.825461:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967310761472:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147149.825477:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.825513:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308204928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1633us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.825522:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6681 00000100:00100000:0.0:1746147149.825635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.825674:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308205184 00000100:00100000:2.0:1746147149.825682:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308205184 00002000:00100000:2.0:1746147149.825717:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2674688->2678783) req@ffff88011e500380 x1830967308205184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.825726:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500380 with x1830967308205184 ext(2674688->2678783) 00002000:00010000:2.0:1746147149.825730:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500380 00000100:00100000:2.0:1746147149.825743:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3758 00000100:00100000:2.0:1746147149.825749:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308205184:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147149.825887:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308205184:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 137us (252us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.825893:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3758 00002000:00100000:2.0:1746147149.825898:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2674688->2678783) req@ffff88011e500380 x1830967308205184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.825905:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500380 with x1830967308205184 ext(2674688->2678783) 00002000:00010000:2.0:1746147149.825908:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500380 00000100:00100000:0.0:1746147149.830894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.831044:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308205440 00000100:00100000:2.0:1746147149.831054:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308205440 00002000:00100000:2.0:1746147149.831124:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2977792->2981887) req@ffff88011e500700 x1830967308205440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.831133:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500700 with x1830967308205440 ext(2977792->2981887) 00002000:00010000:2.0:1746147149.831139:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500700 00000100:00100000:2.0:1746147149.831160:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3759 00000100:00100000:2.0:1746147149.831169:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308205440:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147149.832522:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308205440:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1348us (1634us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.832533:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3759 00002000:00100000:2.0:1746147149.832541:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (2977792->2981887) req@ffff88011e500700 x1830967308205440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.832549:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e500700 with x1830967308205440 ext(2977792->2981887) 00002000:00010000:2.0:1746147149.832554:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e500700 00000100:00100000:0.0:1746147149.836026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.836190:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308205696 00000100:00100000:1.0:1746147149.836199:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308205696 00000100:00100000:2.0:1746147149.836582:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5554 00000100:00100000:2.0:1746147149.836593:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32614:x1830967308205696:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147149.836871:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32614:x1830967308205696:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 279us (854us total) trans 8589936123 rc 0/0 00000100:00100000:2.0:1746147149.836878:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5554 00000100:00100000:0.0:1746147149.887688:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.887941:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308205952 00000100:00100000:1.0:1746147149.887952:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308205952 00000100:00100000:1.0:1746147149.888023:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15399 00000100:00100000:1.0:1746147149.888032:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+19:32617:x1830967308205952:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147149.888062:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.888081:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x313993942505794e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ad4 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.888510:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888523:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888535:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888548:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888554:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888559:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888657:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888667:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888672:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147149.888679:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147149.888750:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888760:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888765:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888770:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.888775:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888781:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888792:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147149.888794:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.888798:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888813:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425057955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888927:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888932:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888937:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888940:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.888942:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888949:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888955:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f027900) 00010000:00010000:1.0:1746147149.888957:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.888958:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888963:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8400/0x313993942505795c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.888995:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9c00/0x313993942505794e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 22 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.889004:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 21 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.889010:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.889012:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147149.889014:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8200, rc 0) 00000100:00100000:1.0:1746147149.889073:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:32617:x1830967308205952:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1042us (1396us total) trans 8589936124 rc 0/0 00000100:00100000:1.0:1746147149.889080:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15399 00000100:00100000:0.0:1746147149.893241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.893447:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206080 00000100:00100000:1.0:1746147149.893458:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206080 00000100:00100000:1.0:1746147149.893528:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15400 00000100:00100000:1.0:1746147149.893540:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32618:x1830967308206080:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147149.893573:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.893598:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78adb expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.893727:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.893740:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.893751:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.893764:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896115:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896131:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896247:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896273:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896280:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147149.896330:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:1.0:1746147149.896336:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147149.896356:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896366:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896375:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896380:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896387:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896393:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.896396:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896402:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896414:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147149.896417:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.896421:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896426:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x3139939425057978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896439:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896443:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896447:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896452:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.896455:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896459:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896466:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f027200) 00010000:00010000:1.0:1746147149.896468:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.896471:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896475:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9a00/0x313993942505797f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.896520:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425057971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78adb expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.896533:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78adb expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.896539:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.896541:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147149.896543:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8c00, rc 0) 00000100:00100000:1.0:1746147149.896612:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32618:x1830967308206080:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3074us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.896619:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15400 00000100:00100000:2.0:1746147149.900185:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.900216:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206208 00000100:00100000:0.0:1746147149.900226:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206208 00000100:00100000:2.0:1746147149.900229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.900299:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206336 00000100:00100000:3.0:1746147149.900302:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206336 00000100:00100000:3.0:1746147149.900363:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 830 00000100:00100000:3.0:1746147149.900370:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308206336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.900384:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.900407:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8c00/0x3139939425057986 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78adb expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.901065:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15079 00000100:00100000:0.0:1746147149.901072:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308206208:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147149.901134:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.901166:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147149.901184:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147149.901215:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x313993942505798d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ae2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147149.901234:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308206336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 865us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.901241:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 830 00000100:00100000:1.0:1746147149.901265:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310761600:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147149.901424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.901426:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.901440:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206464 00000100:00100000:1.0:1746147149.901443:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206464 00000100:00100000:1.0:1746147149.901463:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15080 00000100:00100000:1.0:1746147149.901468:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308206464:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147149.901476:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147149.901478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147149.901486:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8600/0x3139939425057994 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ae9 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.901512:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310761728:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.901532:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.901546:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206592 00000100:00100000:1.0:1746147149.901548:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206592 00000100:00100000:1.0:1746147149.901568:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15081 00000100:00100000:1.0:1746147149.901572:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308206592:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147149.901579:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.901586:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f12ca00/0x313993942505799b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78af0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.901608:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310761856:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.901629:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.905368:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310761728:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147149.905409:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8600/0x3139939425057994 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ae9 expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.905424:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8600/0x3139939425057994 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ae9 expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.905439:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8600, rc 0) 00000100:00100000:1.0:1746147149.905490:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310761600:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147149.905494:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308206464:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4024us (4070us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147149.905504:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15080 00010000:00010000:1.0:1746147149.905513:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x313993942505798d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ae2 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.905523:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8800/0x313993942505798d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ae2 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.905536:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8800, rc 0) 00000100:00100000:1.0:1746147149.905555:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308206208:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4485us (5382us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.905562:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15079 00000100:00100000:2.0:1746147149.905631:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310761856:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.905649:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f12ca00/0x313993942505799b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78af0 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.905659:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f12ca00/0x313993942505799b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78af0 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.905675:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12ca00, rc 0) 00000100:00100000:2.0:1746147149.906216:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308206592:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4642us (4735us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.906222:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15081 00000100:00100000:0.0:1746147149.909085:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.909160:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206848 00000100:00100000:1.0:1746147149.909169:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206848 00000100:00100000:1.0:1746147149.909224:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15401 00000100:00100000:1.0:1746147149.909231:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32618:x1830967308206848:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147149.909253:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.909273:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c000/0x31399394250579a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78af7 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909379:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.909395:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909402:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 41 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909409:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 20 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909416:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.909446:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 20 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909459:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 20 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.909471:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310761984:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.909571:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 41 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909579:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 41 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.909587:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310762112:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.909611:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.909618:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 13 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.909625:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310762240:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.909638:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.911903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.912161:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310761984:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.912173:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310762112:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.912180:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310762240:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.912208:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147149.912303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.912331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.912354:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308206976 00000100:00100000:0.0:1746147149.912360:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308206976 00000100:00100000:3.0:1746147149.912439:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308207232 00000100:00100000:3.0:1746147149.912443:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308207232 00010000:00010000:3.0:1746147149.912473:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 21 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.912516:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308207104 00000100:00100000:3.0:1746147149.912519:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308207104 00010000:00010000:3.0:1746147149.912529:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 14 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746147149.912552:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6682 00000100:00100000:3.0:1746147149.912559:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967308207232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.912571:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.912576:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 21 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.912585:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 21 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.912605:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8200/0x3139939425057963 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ad4 expref: 21 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.912622:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.912626:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.912635:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.912639:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.912676:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308207232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.912682:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6682 00000100:00100000:3.0:1746147149.912700:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6683 00000100:00100000:3.0:1746147149.912704:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308207104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.912710:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.912714:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 14 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.912721:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 14 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.912732:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034e00/0x313993942505789f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a48 expref: 14 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.912740:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147149.912742:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.912747:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147149.912750:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.912764:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308207104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.912769:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6683 00010000:00010000:0.0:1746147149.913452:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 42 pid: 6215 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746147149.913484:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6684 00000100:00100000:0.0:1746147149.913490:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308206976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147149.913497:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147149.913500:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 42 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746147149.913598:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 42 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746147149.913611:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425057939 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ac6 expref: 42 pid: 6215 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746147149.913621:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147149.913624:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147149.913631:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147149.913637:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147149.913994:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147149.913996:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147149.914004:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147149.914023:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000100:00100000:1.0:1746147149.914040:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308206976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 549us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.914045:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6684 00010000:00010000:2.0:1746147149.914187:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c000/0x31399394250579a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78af7 expref: 14 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.914206:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78af7 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.914213:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.914215:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147149.914217:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d400, rc 0) 00000100:00100000:2.0:1746147149.914250:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32618:x1830967308206848:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 5019us (5173us total) trans 8589936125 rc 0/0 00000100:00100000:2.0:1746147149.914257:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15401 00000100:00100000:0.0:1746147149.924651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.924707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.925133:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308207488 00000100:00100000:2.0:1746147149.925144:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308207488 00000100:00100000:2.0:1746147149.925189:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308207744 00000100:00100000:2.0:1746147149.925192:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308207744 00000100:00100000:2.0:1746147149.925218:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15402 00000100:00100000:2.0:1746147149.925226:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:32621:x1830967308207488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.925253:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.925274:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250579b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78afe expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.925349:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925362:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925373:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925385:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925391:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925397:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925497:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x31399394250579cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925507:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x31399394250579cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925513:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x31399394250579cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147149.925522:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147149.925603:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925609:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925615:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925620:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925625:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79ac00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147149.925628:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925635:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925648:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147149.925651:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147149.925655:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925659:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ac00/0x31399394250579be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925692:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925697:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925701:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925705:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147149.925707:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925712:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925718:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009823af00) 00010000:00010000:2.0:1746147149.925720:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147149.925721:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925726:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x31399394250579c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925760:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ae00/0x31399394250579b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78afe expref: 23 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.925772:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x31399394250579cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78afe expref: 22 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.925777:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.925779:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147149.925782:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4600, rc 0) 00000100:00100000:2.0:1746147149.925843:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:32621:x1830967308207488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 617us (1203us total) trans 8589936126 rc 0/0 00000100:00100000:2.0:1746147149.925849:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15402 00000100:00100000:2.0:1746147149.925864:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15403 00000100:00100000:2.0:1746147149.925870:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32618:x1830967308207744:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147149.925879:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.925881:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147149.925892:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d400/0x31399394250579a9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78af7 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.925901:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.925903:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147149.925908:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4000/0x31399394250579da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b05 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.925943:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925950:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925959:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925967:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925972:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925977:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925981:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49c4c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147149.925983:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925987:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.925992:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147149.925994:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147149.925996:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.926000:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4c00/0x31399394250579e1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147149.926016:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4000/0x31399394250579da lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b05 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.926022:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4000/0x31399394250579da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b05 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.926033:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4000, rc 0) 00000100:00100000:2.0:1746147149.926053:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32618:x1830967308207744:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 183us (1346us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.926059:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15403 00000100:00100000:0.0:1746147149.929171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.929240:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308208128 00000100:00100000:2.0:1746147149.929250:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308208128 00000100:00100000:2.0:1746147149.929329:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5555 00000100:00100000:2.0:1746147149.929337:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:32618:x1830967308208128:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147149.929515:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32618:x1830967308208128:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 178us (350us total) trans 8589936127 rc 0/0 00000100:00100000:2.0:1746147149.929522:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5555 00000100:00100000:0.0:1746147149.930932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.930965:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308207872 00000100:00100000:1.0:1746147149.930970:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308207872 00000100:00100000:1.0:1746147149.931010:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 831 00000100:00100000:1.0:1746147149.931016:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308207872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147149.931024:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147149.931043:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x31399394250579cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78afe expref: 22 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.931067:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.931070:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147149.931109:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967308207872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.931114:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 831 00000100:00100000:0.0:1746147149.933971:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.934019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.934186:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308208256 00000100:00100000:2.0:1746147149.934190:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308208384 00000100:00100000:1.0:1746147149.934192:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308208256 00000100:00100000:2.0:1746147149.934193:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308208384 00000100:00100000:1.0:1746147149.934257:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15082 00000100:00100000:1.0:1746147149.934263:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308208256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.934276:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.934303:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12de00/0x31399394250579e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b0c expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147149.934347:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310762368:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147149.934423:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.934634:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15083 00000100:00100000:2.0:1746147149.934640:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308208384:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.934648:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.934656:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4000/0x31399394250579ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b13 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.934677:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310762496:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147149.934699:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.936907:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310762496:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147149.936935:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4000/0x31399394250579ef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b13 expref: 32 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.936953:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4000/0x31399394250579ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b13 expref: 32 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147149.936968:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4000, rc 0) 00000100:00100000:2.0:1746147149.937015:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308208384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2374us (2993us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147149.937021:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15083 00000100:00100000:1.0:1746147149.937176:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310762368:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.937195:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12de00/0x31399394250579e8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b0c expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.937203:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12de00/0x31399394250579e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b0c expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.937210:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12de00, rc 0) 00000100:00100000:1.0:1746147149.937225:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:2000:x1830967308208256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2962us (3262us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.937230:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15082 00000100:00100000:0.0:1746147149.945306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.945423:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308208512 00000100:00100000:1.0:1746147149.945431:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308208512 00000100:00100000:1.0:1746147149.945480:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15084 00000100:00100000:1.0:1746147149.945488:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+19:32621:x1830967308208512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.945505:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.945519:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b1a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.945543:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.945549:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147149.945551:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147149.945554:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.945582:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.945592:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 31 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.945601:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310762624:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.946526:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.949950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.950043:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308208640 00000100:00100000:1.0:1746147149.950046:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310762624:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.950073:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.950119:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d800, rc 0) 00000100:00100000:1.0:1746147149.950162:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32621:x1830967308208512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4674us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.950169:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15084 00000100:00100000:3.0:1746147149.950335:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308208640 00002000:00100000:3.0:1746147149.951046:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1200128->1724415) req@ffff88012f3cdc00 x1830967308208640/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.951055:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967308208640 ext(1200128->1724415) 00010000:00010000:3.0:1746147149.951062:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.951074:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 32 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.951080:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3cdc00 00000100:00100000:3.0:1746147149.951116:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1181 00000100:00100000:3.0:1746147149.951123:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967308208640:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147149.956589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.956688:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308208896 00000100:00100000:1.0:1746147149.956696:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308208896 00000100:00100000:1.0:1746147149.956751:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15404 00000100:00100000:1.0:1746147149.956759:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32624:x1830967308208896:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147149.956785:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.956813:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250579fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b21 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.956883:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.956895:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.956904:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.956923:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.956929:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.956934:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957025:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957033:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957039:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147149.957047:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147149.957127:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957133:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957141:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957146:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957151:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12da00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.957154:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957159:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957173:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147149.957176:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.957178:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957183:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425057a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957206:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957210:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957214:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957218:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12de00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147149.957220:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957231:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957236:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f027900) 00010000:00010000:1.0:1746147149.957238:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147149.957240:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957244:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12de00/0x3139939425057a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.957907:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x31399394250579fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 44 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.957921:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 43 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.957927:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.957929:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147149.957931:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d000, rc 0) 00000100:00100000:1.0:1746147149.957978:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32624:x1830967308208896:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1219us (1397us total) trans 8589936128 rc 0/0 00000100:00100000:1.0:1746147149.957985:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15404 00000100:00100000:3.0:1746147149.961124:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967308208640:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 9995us (11174us total) trans 21474841547 rc 0/0 00000100:00100000:3.0:1746147149.961134:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1181 00002000:00100000:3.0:1746147149.961143:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (1200128->1724415) req@ffff88012f3cdc00 x1830967308208640/t21474841547(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/448 e 0 to 0 dl 1746147160 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.961151:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967308208640 ext(1200128->1724415) 00010000:00010000:3.0:1746147149.961159:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746147149.961172:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746147149.961177:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3cdc00 00000100:00100000:0.0:1746147149.963423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.963664:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308209024 00000100:00100000:2.0:1746147149.963671:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308209024 00010000:00010000:2.0:1746147149.963701:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.963736:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6685 00000100:00100000:2.0:1746147149.963746:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967308209024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.963758:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.963774:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.963786:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.963815:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d600/0x3139939425057883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a3a expref: 34 pid: 12225 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.963841:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.963843:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.963849:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.963856:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.963882:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.963892:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310762752:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147149.963995:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.970171:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310762752:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147149.970194:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.970237:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967308209024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6490us (6817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.970247:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6685 00000100:00100000:0.0:1746147149.971459:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.971517:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308209280 00000100:00100000:3.0:1746147149.971524:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308209280 00002000:00100000:3.0:1746147149.971560:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3620864->3624959) req@ffff88012f3cc700 x1830967308209280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.971568:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc700 with x1830967308209280 ext(3620864->3624959) 00002000:00010000:3.0:1746147149.971573:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc700 00000100:00100000:3.0:1746147149.971596:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3760 00000100:00100000:3.0:1746147149.971604:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308209280:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147149.971716:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967308209280:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 113us (260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147149.971723:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3760 00002000:00100000:3.0:1746147149.971728:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x8f:0x0] (3620864->3624959) req@ffff88012f3cc700 x1830967308209280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147149.971734:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc700 with x1830967308209280 ext(3620864->3624959) 00002000:00010000:3.0:1746147149.971738:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc700 00000100:00100000:0.0:1746147149.975600:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.976304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.976327:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308209536 00000100:00100000:1.0:1746147149.976334:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308209536 00002000:00100000:1.0:1746147149.976364:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88012f3cce00 x1830967308209536/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.976370:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cce00 with x1830967308209536 ext(1048576->2097151) 00002000:00010000:1.0:1746147149.976375:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cce00 00000100:00100000:1.0:1746147149.976394:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308209792 00000100:00100000:1.0:1746147149.976395:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308209792 00002000:00100000:1.0:1746147149.976403:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88012f3ced80 x1830967308209792/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 504/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.976407:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3ced80 with x1830967308209792 ext(1048576->2097151) 00002000:00010000:1.0:1746147149.976410:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3ced80 00000100:00100000:1.0:1746147149.976423:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3761 00000100:00100000:1.0:1746147149.976427:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308209536:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.976451:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3762 00000100:00100000:0.0:1746147149.976459:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308209792:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147149.979071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.979117:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308210048 00000100:00100000:2.0:1746147149.979124:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308210048 00002000:00100000:2.0:1746147149.979153:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3850240->3854335) req@ffff88012f3cfb80 x1830967308210048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/0 e 0 to 0 dl 1746147160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.979160:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cfb80 with x1830967308210048 ext(3850240->3854335) 00002000:00010000:2.0:1746147149.979163:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cfb80 00000100:00100000:2.0:1746147149.979186:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3763 00000100:00100000:2.0:1746147149.979191:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308210048:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147149.979285:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308210048:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 94us (221us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147149.979290:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3763 00002000:00100000:2.0:1746147149.979293:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3850240->3854335) req@ffff88012f3cfb80 x1830967308210048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147149.979297:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cfb80 with x1830967308210048 ext(3850240->3854335) 00002000:00010000:2.0:1746147149.979299:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cfb80 00000100:00100000:0.0:1746147149.985047:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2001:x1830967308209792:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8577us (8740us total) trans 0 rc 536576/536576 00000100:00100000:0.0:1746147149.985061:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3762 00002000:00100000:0.0:1746147149.985074:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88012f3ced80 x1830967308209792/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 504/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 536576/536576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147149.985084:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3ced80 with x1830967308209792 ext(1048576->2097151) 00002000:00010000:0.0:1746147149.985109:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3ced80 00000100:00100000:1.0:1746147149.987589:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308209536:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11149us (11986us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147149.987600:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3761 00002000:00100000:1.0:1746147149.987611:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88012f3cce00 x1830967308209536/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:525/0 lens 488/440 e 0 to 0 dl 1746147160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147149.987620:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cce00 with x1830967308209536 ext(1048576->2097151) 00002000:00010000:1.0:1746147149.987626:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cce00 00000100:00100000:0.0:1746147149.989008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.989137:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.989146:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308210304 00000100:00100000:2.0:1746147149.989156:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308210304 00000100:00100000:1.0:1746147149.989173:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308210432 00000100:00100000:1.0:1746147149.989177:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308210432 00000100:00100000:2.0:1746147149.989213:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5556 00000100:00100000:1.0:1746147149.989216:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15085 00000100:00100000:2.0:1746147149.989221:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32624:x1830967308210304:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147149.989222:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+20:32617:x1830967308210432:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147149.989237:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.989256:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b28 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.989283:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.989293:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.989300:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.989306:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.989308:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.989311:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2564096->3145727] (req 2564096->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.989342:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.989354:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 12 pid: 17600 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.989366:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310762880:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147149.989412:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32624:x1830967308210304:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 191us (412us total) trans 8589936129 rc 0/0 00000100:00100000:2.0:1746147149.989418:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5556 00010000:00010000:1.0:1746147149.989454:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.989463:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 32 pid: 1136 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.989471:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310763008:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.989510:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.989518:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147149.989525:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310763136:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.989548:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.991808:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310762880:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.991822:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310763008:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147149.991831:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310763136:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147149.991862:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [2564096->3145727] (req 2564096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.991877:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8ec00, rc 0) 00000100:00100000:1.0:1746147149.991936:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+21:32617:x1830967308210432:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2713us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.991944:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15085 00000100:00100000:2.0:1746147149.992685:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.992742:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308210816 00000100:00100000:1.0:1746147149.992749:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308210816 00000100:00100000:1.0:1746147149.992781:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15405 00000100:00100000:1.0:1746147149.992787:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32627:x1830967308210816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.992815:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.992831:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x3139939425057a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b2f expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.992919:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.992932:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147149.992943:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147149.992953:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147149.993148:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x3139939425057a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.993273:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.993280:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147149.993282:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147149.993285:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f600, rc 0) 00000100:00100000:1.0:1746147149.993313:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32627:x1830967308210816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 526us (630us total) trans 8589936130 rc 0/0 00000100:00100000:1.0:1746147149.993318:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15405 00000100:00100000:0.0:1746147149.994832:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147149.994872:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.994901:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308210944 00000100:00100000:2.0:1746147149.994908:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308210944 00010000:00010000:2.0:1746147149.994939:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746147149.994979:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308210560 00000100:00100000:2.0:1746147149.994982:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308210560 00010000:00010000:2.0:1746147149.994993:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 13 pid: 17600 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.995008:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6686 00000100:00100000:2.0:1746147149.995015:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308210944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147149.995029:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147149.995086:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6687 00000100:00100000:3.0:1746147149.995119:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308210560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147149.995127:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147149.995443:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 13 pid: 17600 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746147149.995457:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 13 pid: 17600 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746147149.995477:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20a00/0x313993942505786e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a2c expref: 13 pid: 17600 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746147149.995496:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147149.995530:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308210560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 411us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147149.995538:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6687 00010000:00010000:2.0:1746147149.995655:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.995663:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.995676:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c10e00/0x31399394250577f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a09 expref: 21 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147149.995699:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147149.995719:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308210944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 705us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147149.995725:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6686 00000100:00100000:2.0:1746147149.996276:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.996309:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.996354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147149.996362:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211072 00000100:00100000:2.0:1746147149.996365:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211328 00000100:00100000:1.0:1746147149.996366:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211072 00000100:00100000:2.0:1746147149.996367:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211328 00010000:00010000:2.0:1746147149.996380:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 33 pid: 1136 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746147149.996394:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6688 00000100:00100000:1.0:1746147149.996397:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211200 00000100:00100000:2.0:1746147149.996399:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308211328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147149.996399:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211200 00010000:00010000:2.0:1746147149.996406:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147149.996413:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 33 pid: 1136 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746147149.996418:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15086 00000100:00100000:1.0:1746147149.996423:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+31:2003:x1830967308211072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.996439:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147149.996452:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e400/0x3139939425057a3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b36 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147149.996474:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15087 00000100:00100000:0.0:1746147149.996483:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967308211200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147149.996492:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147149.996497:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310763264:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147149.996501:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425057a43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b3d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.996509:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 33 pid: 1136 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.996519:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.996530:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32400/0x31399394250578c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a6b expref: 33 pid: 1136 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746147149.996532:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425057a43 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b3d expref: 21 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.996541:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afe00/0x3139939425057a43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b3d expref: 21 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147149.996553:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afe00, rc 0) 00000100:00100000:1.0:1746147149.996555:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147149.996575:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+20:2003:x1830967308211200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (266us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147149.996580:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15087 00010000:00010000:2.0:1746147149.996608:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.996610:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147149.996617:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.996697:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.996721:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.996729:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096841880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310763392:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147149.996768:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147149.996981:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.997007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147149.997031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147149.997196:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211712 00000100:00100000:1.0:1746147149.997196:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211456 00000100:00100000:2.0:1746147149.997199:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211712 00000100:00100000:1.0:1746147149.997199:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211456 00000100:00100000:2.0:1746147149.997217:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211584 00000100:00100000:2.0:1746147149.997219:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211584 00000100:00100000:1.0:1746147149.997221:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15088 00000100:00100000:1.0:1746147149.997225:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967308211456:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147149.997231:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15089 00010000:00010000:1.0:1746147149.997232:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147149.997236:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967308211712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147149.997239:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b44 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147149.997241:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.997245:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x3139939425057a51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b52 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147149.997249:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.997251:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147149.997255:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.997264:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147149.997265:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310763520:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.997272:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8fc00, rc 0) 00000100:00100000:2.0:1746147149.997298:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147149.997316:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15090 00000100:00100000:2.0:1746147149.997321:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308211584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147149.997328:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147149.997334:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49200/0x3139939425057a58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b4b expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147149.997356:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310763648:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147149.997893:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147149.997893:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308211456:12345-192.168.204.25@tcp:101:cat.0 Request processed in 665us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147149.997899:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15088 00000100:00100000:1.0:1746147149.998488:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310763264:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147149.998510:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e400/0x3139939425057a3c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b36 expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.998521:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e400/0x3139939425057a3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b36 expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147149.998543:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e400, rc 0) 00000100:00100000:1.0:1746147149.998574:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+31:2003:x1830967308211072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2151us (2299us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147149.998580:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15086 00000100:00100000:3.0:1746147150.002261:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310763520:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147150.002307:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x3139939425057a51 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b52 expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.002322:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x3139939425057a51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b52 expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.002333:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c4400, rc 0) 00000100:00100000:0.0:1746147150.003164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.003199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.003233:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308212096 00000100:00100000:0.0:1746147150.003240:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308212096 00002000:00100000:0.0:1746147150.003290:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2564096->2568191) req@ffff88012f3cea00 x1830967308212096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.003299:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cea00 with x1830967308212096 ext(2564096->2568191) 00002000:00010000:0.0:1746147150.003304:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cea00 00000100:00100000:0.0:1746147150.003325:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3764 00000100:00100000:0.0:1746147150.003333:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308212096:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:1.0:1746147150.003366:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147150.003380:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308211968 00000100:00100000:1.0:1746147150.003383:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308211968 00000100:00100000:1.0:1746147150.003410:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15091 00000100:00100000:1.0:1746147150.003415:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+31:32621:x1830967308211968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147150.003429:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.003444:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b59 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.003470:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.003525:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096841880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310763392:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.003540:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.003573:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308211328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7173us (7218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.003581:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6688 00000100:00100000:3.0:1746147150.003615:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967308211712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6378us (6605us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147150.003621:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15089 00000100:00100000:2.0:1746147150.003629:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310763648:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147150.003663:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.003665:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.003669:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.003699:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.003715:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 47 pid: 9586 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746147150.003727:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310763776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.003779:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746147150.003792:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147150.003897:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49200/0x3139939425057a58 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b4b expref: 47 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.003907:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49200/0x3139939425057a58 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b4b expref: 47 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.003914:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49200, rc 0) 00000100:00100000:2.0:1746147150.003934:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967308211584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6613us (6901us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.003939:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15090 00000100:00100000:0.0:1746147150.003970:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308212096:12345-192.168.204.25@tcp:3:cat.0 Request processed in 632us (764us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147150.003980:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3764 00002000:00100000:0.0:1746147150.003989:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2564096->2568191) req@ffff88012f3cea00 x1830967308212096/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.003999:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cea00 with x1830967308212096 ext(2564096->2568191) 00002000:00010000:0.0:1746147150.004004:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cea00 00000100:00100000:1.0:1746147150.006315:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310763776:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.006341:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.006355:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8ea00, rc 0) 00000100:00100000:1.0:1746147150.006405:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+32:32621:x1830967308211968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2989us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.006412:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15091 00000100:00100000:0.0:1746147150.006933:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.007076:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308212224 00000100:00100000:2.0:1746147150.007084:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308212224 00002000:00100000:2.0:1746147150.007211:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2674688->3854335) req@ffff88012f3cca80 x1830967308212224/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 504/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.007221:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cca80 with x1830967308212224 ext(2674688->3854335) 00010000:00010000:2.0:1746147150.007228:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 46 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147150.007241:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 46 pid: 9586 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746147150.007248:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3cca80 00000100:00080000:1.0:1746147150.007385:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147150.007533:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1182 00000100:00100000:2.0:1746147150.007541:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308212224:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147150.012958:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967308212224:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5401us (6013us total) trans 17179874291 rc 0/0 00000100:00100000:2.0:1746147150.012972:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1182 00002000:00100000:2.0:1746147150.012982:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (2674688->3854335) req@ffff88012f3cca80 x1830967308212224/t17179874291(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 504/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.012992:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cca80 with x1830967308212224 ext(2674688->3854335) 00010000:00010000:2.0:1746147150.013003:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 48 pid: 9586 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746147150.013022:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 48 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.013029:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3cca80 00000100:00100000:0.0:1746147150.014433:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.015601:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.015747:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308212352 00000100:00100000:1.0:1746147150.015757:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308212352 00000100:00100000:1.0:1746147150.015814:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15092 00000100:00100000:1.0:1746147150.015823:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+32:32617:x1830967308212352:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147150.015845:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.015866:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b60 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.015895:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.015897:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.015902:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.015913:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.015924:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f200, rc 0) 00000100:00100000:2.0:1746147150.015926:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308212480 00000100:00100000:2.0:1746147150.015930:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308212480 00010000:00010000:2.0:1746147150.015949:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 48 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746147150.015965:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+33:32617:x1830967308212352:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 144us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.015970:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15092 00000100:00100000:2.0:1746147150.015974:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6689 00000100:00100000:2.0:1746147150.015978:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967308212480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.015986:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.016005:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 48 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.016015:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 48 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.016036:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b000/0x3139939425057947 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2674688->2981887) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78acd expref: 48 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.016046:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.016048:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.016054:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.016065:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.016071:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.016072:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.016075:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.016081:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.016128:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.016141:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310763904:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.016299:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.016307:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310764032:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.016331:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.018455:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310763904:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.018466:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310764032:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.018487:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.018520:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967308212480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2540us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.018532:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6689 00000100:00100000:0.0:1746147150.019552:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.019599:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308212736 00000100:00100000:2.0:1746147150.019606:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308212736 00002000:00100000:2.0:1746147150.019660:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009f087480 x1830967308212736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.019670:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967308212736 ext(1048576->2097151) 00002000:00010000:2.0:1746147150.019676:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:2.0:1746147150.019815:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3765 00000100:00100000:2.0:1746147150.019823:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308212736:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:1.0:1746147150.020021:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147150.025645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.025670:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.025698:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.025720:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308213120 00000100:00100000:2.0:1746147150.025729:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308213120 00002000:00100000:2.0:1746147150.025771:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880134ab0380 x1830967308213120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147150.025780:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308213248 00002000:00100000:2.0:1746147150.025781:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0380 with x1830967308213120 ext(2097152->3145727) 00002000:00010000:2.0:1746147150.025787:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0380 00000100:00100000:3.0:1746147150.025791:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308213248 00000100:00100000:2.0:1746147150.025812:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308213504 00000100:00100000:2.0:1746147150.025814:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308213504 00002000:00100000:2.0:1746147150.025823:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3334144->3338239) req@ffff880134ab3800 x1830967308213504/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.025829:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab3800 with x1830967308213504 ext(3334144->3338239) 00002000:00010000:2.0:1746147150.025832:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab3800 00002000:00100000:3.0:1746147150.025842:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2564095) req@ffff880134ab1500 x1830967308213248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147150.025843:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3766 00000100:00100000:2.0:1746147150.025851:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+34:2001:x1830967308213120:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147150.025852:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab1500 with x1830967308213248 ext(2097152->2564095) 00002000:00010000:3.0:1746147150.025856:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab1500 00000100:00100000:3.0:1746147150.025892:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3767 00000100:00100000:3.0:1746147150.025901:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+34:2003:x1830967308213504:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.026028:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+35:2003:x1830967308213504:12345-192.168.204.25@tcp:3:cat.0 Request processed in 128us (328us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147150.026034:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3767 00002000:00100000:3.0:1746147150.026040:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3334144->3338239) req@ffff880134ab3800 x1830967308213504/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.026046:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab3800 with x1830967308213504 ext(3334144->3338239) 00002000:00010000:3.0:1746147150.026049:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab3800 00000100:00100000:3.0:1746147150.026065:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3768 00000100:00100000:3.0:1746147150.026069:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308213248:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.030868:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308213248:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4784us (5183us total) trans 0 rc 466944/466944 00000100:00100000:3.0:1746147150.030882:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3768 00002000:00100000:3.0:1746147150.030896:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->2564095) req@ffff880134ab1500 x1830967308213248/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.030906:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab1500 with x1830967308213248 ext(2097152->2564095) 00002000:00010000:3.0:1746147150.030912:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134ab1500 00000100:00100000:2.0:1746147150.030932:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967308212736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11108us (11383us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.030974:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3765 00002000:00100000:2.0:1746147150.030980:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009f087480 x1830967308212736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.030988:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967308212736 ext(1048576->2097151) 00002000:00010000:2.0:1746147150.030991:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:0.0:1746147150.031436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.031506:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308213760 00000100:00100000:2.0:1746147150.031514:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308213760 00000100:00100000:2.0:1746147150.032053:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5557 00000100:00100000:2.0:1746147150.032062:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+21:32617:x1830967308213760:12345-192.168.204.25@tcp:35:multiop.0 00000100:00080000:1.0:1746147150.032248:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147150.032888:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:32617:x1830967308213760:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 824us (1450us total) trans 8589936131 rc 0/0 00000100:00100000:2.0:1746147150.032895:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5557 00000100:00100000:2.0:1746147150.033392:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308213120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7541us (7757us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.033399:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3766 00002000:00100000:2.0:1746147150.033406:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880134ab0380 x1830967308213120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.033414:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab0380 with x1830967308213120 ext(2097152->3145727) 00002000:00010000:2.0:1746147150.033419:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab0380 00000100:00100000:0.0:1746147150.036741:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.036791:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308213888 00000100:00100000:1.0:1746147150.036810:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308213888 00000100:00100000:1.0:1746147150.037400:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15093 00000100:00100000:1.0:1746147150.037409:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32627:x1830967308213888:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147150.037428:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.037446:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b67 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.037479:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.037486:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.037488:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.037491:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 48 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.037523:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.037535:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 32 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746147150.037547:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764160:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.037627:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.038891:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.038937:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.038954:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308214272 00000100:00100000:2.0:1746147150.038960:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308214272 00000100:00100000:3.0:1746147150.038986:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308214400 00000100:00100000:3.0:1746147150.038990:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308214400 00002000:00100000:3.0:1746147150.039005:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3338240->4194303) req@ffff88009f085c00 x1830967308214400/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.039005:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88009f084700 x1830967308214272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.039014:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085c00 with x1830967308214400 ext(3338240->4194303) 00002000:00100000:2.0:1746147150.039014:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967308214272 ext(3145728->4194303) 00002000:00010000:3.0:1746147150.039019:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085c00 00002000:00010000:2.0:1746147150.039019:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:3.0:1746147150.039045:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3769 00000100:00100000:3.0:1746147150.039051:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+33:2000:x1830967308214400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.039059:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3770 00000100:00100000:2.0:1746147150.039062:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308214272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147150.039375:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764160:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.039409:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 48 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.039421:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64aa00, rc 0) 00000100:00100000:1.0:1746147150.039456:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32627:x1830967308213888:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2048us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.039462:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15093 00000100:00100000:0.0:1746147150.039538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.039975:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308214528 00000100:00100000:1.0:1746147150.039979:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308214528 00002000:00100000:1.0:1746147150.039996:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1388544->1900543) req@ffff88009f085180 x1830967308214528/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.040003:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085180 with x1830967308214528 ext(1388544->1900543) 00010000:00010000:1.0:1746147150.040009:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.040024:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.040030:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f085180 00000100:00100000:1.0:1746147150.040049:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1183 00000100:00100000:1.0:1746147150.040054:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308214528:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147150.045780:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308214400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6717us (6829us total) trans 0 rc 856064/856064 00000100:00100000:3.0:1746147150.045795:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3769 00002000:00100000:3.0:1746147150.045821:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3338240->4194303) req@ffff88009f085c00 x1830967308214400/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 856064/856064 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.045832:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085c00 with x1830967308214400 ext(3338240->4194303) 00002000:00010000:3.0:1746147150.045838:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085c00 00000100:00100000:3.0:1746147150.046398:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:2000:x1830967308214272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7333us (7512us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.046405:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3770 00002000:00100000:3.0:1746147150.046410:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff88009f084700 x1830967308214272/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.046418:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967308214272 ext(3145728->4194303) 00002000:00010000:3.0:1746147150.046422:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:0.0:1746147150.047544:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308214528:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7484us (8001us total) trans 17179874292 rc 0/0 00000100:00100000:0.0:1746147150.047553:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1183 00002000:00100000:0.0:1746147150.047559:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1388544->1900543) req@ffff88009f085180 x1830967308214528/t17179874292(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.047566:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085180 with x1830967308214528 ext(1388544->1900543) 00010000:00010000:0.0:1746147150.047576:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.047591:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746147150.047597:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f085180 00000100:00100000:0.0:1746147150.049699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.049774:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308214656 00000100:00100000:2.0:1746147150.049784:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308214656 00010000:00010000:2.0:1746147150.049834:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.049875:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6690 00000100:00100000:2.0:1746147150.049884:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+35:2001:x1830967308214656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.049900:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.049919:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.049930:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.049954:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e800/0x3139939425057891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1900543) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78a41 expref: 35 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.049985:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.049988:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.049995:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.050004:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.050038:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.050051:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310764288:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.050160:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.051462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.051614:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308214784 00000100:00100000:1.0:1746147150.051620:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308214784 00000100:00100000:1.0:1746147150.051659:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15094 00000100:00100000:1.0:1746147150.051665:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308214784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147150.051681:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.051694:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b6e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.051712:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.051713:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.051719:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.051731:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.051739:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64ae00, rc 0) 00000100:00100000:1.0:1746147150.051773:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+36:2000:x1830967308214784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 108us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.051781:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15094 00000100:00100000:0.0:1746147150.052013:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.052042:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308214912 00000100:00100000:1.0:1746147150.052045:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308214912 00000100:00100000:1.0:1746147150.052060:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15095 00000100:00100000:1.0:1746147150.052065:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+36:2000:x1830967308214912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147150.052072:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.052079:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64b000/0x3139939425057a7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b75 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.052142:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764416:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147150.052178:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.055978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.056020:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310764288:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.056044:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.056116:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967308214656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6232us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.056128:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6690 00000100:00100000:1.0:1746147150.056329:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308215168 00000100:00100000:1.0:1746147150.056338:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308215168 00002000:00100000:1.0:1746147150.056380:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009f085f80 x1830967308215168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147150.056381:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764416:192.168.204.25@tcp:106: 00002000:00100000:1.0:1746147150.056390:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085f80 with x1830967308215168 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.056394:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085f80 00000100:00100000:1.0:1746147150.056428:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3771 00000100:00100000:1.0:1746147150.056435:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308215168:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147150.056476:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64b000/0x3139939425057a7b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b75 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.056490:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64b000/0x3139939425057a7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b75 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.056517:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64b000, rc 0) 00000100:00100000:0.0:1746147150.056606:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308214912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4538us (4591us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147150.056613:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15095 00000100:00100000:0.0:1746147150.060939:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.061353:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308215424 00000100:00100000:3.0:1746147150.061363:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308215424 00002000:00100000:3.0:1746147150.061417:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f084a80 x1830967308215424/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.061429:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084a80 with x1830967308215424 ext(4194304->4919295) 00002000:00010000:3.0:1746147150.061436:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084a80 00000100:00100000:3.0:1746147150.061472:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3772 00000100:00100000:3.0:1746147150.061482:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+35:2003:x1830967308215424:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147150.064656:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308215168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8211us (8679us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.064669:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3771 00002000:00100000:1.0:1746147150.064681:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff88009f085f80 x1830967308215168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.064696:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085f80 with x1830967308215168 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.064702:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085f80 00000100:00100000:3.0:1746147150.065375:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+35:2003:x1830967308215424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 3894us (4448us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147150.065383:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3772 00002000:00100000:3.0:1746147150.065388:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88009f084a80 x1830967308215424/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.065395:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084a80 with x1830967308215424 ext(4194304->4919295) 00002000:00010000:3.0:1746147150.065399:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084a80 00000100:00100000:0.0:1746147150.068548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.069343:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308215552 00000100:00100000:2.0:1746147150.069353:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308215552 00000100:00100000:2.0:1746147150.069403:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15096 00000100:00100000:2.0:1746147150.069412:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308215552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.069432:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.069452:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425057a82 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b7c expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.069509:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764544:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147150.069601:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.071159:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764544:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147150.071188:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425057a82 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b7c expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.071201:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x3139939425057a82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b7c expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.071214:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49400, rc 0) 00000100:00100000:2.0:1746147150.071262:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308215552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1851us (2723us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.071269:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15096 00000100:00100000:0.0:1746147150.072143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.072373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.072459:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308215808 00000100:00100000:2.0:1746147150.072466:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308215808 00000100:00100000:2.0:1746147150.072662:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308215680 00000100:00100000:2.0:1746147150.072665:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308215680 00000100:00100000:1.0:1746147150.072738:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15097 00000100:00100000:1.0:1746147150.072750:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308215808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147150.072769:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.072788:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30800/0x3139939425057a89 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b8a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.072847:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310764672:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147150.072971:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15098 00000100:00100000:2.0:1746147150.072977:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967308215680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.072986:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.072996:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d48600/0x3139939425057a90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b83 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.073022:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764800:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147150.073554:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.073627:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.074113:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.074179:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308215936 00000100:00100000:3.0:1746147150.074184:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308215936 00000100:00100000:3.0:1746147150.074211:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15099 00000100:00100000:3.0:1746147150.074217:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308215936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.074226:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.074236:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x3139939425057a97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b91 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.074268:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310764928:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147150.074336:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.075142:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310764800:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147150.075142:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310764672:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147150.075165:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d48600/0x3139939425057a90 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b83 expref: 49 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.075165:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30800/0x3139939425057a89 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b8a expref: 34 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.075176:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30800/0x3139939425057a89 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b8a expref: 34 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.075180:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d48600/0x3139939425057a90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b83 expref: 49 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.075197:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48600, rc 0) 00010000:00010000:1.0:1746147150.075204:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30800, rc 0) 00000100:00100000:2.0:1746147150.075225:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967308215680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2247us (2851us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147150.075226:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308215808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2480us (3085us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.075231:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15098 00000100:00100000:1.0:1746147150.075241:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15097 00000100:00100000:3.0:1746147150.075460:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310764928:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147150.075475:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x3139939425057a97 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b91 expref: 36 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.075484:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33000/0x3139939425057a97 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b91 expref: 36 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.075502:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00000100:00100000:3.0:1746147150.075520:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+35:2002:x1830967308215936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1303us (1410us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147150.075525:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15099 00000100:00100000:0.0:1746147150.076901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.076972:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308216064 00000100:00100000:3.0:1746147150.076978:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308216064 00000100:00100000:3.0:1746147150.077075:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15100 00000100:00100000:3.0:1746147150.077083:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:32627:x1830967308216064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.077229:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.077247:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b98 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.077273:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.077275:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.077284:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.077298:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.077307:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32800, rc 0) 00000100:00100000:3.0:1746147150.077430:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32627:x1830967308216064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 346us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.077841:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15100 00000100:00100000:0.0:1746147150.082500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.082601:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308216320 00000100:00100000:2.0:1746147150.082611:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308216320 00000100:00100000:2.0:1746147150.082951:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5558 00000100:00100000:2.0:1746147150.082960:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+22:32621:x1830967308216320:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147150.083980:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:32621:x1830967308216320:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1018us (1487us total) trans 8589936132 rc 0/0 00000100:00100000:2.0:1746147150.083988:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5558 00000100:00100000:0.0:1746147150.084230:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.084364:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308216576 00000100:00100000:3.0:1746147150.084369:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308216576 00002000:00100000:3.0:1746147150.084404:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880091d94380 x1830967308216576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.084414:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94380 with x1830967308216576 ext(2097152->3145727) 00002000:00010000:3.0:1746147150.084420:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94380 00000100:00100000:3.0:1746147150.084544:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3773 00000100:00100000:3.0:1746147150.084551:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2000:x1830967308216576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.095017:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2000:x1830967308216576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10453us (10775us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.095031:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3773 00002000:00100000:2.0:1746147150.095043:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->3145727) req@ffff880091d94380 x1830967308216576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.095053:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94380 with x1830967308216576 ext(2097152->3145727) 00002000:00010000:2.0:1746147150.095059:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94380 00000100:00100000:0.0:1746147150.100144:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.100708:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308216704 00000100:00100000:3.0:1746147150.100719:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308216704 00000100:00100000:2.0:1746147150.100845:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15101 00000100:00100000:2.0:1746147150.100859:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32627:x1830967308216704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.100881:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.100904:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78b9f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.100937:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.100944:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.100946:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.100950:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.101196:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.101209:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 19 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.101222:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310765056:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.101330:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.103079:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310765056:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.103579:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.103597:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49200, rc 0) 00000100:00100000:2.0:1746147150.103649:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32627:x1830967308216704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2792us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.103657:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15101 00000100:00100000:0.0:1746147150.106827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.107471:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308216832 00000100:00100000:2.0:1746147150.107480:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308216832 00002000:00100000:2.0:1746147150.107518:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2564096->3145727) req@ffff880091d94700 x1830967308216832/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.107527:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967308216832 ext(2564096->3145727) 00010000:00010000:2.0:1746147150.107535:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 20 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.107548:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 20 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.107554:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d94700 00000100:00100000:2.0:1746147150.107582:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1184 00000100:00100000:2.0:1746147150.107588:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+20:2001:x1830967308216832:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147150.117720:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308216832:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10121us (10892us total) trans 21474841548 rc 0/0 00000100:00100000:2.0:1746147150.117732:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1184 00002000:00100000:2.0:1746147150.117743:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2564096->3145727) req@ffff880091d94700 x1830967308216832/t21474841548(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.117752:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967308216832 ext(2564096->3145727) 00010000:00010000:2.0:1746147150.117760:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.117779:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.117785:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d94700 00000100:00100000:0.0:1746147150.122558:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.122709:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308216960 00000100:00100000:2.0:1746147150.122716:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308216960 00010000:00010000:2.0:1746147150.122746:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.122775:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6691 00000100:00100000:2.0:1746147150.122780:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308216960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.122789:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.122814:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.122824:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.122842:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ec00/0x3139939425057a20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b28 expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.122862:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.122864:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.122870:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.122882:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.122913:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.122925:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310765184:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.123122:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.124963:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967310765184:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.124981:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.125055:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+21:2001:x1830967308216960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2272us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.125063:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6691 00000100:00100000:0.0:1746147150.127150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.127369:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308217216 00000100:00100000:2.0:1746147150.127376:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308217216 00002000:00100000:2.0:1746147150.127413:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8801305f0000 x1830967308217216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.127422:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0000 with x1830967308217216 ext(2097152->3145727) 00002000:00010000:2.0:1746147150.127427:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f0000 00000100:00100000:2.0:1746147150.127589:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3774 00000100:00100000:2.0:1746147150.127597:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967308217216:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.135605:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967308217216:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8001us (8451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.135618:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3774 00002000:00100000:2.0:1746147150.135629:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->3145727) req@ffff8801305f0000 x1830967308217216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.135638:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0000 with x1830967308217216 ext(2097152->3145727) 00002000:00010000:2.0:1746147150.135643:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f0000 00000100:00100000:0.0:1746147150.142608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.142691:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308217344 00000100:00100000:2.0:1746147150.142700:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308217344 00000100:00100000:2.0:1746147150.142745:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15102 00000100:00100000:2.0:1746147150.142753:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:32627:x1830967308217344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.142767:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.142781:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ba6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.142817:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.142823:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.142824:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.142827:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.142852:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.142861:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 34 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.142875:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310765312:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.142953:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.146180:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310765312:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.146206:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.146222:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79ac00, rc 0) 00000100:00100000:2.0:1746147150.146278:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32627:x1830967308217344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3524us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.146491:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15102 00000100:00100000:0.0:1746147150.146782:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.146823:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308217472 00000100:00100000:2.0:1746147150.146829:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308217472 00002000:00100000:2.0:1746147150.146859:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3338239) req@ffff8801305f1500 x1830967308217472/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.146868:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1500 with x1830967308217472 ext(3145728->3338239) 00010000:00010000:2.0:1746147150.146874:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 35 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.146885:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 35 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.146936:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f1500 00000100:00100000:2.0:1746147150.146956:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1185 00000100:00100000:2.0:1746147150.146962:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+35:2000:x1830967308217472:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147150.151652:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+37:2000:x1830967308217472:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4679us (4860us total) trans 17179874293 rc 0/0 00000100:00100000:2.0:1746147150.151665:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1185 00002000:00100000:2.0:1746147150.151677:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->3338239) req@ffff8801305f1500 x1830967308217472/t17179874293(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.151687:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1500 with x1830967308217472 ext(3145728->3338239) 00010000:00010000:2.0:1746147150.151698:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 37 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.151712:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 37 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.151719:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f1500 00000100:00100000:1.0:1746147150.163812:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.164051:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.164136:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308217600 00000100:00100000:3.0:1746147150.164147:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308217600 00010000:00010000:3.0:1746147150.164188:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 37 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.164220:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308217856 00000100:00100000:2.0:1746147150.164229:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308217856 00000100:00100000:3.0:1746147150.164232:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6692 00000100:00100000:3.0:1746147150.164240:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+37:2000:x1830967308217600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.164254:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147150.164269:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15406 00010000:00010000:3.0:1746147150.164273:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 37 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.164277:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+23:32634:x1830967308217856:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147150.164284:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 37 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.164299:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.164305:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f200/0x3139939425057a66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b60 expref: 37 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.164320:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x3139939425057ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bad expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.164338:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.164340:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.164347:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 49 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.164355:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 49 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.164389:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 49 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.164400:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310765440:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.164471:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147150.164954:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.164967:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.164982:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.164997:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165001:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165006:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165136:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165145:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165151:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:2.0:1746147150.165158:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147150.165231:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165237:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165242:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165247:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165252:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.165256:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165263:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165271:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147150.165274:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.165277:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165282:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x3139939425057aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165304:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165308:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165312:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165316:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0e800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.165319:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165324:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165330:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094f11f00) 00010000:00010000:2.0:1746147150.165332:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.165334:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165342:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x3139939425057ac1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.165381:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01b000/0x3139939425057ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 26 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.165391:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 25 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.165397:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.165399:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147150.165401:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fa00, rc 0) 00000100:00100000:2.0:1746147150.165445:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90095e6f-8cef-455a-9171-4caf9b613254+25:32634:x1830967308217856:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1169us (1655us total) trans 8589936133 rc 0/0 00000100:00100000:2.0:1746147150.165452:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15406 00000100:00100000:3.0:1746147150.168570:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310765440:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147150.168595:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147150.168659:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+36:2000:x1830967308217600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4418us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.168671:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6692 00000100:00100000:0.0:1746147150.175749:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.175809:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.175893:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.175988:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308217984 00000100:00100000:2.0:1746147150.175998:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308217984 00000100:00100000:2.0:1746147150.176050:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15103 00000100:00100000:2.0:1746147150.176059:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+36:32634:x1830967308217984:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147150.176079:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.176133:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bb4 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.176147:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308218240 00000100:00100000:3.0:1746147150.176151:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308218240 00010000:00010000:2.0:1746147150.176169:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.176178:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.176181:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.176184:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->3547135] (req 3342336->3547135) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147150.176185:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801305f1880 x1830967308218240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.176194:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1880 with x1830967308218240 ext(3145728->4194303) 00010000:00010000:3.0:1746147150.176202:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.176211:0:29479:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147150.176217:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f1880 00010000:00010000:2.0:1746147150.176218:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.176231:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.176238:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308218496 00000100:00100000:3.0:1746147150.176240:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308218496 00000100:00100000:2.0:1746147150.176244:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310765568:192.168.204.25@tcp:104: 00002000:00100000:3.0:1746147150.176253:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff8801305f0380 x1830967308218496/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.176261:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0380 with x1830967308218496 ext(3145728->4194303) 00000100:00100000:2.0:1746147150.176264:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1186 00002000:00010000:3.0:1746147150.176265:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f0380 00000100:00100000:2.0:1746147150.176270:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2001:x1830967308218240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.176276:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3775 00000100:00100000:3.0:1746147150.176281:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308218496:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.176943:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9a2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.179941:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310765568:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.180191:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->3547135] (req 3342336->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.180210:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f200, rc 0) 00000100:00100000:2.0:1746147150.180266:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:32634:x1830967308217984:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4207us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.180274:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15103 00000100:00100000:3.0:1746147150.184841:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967308218496:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8546us (8935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.184853:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3775 00002000:00100000:3.0:1746147150.184865:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8e:0x0] (3145728->4194303) req@ffff8801305f0380 x1830967308218496/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.184876:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f0380 with x1830967308218496 ext(3145728->4194303) 00002000:00010000:3.0:1746147150.184882:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f0380 00000100:00100000:2.0:1746147150.187158:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2001:x1830967308218240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10878us (11338us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.187169:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1186 00002000:00100000:2.0:1746147150.187178:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8801305f1880 x1830967308218240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.187192:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f1880 with x1830967308218240 ext(3145728->4194303) 00010000:00010000:2.0:1746147150.187202:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.187216:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.187223:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f1880 00000100:00100000:0.0:1746147150.193661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.193767:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308218624 00000100:00100000:2.0:1746147150.193778:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308218624 00000100:00100000:0.0:1746147150.194303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.194565:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15104 00000100:00100000:2.0:1746147150.194575:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967308218624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.194594:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.194614:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x3139939425057add lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bbb expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.194635:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.194645:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x3139939425057add lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bbb expref: 51 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.194655:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x3139939425057add lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bbb expref: 51 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.194679:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:2.0:1746147150.194723:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967308218624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 150us (1073us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.194732:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15104 00000100:00100000:3.0:1746147150.194875:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308218752 00000100:00100000:3.0:1746147150.194880:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308218752 00010000:00010000:3.0:1746147150.194898:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.194923:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6693 00000100:00100000:3.0:1746147150.194928:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2002:x1830967308218752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.194936:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.194954:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.194965:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.194981:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057aac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ba6 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.194992:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.194994:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.195001:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.195008:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.195037:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.195046:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310765696:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.195109:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.196130:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.196265:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308218880 00000100:00100000:3.0:1746147150.196270:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308218880 00000100:00100000:3.0:1746147150.196295:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15105 00000100:00100000:3.0:1746147150.196300:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32627:x1830967308218880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.196308:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.196319:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bc2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.196336:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.196347:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147150.196348:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147150.196351:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [4194304->4919295] (req 4194304->4919295) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 51 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.196369:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.196381:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.196391:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310765824:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.196486:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310765696:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.196500:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147150.196785:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.196845:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2002:x1830967308218752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1915us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.196852:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6693 00000100:00100000:1.0:1746147150.197271:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.197412:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308219136 00000100:00100000:2.0:1746147150.197416:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308219136 00002000:00100000:2.0:1746147150.197445:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3342336->3346431) req@ffff88011e4c5880 x1830967308219136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.197454:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c5880 with x1830967308219136 ext(3342336->3346431) 00010000:00010000:2.0:1746147150.197461:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.197471:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.197477:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e4c5880 00000100:00100000:2.0:1746147150.197867:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1187 00000100:00100000:2.0:1746147150.197873:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967308219136:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147150.197995:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967308219136:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 121us (723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147150.198000:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1187 00002000:00100000:2.0:1746147150.198005:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3342336->3346431) req@ffff88011e4c5880 x1830967308219136/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.198013:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c5880 with x1830967308219136 ext(3342336->3346431) 00010000:00010000:2.0:1746147150.198017:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.198026:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.198031:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e4c5880 00000100:00100000:2.0:1746147150.198499:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967310765824:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.198517:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [4194304->4919295] (req 4194304->4919295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 50 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.198530:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:2.0:1746147150.198562:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32627:x1830967308218880:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2261us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.198567:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15105 00000100:00100000:0.0:1746147150.203227:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.203375:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308219392 00000100:00100000:3.0:1746147150.203386:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308219392 00002000:00100000:3.0:1746147150.203433:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3543040->3547135) req@ffff8801305f3800 x1830967308219392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.203444:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3800 with x1830967308219392 ext(3543040->3547135) 00010000:00010000:3.0:1746147150.203453:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.203468:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.203475:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f3800 00000100:00100000:3.0:1746147150.203511:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1188 00000100:00100000:3.0:1746147150.203520:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+37:2003:x1830967308219392:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147150.204038:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+37:2003:x1830967308219392:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 518us (821us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147150.204045:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1188 00002000:00100000:3.0:1746147150.204052:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3543040->3547135) req@ffff8801305f3800 x1830967308219392/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.204060:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3800 with x1830967308219392 ext(3543040->3547135) 00010000:00010000:3.0:1746147150.204065:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.204074:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.204079:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305f3800 00000100:00100000:0.0:1746147150.206572:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.206844:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308219776 00000100:00100000:2.0:1746147150.206854:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308219776 00000100:00100000:2.0:1746147150.206907:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5559 00000100:00100000:2.0:1746147150.206916:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:32634:x1830967308219776:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147150.207208:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:32634:x1830967308219776:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 293us (646us total) trans 8589936134 rc 0/0 00000100:00100000:2.0:1746147150.207216:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5559 00000100:00100000:0.0:1746147150.208372:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.208433:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308219904 00000100:00100000:3.0:1746147150.208439:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308219904 00002000:00100000:3.0:1746147150.208471:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3342336->3547135) req@ffff88012e321f80 x1830967308219904/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.208481:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321f80 with x1830967308219904 ext(3342336->3547135) 00010000:00010000:3.0:1746147150.208490:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.208505:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.208516:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e321f80 00000100:00100000:3.0:1746147150.208577:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1189 00000100:00100000:3.0:1746147150.208584:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+37:2000:x1830967308219904:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147150.214082:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308219904:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5484us (5698us total) trans 17179874294 rc 0/0 00000100:00100000:3.0:1746147150.214112:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1189 00002000:00100000:3.0:1746147150.214124:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (3342336->3547135) req@ffff88012e321f80 x1830967308219904/t17179874294(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.214133:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321f80 with x1830967308219904 ext(3342336->3547135) 00010000:00010000:3.0:1746147150.214144:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 39 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.214161:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 39 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.214168:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e321f80 00000100:00100000:0.0:1746147150.214946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.219540:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308220160 00000100:00100000:2.0:1746147150.219556:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308220160 00000100:00100000:2.0:1746147150.219626:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15407 00000100:00100000:2.0:1746147150.219635:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:32636:x1830967308220160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147150.219661:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.219682:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bc9 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.219697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147150.219729:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147150.219814:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.219832:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.219840:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 25 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.219846:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:2.0:1746147150.219884:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 25 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.219918:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308220288 00000100:00100000:3.0:1746147150.219924:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308220288 00010000:00010000:3.0:1746147150.219945:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 39 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.219965:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 25 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.219979:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310765952:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.219980:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6694 00000100:00100000:3.0:1746147150.219985:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+39:2003:x1830967308220288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.219998:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147150.220013:0:8909:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147149 -> 1746147150 00002000:00010000:3.0:1746147150.220016:0:8909:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147149 -> 1746147150 00010000:00010000:3.0:1746147150.220021:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 39 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.220031:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 39 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.220051:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425057ad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 3342336->3547135) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bb4 expref: 39 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.220070:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.220071:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.220073:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.220079:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.220080:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 47 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.220086:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.220101:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310766080:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.220124:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.220129:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.220132:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310766208:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.220153:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.222985:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.223069:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.223132:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308220544 00000100:00100000:0.0:1746147150.223134:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308220416 00000100:00100000:1.0:1746147150.223141:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308220544 00000100:00100000:0.0:1746147150.223141:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308220416 00010000:00010000:1.0:1746147150.223177:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.223177:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 26 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.223208:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6695 00000100:00100000:0.0:1746147150.223216:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308220416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.223230:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.223236:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 26 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.223252:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 26 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.223266:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134ab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310765952:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.223277:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057ac8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bad expref: 26 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.223278:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967310766080:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.223293:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147150.223298:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147150.223307:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147150.223312:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147150.223355:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+25:2000:x1830967308220416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.223362:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6695 00000100:00100000:0.0:1746147150.223386:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6696 00000100:00100000:0.0:1746147150.223391:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967308220544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.223397:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.223401:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.223696:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967310766208:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147150.223709:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147150.223714:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147150.223718:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.223734:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+38:2003:x1830967308220288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3748us (4037us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147150.223735:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425057a12 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b21 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.223740:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6694 00010000:00010000:0.0:1746147150.223746:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147150.223749:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147150.223756:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147150.223762:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147150.223808:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147150.223825:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147150.223827:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967308220544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 435us (855us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147150.223832:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147150.223833:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6696 00000004:00200000:2.0:1746147150.223852:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147150.223982:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 48 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.224010:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.224016:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.224019:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147150.224021:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0e000, rc 0) 00000100:00100000:2.0:1746147150.224044:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:32636:x1830967308220160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4411us (9102us total) trans 8589936135 rc 0/0 00000100:00100000:2.0:1746147150.224051:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15407 00000100:00100000:0.0:1746147150.224985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.225033:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308220800 00000100:00100000:3.0:1746147150.225040:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308220800 00002000:00100000:3.0:1746147150.225073:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012e321500 x1830967308220800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.225082:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321500 with x1830967308220800 ext(4194304->4919295) 00002000:00010000:3.0:1746147150.225086:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e321500 00000100:00100000:3.0:1746147150.225124:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3776 00000100:00100000:3.0:1746147150.225130:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967308220800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.232921:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2003:x1830967308220800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7773us (7921us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147150.232937:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3776 00002000:00100000:3.0:1746147150.232953:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff88012e321500 x1830967308220800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.232964:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e321500 with x1830967308220800 ext(4194304->4919295) 00002000:00010000:3.0:1746147150.232971:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e321500 00000100:00100000:0.0:1746147150.277304:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.277418:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308220928 00000100:00100000:2.0:1746147150.277681:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308220928 00000100:00100000:0.0:1746147150.278851:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15106 00000100:00100000:1.0:1746147150.278917:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:32636:x1830967308220928:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147150.278946:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.278976:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bd0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.279014:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.279025:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 37 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.279034:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.279041:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.279043:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.279046:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 51 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.279327:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.279340:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 12 pid: 12225 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.279360:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310766336:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.280415:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 37 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.280425:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 37 pid: 1136 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.280435:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310766464:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.282567:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.282687:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.282710:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221056 00000100:00100000:2.0:1746147150.282716:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221056 00000100:00100000:2.0:1746147150.282766:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 186 00000100:00100000:2.0:1746147150.282774:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2001:x1830967308221056:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147150.282843:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2001:x1830967308221056:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.282851:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 186 00000100:00100000:2.0:1746147150.282909:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.282930:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221184 00000100:00100000:2.0:1746147150.282933:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221184 00000100:00100000:2.0:1746147150.282968:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221440 00000100:00100000:2.0:1746147150.282970:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221440 00000100:00100000:2.0:1746147150.282985:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 873 00000100:00100000:2.0:1746147150.282991:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2000:x1830967308221184:12345-192.168.204.25@tcp:400:kworker.0 00010000:00010000:1.0:1746147150.283072:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.283114:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.283131:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310766592:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.283185:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.285099:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 874 00000100:00100000:3.0:1746147150.285116:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2000:x1830967308221440:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1746147150.285187:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:2000:x1830967308221440:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 77us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.285194:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 874 00000100:00080000:0.0:1746147150.285260:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147150.285350:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2000:x1830967308221184:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 2357us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.285359:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 873 00000100:00100000:1.0:1746147150.285501:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310766336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.286457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.286498:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.286519:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221568 00000100:00100000:2.0:1746147150.286528:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221568 00010000:00010000:2.0:1746147150.286591:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 13 pid: 12225 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.286624:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6697 00000100:00100000:2.0:1746147150.286632:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308221568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147150.286635:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221312 00000100:00100000:3.0:1746147150.286641:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221312 00010000:00010000:2.0:1746147150.286650:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147150.286673:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 875 00010000:00010000:2.0:1746147150.286676:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 13 pid: 12225 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.286679:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+5:2001:x1830967308221312:12345-192.168.204.25@tcp:400:kworker.0 00010000:00010000:2.0:1746147150.286688:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 13 pid: 12225 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.286715:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505759d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788dc expref: 13 pid: 12225 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.286745:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746147150.286811:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746147150.286814:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147150.286815:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90095e6f-8cef-455a-9171-4caf9b613254+5:2001:x1830967308221312:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 135us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.286819:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310766464:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.286822:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 875 00000100:00100000:0.0:1746147150.286845:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.286863:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e323480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308221568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 232us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.286870:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6697 00000100:00100000:3.0:1746147150.286872:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221696 00000100:00100000:3.0:1746147150.286875:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221696 00010000:00010000:3.0:1746147150.286889:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 38 pid: 1136 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.286907:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6698 00000100:00100000:2.0:1746147150.286912:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+38:2001:x1830967308221696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.286919:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.286926:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 38 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.286934:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 38 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.286944:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x313993942505765a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78922 expref: 38 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.286957:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.286990:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+37:2001:x1830967308221696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.286996:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6698 00000100:00100000:1.0:1746147150.288387:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310766592:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.288423:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 51 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.288440:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30a00, rc 0) 00000100:00100000:1.0:1746147150.288481:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:32636:x1830967308220928:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9620us (11190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.288487:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15106 00000100:00100000:0.0:1746147150.290365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.291924:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308221824 00000100:00100000:1.0:1746147150.291937:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308221824 00010000:00010000:1.0:1746147150.291986:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.292024:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6699 00000100:00100000:1.0:1746147150.292034:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2000:x1830967308221824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147150.292330:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.292370:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.292385:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.292414:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425057542 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788a4 expref: 51 pid: 10340 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.293150:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.293155:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.293166:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.293186:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.293234:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 50 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.293248:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310766720:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147150.293716:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.296904:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.296945:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310766720:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147150.296970:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.297029:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967308221824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4995us (6671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.297040:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6699 00000100:00100000:3.0:1746147150.297120:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222080 00000100:00100000:3.0:1746147150.297127:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222080 00002000:00100000:3.0:1746147150.297165:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (868352->872447) req@ffff880134ab1c00 x1830967308222080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.297306:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab1c00 with x1830967308222080 ext(868352->872447) 00002000:00010000:3.0:1746147150.297312:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab1c00 00000100:00100000:3.0:1746147150.297339:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3777 00000100:00100000:3.0:1746147150.297346:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2001:x1830967308222080:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147150.297467:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2001:x1830967308222080:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 121us (574us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147150.297472:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3777 00002000:00100000:3.0:1746147150.297477:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (868352->872447) req@ffff880134ab1c00 x1830967308222080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.297484:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134ab1c00 with x1830967308222080 ext(868352->872447) 00002000:00010000:3.0:1746147150.297488:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134ab1c00 00000100:00100000:0.0:1746147150.305277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.305391:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222208 00000100:00100000:1.0:1746147150.305401:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222208 00000100:00100000:1.0:1746147150.305462:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15107 00000100:00100000:1.0:1746147150.305471:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:32636:x1830967308222208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147150.305493:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.305516:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bd7 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.305548:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.305558:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 20 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.305566:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.305572:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.305574:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.305577:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.305607:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.305619:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 11 pid: 1398 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.305630:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310766848:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.305732:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 20 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.305741:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 20 pid: 1853 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.305751:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310766976:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.306960:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.306975:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.306985:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310767104:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.309322:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.310344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.310412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.310473:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222336 00000100:00100000:3.0:1746147150.310483:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222336 00010000:00010000:3.0:1746147150.310523:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 21 pid: 1853 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.310783:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310766848:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.310803:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310766976:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.311080:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222464 00000100:00100000:3.0:1746147150.311083:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222464 00010000:00010000:3.0:1746147150.311137:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 12 pid: 1398 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.311155:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6700 00000100:00100000:3.0:1746147150.311162:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:2002:x1830967308222336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.311175:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.311194:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 21 pid: 1853 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.311204:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 21 pid: 1853 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.311225:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03da00/0x3139939425057661 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78929 expref: 21 pid: 1853 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.311299:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147150.311300:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6701 00000100:00100000:0.0:1746147150.311308:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308222464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147150.311340:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+20:2002:x1830967308222336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 177us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.311346:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6700 00000100:00080000:1.0:1746147150.311365:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147150.311405:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.311416:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 12 pid: 1398 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.311425:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 12 pid: 1398 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.311437:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x313993942505758f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788e3 expref: 12 pid: 1398 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.311453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147150.311455:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.311471:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222720 00000100:00100000:0.0:1746147150.311472:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308222464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 166us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.311474:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222720 00000100:00100000:0.0:1746147150.311478:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6701 00000100:00100000:2.0:1746147150.311498:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15408 00000100:00100000:2.0:1746147150.311503:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+25:32641:x1830967308222720:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147150.311668:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310767104:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.311695:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.311706:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30c00, rc 0) 00000100:00100000:0.0:1746147150.311728:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32636:x1830967308222208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6259us (6469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.311734:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15107 00010000:00010000:2.0:1746147150.311771:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.311943:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212c00/0x3139939425057b0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bde expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.312010:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312021:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312031:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312041:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312046:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312052:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312304:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212800/0x3139939425057b23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312313:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212800/0x3139939425057b23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312318:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212800/0x3139939425057b23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147150.312324:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147150.312394:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312399:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312404:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312410:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312415:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f212200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.312419:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312425:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312433:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147150.312435:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.312439:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.312444:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212200/0x3139939425057b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313051:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313057:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313061:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313065:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f212a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.313067:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313071:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313078:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094f11f00) 00010000:00010000:2.0:1746147150.313080:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.313082:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313087:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425057b1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.313146:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212c00/0x3139939425057b0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bde expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.313156:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212800/0x3139939425057b23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bde expref: 27 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.313162:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.313164:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147150.313166:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212800, rc 0) 00000100:00100000:2.0:1746147150.313386:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:32641:x1830967308222720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1880us (1932us total) trans 8589936136 rc 0/0 00000100:00100000:2.0:1746147150.313392:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15408 00000100:00100000:3.0:1746147150.313777:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.313923:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222848 00000100:00100000:0.0:1746147150.313930:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222848 00010000:00010000:0.0:1746147150.313956:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.313980:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6702 00000100:00100000:0.0:1746147150.313987:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967308222848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.313998:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.314013:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.314024:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.314041:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x3139939425057557 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e788ab expref: 35 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.314053:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.314055:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.314063:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.314071:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.314123:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.314135:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e321180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310767232:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147150.314201:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.319269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.319386:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.319397:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e321180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310767232:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147150.319414:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.319432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.319466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.319469:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308222976 00000100:00100000:3.0:1746147150.319476:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308222976 00000100:00100000:3.0:1746147150.319523:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 832 00000100:00100000:3.0:1746147150.319530:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+27:2000:x1830967308222976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.319546:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.319571:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212800/0x3139939425057b23 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bde expref: 27 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.319594:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.319599:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147150.319633:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+26:2000:x1830967308222976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.319639:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 832 00010000:00010000:2.0:1746147150.319835:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.320014:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308223104 00000100:00100000:1.0:1746147150.320018:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308223104 00000100:00100000:0.0:1746147150.320021:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308223232 00000100:00100000:0.0:1746147150.320024:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308223232 00000100:00100000:0.0:1746147150.320047:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308223360 00000100:00100000:0.0:1746147150.320049:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308223360 00000100:00100000:1.0:1746147150.320056:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308223488 00000100:00100000:1.0:1746147150.320059:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308223488 00000100:00100000:0.0:1746147150.320063:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15108 00000100:00100000:0.0:1746147150.320068:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967308223232:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147150.320075:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15109 00000100:00100000:1.0:1746147150.320079:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+38:2000:x1830967308223104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147150.320086:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.320086:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.320126:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425057b31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78be5 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.320126:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cc0000/0x3139939425057b38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bec expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.320172:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310767488:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147150.320172:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310767360:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147150.320222:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.320242:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15110 00000100:00100000:0.0:1746147150.320247:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308223360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.320253:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.320260:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bf3 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.320271:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.320273:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.320282:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.320297:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.320309:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64b200, rc 0) 00000100:00100000:2.0:1746147150.320365:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15111 00000100:00100000:2.0:1746147150.320373:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308223488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.320379:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.320386:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78bfa expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.320397:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.320398:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.320402:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.320412:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.320418:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212c00, rc 0) 00000100:00100000:1.0:1746147150.320559:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.320631:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967308223488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 259us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.320631:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+40:2000:x1830967308223360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 382us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.320636:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15110 00000100:00100000:2.0:1746147150.320639:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15111 00000100:00100000:2.0:1746147150.320660:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967308222848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6674us (6884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.320667:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6702 00000100:00100000:0.0:1746147150.328177:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.328340:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308223744 00000100:00100000:3.0:1746147150.328353:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308223744 00002000:00100000:3.0:1746147150.328415:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1449984->1454079) req@ffff8801305f3100 x1830967308223744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.328427:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3100 with x1830967308223744 ext(1449984->1454079) 00002000:00010000:3.0:1746147150.328434:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f3100 00000100:00100000:3.0:1746147150.328463:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3778 00000100:00100000:3.0:1746147150.328473:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967308223744:12345-192.168.204.25@tcp:3:multiop.0 00002000:00010000:1.0:1746147150.328501:0:17600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime: 1746147148 -> 1746147150 00002000:00010000:1.0:1746147150.328512:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime: 1746147148 -> 1746147150 00002000:00010000:1.0:1746147150.328514:0:17600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime: 1746147148 -> 1746147150 00000100:00100000:1.0:1746147150.328535:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310767488:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147150.328592:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425057b31 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78be5 expref: 39 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.328607:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425057b31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78be5 expref: 39 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.328637:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31e00, rc 0) 00000100:00100000:1.0:1746147150.328677:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+38:2000:x1830967308223104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8597us (9290us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147150.328685:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15109 00002000:00010000:2.0:1746147150.328696:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746147148 -> 1746147150 00002000:00010000:2.0:1746147150.328699:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746147148 -> 1746147150 00002000:00010000:2.0:1746147150.328701:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746147148 -> 1746147150 00000100:00100000:2.0:1746147150.328708:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310767360:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147150.328924:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967308223744:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 452us (761us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147150.328930:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3778 00002000:00100000:3.0:1746147150.328936:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1449984->1454079) req@ffff8801305f3100 x1830967308223744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.328945:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305f3100 with x1830967308223744 ext(1449984->1454079) 00002000:00010000:3.0:1746147150.328948:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305f3100 00010000:00010000:2.0:1746147150.329007:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cc0000/0x3139939425057b38 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bec expref: 22 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.329020:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cc0000/0x3139939425057b38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bec expref: 22 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.329226:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cc0000, rc 0) 00000100:00100000:2.0:1746147150.329252:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+21:2000:x1830967308223232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9183us (9836us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.329257:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15108 00000100:00100000:0.0:1746147150.337901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.338168:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308223872 00000100:00100000:2.0:1746147150.338177:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308223872 00000100:00100000:2.0:1746147150.338231:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15112 00000100:00100000:2.0:1746147150.338239:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+38:32641:x1830967308223872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.338260:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.338285:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c01 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.338327:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 49 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.338335:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.338337:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.338340:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 39 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.338368:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 49 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.338378:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 49 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.338390:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310767616:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.338488:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5510900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.347264:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.347541:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308224128 00000100:00100000:2.0:1746147150.347552:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308224128 00000100:00100000:2.0:1746147150.347617:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15409 00000100:00100000:2.0:1746147150.347627:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:32643:x1830967308224128:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147150.347657:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.347681:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cc7600/0x3139939425057b54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c08 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.347762:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347778:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347801:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347815:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347820:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347826:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347926:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f200/0x3139939425057b69 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347936:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f200/0x3139939425057b69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.347943:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f200/0x3139939425057b69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147150.347951:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147150.348029:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348035:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348040:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348046:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348052:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0fc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.348055:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348062:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348072:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147150.348075:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.348079:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348085:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fc00/0x3139939425057b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348154:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348159:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348164:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348167:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.348169:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348172:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348179:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094f11f00) 00010000:00010000:2.0:1746147150.348180:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.348183:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348187:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425057b62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.348223:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cc7600/0x3139939425057b54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c08 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.348239:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f200/0x3139939425057b69 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c08 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.348245:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.348247:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147150.348249:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f200, rc 0) 00000100:00100000:2.0:1746147150.350259:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:32643:x1830967308224128:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2622us (2995us total) trans 8589936137 rc 0/0 00000100:00100000:2.0:1746147150.350272:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15409 00000100:00100000:3.0:1746147150.351131:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310767616:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.351170:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 39 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.351180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147150.351188:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212a00, rc 0) 00000100:00100000:0.0:1746147150.351213:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308224256 00000100:00100000:0.0:1746147150.351219:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308224256 00002000:00100000:0.0:1746147150.351253:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (868352->1048575) req@ffff880129f57b80 x1830967308224256/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.351261:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967308224256 ext(868352->1048575) 00010000:00010000:0.0:1746147150.351270:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.351282:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 50 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746147150.351288:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f57b80 00000100:00100000:3.0:1746147150.351965:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:90095e6f-8cef-455a-9171-4caf9b613254+39:32641:x1830967308223872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 13724us (14072us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.351974:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15112 00000100:00100000:1.0:1746147150.353386:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1190 00000100:00100000:1.0:1746147150.353401:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2001:x1830967308224256:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147150.354016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.354149:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308224384 00000100:00100000:2.0:1746147150.354157:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308224384 00000100:00100000:2.0:1746147150.354279:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 833 00000100:00100000:2.0:1746147150.354286:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+28:2001:x1830967308224384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.354299:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.354862:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f200/0x3139939425057b69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c08 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.354890:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.354895:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.354940:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+27:2001:x1830967308224384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 654us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.354947:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 833 00000100:00100000:1.0:1746147150.356609:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2001:x1830967308224256:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 3202us (5424us total) trans 17179874295 rc 0/0 00000100:00100000:1.0:1746147150.356622:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1190 00002000:00100000:1.0:1746147150.356634:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (868352->1048575) req@ffff880129f57b80 x1830967308224256/t17179874295(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.356644:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967308224256 ext(868352->1048575) 00010000:00010000:1.0:1746147150.356656:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 52 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.356670:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 52 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.356677:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f57b80 00000100:00100000:0.0:1746147150.360142:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.360475:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308224512 00000100:00100000:2.0:1746147150.360485:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308224512 00010000:00010000:2.0:1746147150.360521:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 52 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.360558:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6703 00000100:00100000:2.0:1746147150.360564:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2000:x1830967308224512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.360578:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.360597:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 52 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.360608:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 52 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.360631:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x3139939425057b00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd0 expref: 52 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.360645:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.360646:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.360653:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.360661:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.360691:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.360703:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310767744:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147150.361648:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310767872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147150.361682:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.361709:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310767872 00000100:00100000:0.0:1746147150.361712:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310767872 00000100:00100000:0.0:1746147150.361753:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1746147150.361757:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310767872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746147150.361775:0:9587:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1178240064 pending 11169792 free 3904991232 avail 3673468928 00000100:00100000:0.0:1746147150.361814:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310767872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.361819:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00080000:0.0:1746147150.361840:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147150.362350:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.362451:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310767872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746147150.367264:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967310767744:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.367292:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.367561:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2000:x1830967308224512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6994us (7428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.367574:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6703 00000100:00100000:0.0:1746147150.368045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.368209:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308224768 00000100:00100000:1.0:1746147150.368218:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308224768 00002000:00100000:1.0:1746147150.368267:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f56d80 x1830967308224768/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.368277:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967308224768 ext(0->1048575) 00002000:00010000:1.0:1746147150.368283:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56d80 00000100:00100000:1.0:1746147150.368300:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3779 00000100:00100000:1.0:1746147150.368308:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+39:2002:x1830967308224768:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147150.381264:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+39:2002:x1830967308224768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12943us (13207us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.381277:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3779 00002000:00100000:1.0:1746147150.381290:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f56d80 x1830967308224768/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.381300:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967308224768 ext(0->1048575) 00002000:00010000:1.0:1746147150.381306:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56d80 00000100:00100000:0.0:1746147150.382325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.382457:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308224896 00000100:00100000:3.0:1746147150.382466:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308224896 00000100:00100000:3.0:1746147150.382517:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15113 00000100:00100000:3.0:1746147150.382526:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2002:x1830967308224896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.382543:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.382562:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c0f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.382586:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.382588:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.382597:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 52 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.382613:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 52 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.382629:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32a00, rc 0) 00000100:00100000:3.0:1746147150.382655:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2002:x1830967308224896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.382661:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15113 00000100:00100000:0.0:1746147150.391779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.392516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.392562:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.392591:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308225280 00000100:00100000:0.0:1746147150.392600:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308225280 00002000:00100000:0.0:1746147150.392650:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f56a00 x1830967308225280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.392659:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56a00 with x1830967308225280 ext(0->1048575) 00002000:00010000:0.0:1746147150.392665:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56a00 00000100:00100000:0.0:1746147150.392682:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308225536 00000100:00100000:0.0:1746147150.392685:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308225536 00002000:00100000:0.0:1746147150.392697:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1454080->2097151) req@ffff88009c309880 x1830967308225536/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147150.392756:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3780 00000100:00100000:1.0:1746147150.392768:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2002:x1830967308225280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.393189:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308225024 00000100:00100000:2.0:1746147150.393195:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308225024 00000100:00100000:2.0:1746147150.393231:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15114 00002000:00100000:0.0:1746147150.393235:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309880 with x1830967308225536 ext(1454080->2097151) 00000100:00100000:2.0:1746147150.393236:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+21:32641:x1830967308225024:12345-192.168.204.25@tcp:101:cat.0 00002000:00010000:0.0:1746147150.393239:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c309880 00010000:00010000:2.0:1746147150.393247:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147150.393259:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3781 00010000:00010000:2.0:1746147150.393265:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c16 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.393267:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967308225536:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:2.0:1746147150.393291:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.393299:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.393301:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.393304:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.393334:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.393350:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 34 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.393361:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310768000:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.393447:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.395978:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.396017:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308225664 00000100:00100000:0.0:1746147150.396024:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308225664 00002000:00100000:0.0:1746147150.396065:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1454079) req@ffff88009c309f80 x1830967308225664/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.396075:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309f80 with x1830967308225664 ext(1048576->1454079) 00010000:00010000:0.0:1746147150.396084:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.396119:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746147150.396128:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c309f80 00000100:00100000:0.0:1746147150.396147:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1191 00000100:00100000:0.0:1746147150.396155:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308225664:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147150.398258:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310768000:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.398294:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.398311:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f213000, rc 0) 00000100:00100000:3.0:1746147150.398380:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+22:32641:x1830967308225024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5142us (6611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.398389:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15114 00000100:00100000:1.0:1746147150.400928:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308225536:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7644us (8347us total) trans 0 rc 643072/643072 00000100:00100000:1.0:1746147150.400941:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3781 00002000:00100000:1.0:1746147150.400953:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1454080->2097151) req@ffff88009c309880 x1830967308225536/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.400962:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309880 with x1830967308225536 ext(1454080->2097151) 00010000:00010000:1.0:1746147150.400972:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.400988:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.400995:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c309880 00000100:00100000:1.0:1746147150.405990:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2002:x1830967308225280:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13208us (13459us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.406006:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3780 00002000:00100000:1.0:1746147150.406023:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880129f56a00 x1830967308225280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.406032:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56a00 with x1830967308225280 ext(0->1048575) 00002000:00010000:1.0:1746147150.406039:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56a00 00000100:00100000:1.0:1746147150.408496:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308225664:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12333us (12517us total) trans 21474841549 rc 0/0 00000100:00100000:1.0:1746147150.408508:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1191 00002000:00100000:1.0:1746147150.408517:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1454079) req@ffff88009c309f80 x1830967308225664/t21474841549(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.408529:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c309f80 with x1830967308225664 ext(1048576->1454079) 00010000:00010000:1.0:1746147150.408540:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.408600:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.408608:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c309f80 00000100:00100000:0.0:1746147150.411880:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.412016:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308225792 00000100:00100000:2.0:1746147150.412026:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308225792 00010000:00010000:2.0:1746147150.412066:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.414383:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6704 00000100:00100000:2.0:1746147150.414400:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308225792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.414420:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.414447:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.414464:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.414490:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30c00/0x3139939425057b07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bd7 expref: 36 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.414514:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.414516:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.414523:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.414533:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.414686:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.414701:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310768128:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.414801:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.415557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.415602:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308225920 00000100:00100000:3.0:1746147150.415611:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308225920 00000100:00100000:3.0:1746147150.415649:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15115 00000100:00100000:3.0:1746147150.415655:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32647:x1830967308225920:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.415670:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.415683:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c1d expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.415698:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.415700:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.415704:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 37 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.415720:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 37 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.415728:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32200, rc 0) 00000100:00100000:3.0:1746147150.415775:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32647:x1830967308225920:12345-192.168.204.25@tcp:101:cat.0 Request processed in 118us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.415781:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15115 00000100:00100000:0.0:1746147150.424452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.424570:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967310768128:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.424594:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.424630:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308226176 00000100:00100000:1.0:1746147150.424638:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308226176 00002000:00100000:1.0:1746147150.424688:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c308380 x1830967308226176/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.424698:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308380 with x1830967308226176 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.424704:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308380 00000100:00100000:1.0:1746147150.424728:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3782 00000100:00100000:1.0:1746147150.424737:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967308226176:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.425048:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308225792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10653us (13176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.425059:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6704 00000100:00100000:0.0:1746147150.425079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.425119:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308226432 00000100:00100000:0.0:1746147150.425122:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308226432 00002000:00100000:0.0:1746147150.425139:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c30bb80 x1830967308226432/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.425145:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30bb80 with x1830967308226432 ext(1048576->2097151) 00002000:00010000:0.0:1746147150.425149:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30bb80 00000100:00100000:0.0:1746147150.425161:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3783 00000100:00100000:0.0:1746147150.425166:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308226432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.425337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.425366:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308226688 00000100:00100000:3.0:1746147150.425369:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308226688 00002000:00100000:3.0:1746147150.425388:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800984d6d80 x1830967308226688/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.425396:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6d80 with x1830967308226688 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.425400:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6d80 00000100:00100000:3.0:1746147150.425413:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3784 00000100:00100000:3.0:1746147150.425417:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308226688:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.436240:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308226432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11062us (11149us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.436254:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3783 00002000:00100000:2.0:1746147150.436266:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c30bb80 x1830967308226432/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.436276:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30bb80 with x1830967308226432 ext(1048576->2097151) 00002000:00010000:2.0:1746147150.436283:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30bb80 00000100:00100000:1.0:1746147150.437477:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308226176:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12737us (13033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.437486:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3782 00002000:00100000:1.0:1746147150.437492:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c308380 x1830967308226176/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.437500:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308380 with x1830967308226176 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.437504:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308380 00000100:00100000:3.0:1746147150.440351:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308226688:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14920us (15001us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.440362:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3784 00002000:00100000:3.0:1746147150.440375:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8800984d6d80 x1830967308226688/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.440384:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6d80 with x1830967308226688 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.440391:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6d80 00000100:00100000:0.0:1746147150.447771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.447848:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308227072 00000100:00100000:3.0:1746147150.447858:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308227072 00002000:00100000:3.0:1746147150.447908:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88009c30aa00 x1830967308227072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.447917:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30aa00 with x1830967308227072 ext(3145728->4194303) 00002000:00010000:3.0:1746147150.447924:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30aa00 00000100:00100000:3.0:1746147150.447957:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3785 00000100:00100000:3.0:1746147150.447965:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967308227072:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147150.449046:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.449594:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308226816 00000100:00100000:3.0:1746147150.449600:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308226816 00000100:00100000:3.0:1746147150.449649:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15116 00000100:00100000:3.0:1746147150.449655:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+22:32643:x1830967308226816:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147150.449668:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.449687:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c24 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.449715:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.449723:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.449730:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.449733:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.449736:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1314816->2088959] (req 1314816->2088959) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.449771:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 35 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.449785:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 35 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.449809:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310768256:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.449893:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.449901:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 23 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.449909:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310768384:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.449928:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.452671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.452709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.452853:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308227328 00000100:00100000:1.0:1746147150.452862:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308227328 00002000:00100000:1.0:1746147150.452909:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009c30b100 x1830967308227328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.452919:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b100 with x1830967308227328 ext(2097152->4194303) 00002000:00010000:1.0:1746147150.452927:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30b100 00000100:00100000:1.0:1746147150.452945:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308227584 00000100:00100000:1.0:1746147150.452947:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308227584 00002000:00100000:1.0:1746147150.452959:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88009c30ad80 x1830967308227584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.452972:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30ad80 with x1830967308227584 ext(3145728->4194303) 00002000:00010000:1.0:1746147150.452975:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30ad80 00000100:00100000:1.0:1746147150.452988:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3786 00000100:00100000:1.0:1746147150.452995:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308227328:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147150.453066:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310768256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.453119:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3787 00000100:00100000:3.0:1746147150.453125:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2001:x1830967308227584:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147150.457699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.457734:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.457771:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308227840 00000100:00100000:0.0:1746147150.457779:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308227840 00010000:00010000:0.0:1746147150.457830:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 26 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.457859:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308227712 00000100:00100000:0.0:1746147150.457862:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308227712 00010000:00010000:0.0:1746147150.457873:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 36 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.457899:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6705 00000100:00100000:0.0:1746147150.457908:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308227840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.457921:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.457940:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 26 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.457944:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6706 00010000:00010000:0.0:1746147150.457951:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 26 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.457953:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308227712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.457962:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.457986:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 36 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.457992:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147150.457997:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 36 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.458010:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057b85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c1d expref: 36 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.458025:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308227840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (335us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147150.458034:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147150.458035:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6705 00010000:00010000:2.0:1746147150.458037:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.458044:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 26 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.458052:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.458085:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.458119:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310768512:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147150.458174:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f213000/0x3139939425057b7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c16 expref: 25 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.458201:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.458223:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967308227072:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10259us (10465us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.458232:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3785 00002000:00100000:2.0:1746147150.458240:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88009c30aa00 x1830967308227072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.458254:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30aa00 with x1830967308227072 ext(3145728->4194303) 00002000:00010000:2.0:1746147150.458258:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c30aa00 00000100:00100000:3.0:1746147150.458302:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310768384:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.458327:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.458336:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:3.0:1746147150.458924:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90095e6f-8cef-455a-9171-4caf9b613254+24:32643:x1830967308226816:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9267us (9879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.458930:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15116 00000100:00100000:2.0:1746147150.464072:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310768512:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.464123:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.464186:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967308227712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6232us (6448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.464197:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6706 00000100:00100000:0.0:1746147150.464730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.464764:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.464813:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228224 00000100:00100000:3.0:1746147150.464818:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308227968 00000100:00100000:2.0:1746147150.464820:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228224 00000100:00100000:3.0:1746147150.464823:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308227968 00000100:00100000:0.0:1746147150.464826:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.464843:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228352 00000100:00100000:0.0:1746147150.464847:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228352 00002000:00100000:2.0:1746147150.464859:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1314816->1318911) req@ffff88009c308700 x1830967308228224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147150.464868:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15117 00002000:00100000:2.0:1746147150.464869:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308700 with x1830967308228224 ext(1314816->1318911) 00002000:00010000:2.0:1746147150.464873:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308700 00000100:00100000:3.0:1746147150.464875:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15118 00000100:00100000:0.0:1746147150.464875:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32649:x1830967308227968:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:3.0:1746147150.464882:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308228352:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147150.464889:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3788 00010000:00010000:0.0:1746147150.464890:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.464891:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147150.464894:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308228224:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:3.0:1746147150.464906:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x3139939425057b9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c32 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.464907:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c2b expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.464930:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.464938:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.464945:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.464947:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.464950:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->3633151] (req 3436544->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.464983:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.464995:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.464996:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310768768:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147150.465004:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310768640:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.465013:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2001:x1830967308228224:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 118us (247us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147150.465019:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3788 00002000:00100000:2.0:1746147150.465024:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1314816->1318911) req@ffff88009c308700 x1830967308228224/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.465031:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c308700 with x1830967308228224 ext(1314816->1318911) 00002000:00010000:2.0:1746147150.465034:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c308700 00010000:00010000:0.0:1746147150.465065:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.465141:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147150.465179:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+22:2001:x1830967308227328:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12182us (12517us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147150.465187:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3786 00002000:00100000:1.0:1746147150.465192:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff88009c30b100 x1830967308227328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.465201:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30b100 with x1830967308227328 ext(2097152->4194303) 00002000:00010000:1.0:1746147150.465204:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c30b100 00010000:00010000:0.0:1746147150.465229:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.465237:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310768896:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.465260:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.465681:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2001:x1830967308227584:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12556us (12970us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.465688:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3787 00002000:00100000:3.0:1746147150.465698:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff88009c30ad80 x1830967308227584/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.465704:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c30ad80 with x1830967308227584 ext(3145728->4194303) 00010000:00010000:3.0:1746147150.465709:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 39 pid: 1398 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.465719:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 39 pid: 1398 timeout: 788 lvb_type: 1 00002000:00010000:3.0:1746147150.465725:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c30ad80 00000100:00100000:2.0:1746147150.466334:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310768640:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.466476:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310768768:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147150.466497:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x3139939425057b9a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c32 expref: 36 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.466506:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x3139939425057b9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c32 expref: 36 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.466527:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212800, rc 0) 00000100:00100000:3.0:1746147150.466554:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308228352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1672us (1726us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147150.466559:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15118 00000100:00100000:0.0:1746147150.469219:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.469254:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.469284:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.469331:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228480 00000100:00100000:2.0:1746147150.469340:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228480 00000100:00100000:3.0:1746147150.469356:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228608 00000100:00100000:3.0:1746147150.469361:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228608 00000100:00100000:2.0:1746147150.469380:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228736 00000100:00100000:2.0:1746147150.469381:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228736 00000100:00100000:3.0:1746147150.469391:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15119 00000100:00100000:3.0:1746147150.469399:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+39:32641:x1830967308228480:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147150.469403:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15120 00000100:00100000:2.0:1746147150.469407:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308228608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.469418:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.469418:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.469437:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c39 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.469437:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c800/0x3139939425057ba8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c40 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.469458:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.469462:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3436544->3633151] (req 3436544->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 54 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.469467:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147150.469471:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.469484:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769024:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147150.469495:0:12201:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3436544->3633151] (req 3436544->3633151) gid 0 flags: 0x60000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 54 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.469505:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.469515:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f213000, rc 0) 00000100:00100000:3.0:1746147150.469535:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:90095e6f-8cef-455a-9171-4caf9b613254+40:32641:x1830967308228480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.469540:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15119 00000100:00100000:3.0:1746147150.469553:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15121 00000100:00100000:2.0:1746147150.469555:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.469558:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2002:x1830967308228736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.469564:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.469569:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x3139939425057baf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c47 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.469579:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.469586:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x3139939425057baf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c47 expref: 55 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147150.469591:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310768896:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.469593:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x3139939425057baf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c47 expref: 55 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.469601:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c4400, rc 0) 00010000:00010000:2.0:1746147150.469611:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3436544->3633151] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 54 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.469614:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2002:x1830967308228736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 56us (331us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147150.469618:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5c00, rc 0) 00000100:00100000:3.0:1746147150.469619:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15121 00000100:00100000:2.0:1746147150.469631:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32649:x1830967308227968:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4757us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.469636:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15117 00000100:00100000:0.0:1746147150.470174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.470241:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228864 00000100:00100000:2.0:1746147150.470244:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228864 00010000:00010000:2.0:1746147150.470261:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.470280:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6707 00000100:00100000:2.0:1746147150.470285:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2003:x1830967308228864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.470294:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.470312:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.470322:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.470338:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x3139939425057ae4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4919295) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc2 expref: 53 pid: 1853 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.470362:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.470392:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967308228864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 106us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.470398:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6707 00000100:00100000:2.0:1746147150.470910:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769024:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147150.470926:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c800/0x3139939425057ba8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c40 expref: 36 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.470935:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c800/0x3139939425057ba8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c40 expref: 36 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.470943:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:2.0:1746147150.470963:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308228608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1555us (1709us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.470969:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15120 00000100:00100000:0.0:1746147150.471330:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.471394:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308228992 00000100:00100000:2.0:1746147150.471397:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308228992 00010000:00010000:2.0:1746147150.471411:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.471543:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6708 00000100:00100000:2.0:1746147150.471549:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+40:2000:x1830967308228992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.471556:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.471565:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.471575:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.471587:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64b200/0x3139939425057b3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bf3 expref: 40 pid: 1398 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.471598:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.471599:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.471606:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 51 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.471614:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 51 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.471634:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 51 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.471644:0:7227:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 51 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.471656:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310769280:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.471924:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.471976:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.472053:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308229120 00000100:00100000:2.0:1746147150.472056:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308229120 00000100:00100000:2.0:1746147150.472073:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15122 00000100:00100000:2.0:1746147150.472078:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:32647:x1830967308229120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.472121:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.472131:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c4e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.472145:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.472146:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.472150:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 53 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.472159:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [4915200->5242879] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 53 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.472166:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:2.0:1746147150.472185:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:32647:x1830967308229120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.472190:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15122 00000100:00100000:2.0:1746147150.472750:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310769280:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.472761:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.472931:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308228992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1380us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.472939:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6708 00000100:00100000:0.0:1746147150.473770:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.473810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.473845:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308229504 00000100:00100000:3.0:1746147150.473850:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308229504 00002000:00100000:3.0:1746147150.473882:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (2084864->2088959) req@ffff880096cf8a80 x1830967308229504/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147150.473885:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308229632 00000100:00100000:1.0:1746147150.473889:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308229632 00002000:00100000:3.0:1746147150.473891:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8a80 with x1830967308229504 ext(2084864->2088959) 00002000:00010000:3.0:1746147150.473895:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf8a80 00002000:00100000:1.0:1746147150.473907:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3436544->3440639) req@ffff880096cf9f80 x1830967308229632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.473915:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9f80 with x1830967308229632 ext(3436544->3440639) 00010000:00010000:1.0:1746147150.473921:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.473925:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3789 00000100:00100000:3.0:1746147150.473931:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308229504:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:1.0:1746147150.473932:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.473939:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9f80 00000100:00100000:1.0:1746147150.473953:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1192 00000100:00100000:1.0:1746147150.473959:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967308229632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147150.474043:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967308229632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 84us (232us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147150.474052:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1192 00002000:00100000:1.0:1746147150.474058:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (3436544->3440639) req@ffff880096cf9f80 x1830967308229632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.474065:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9f80 with x1830967308229632 ext(3436544->3440639) 00010000:00010000:1.0:1746147150.474069:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.474077:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.474083:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9f80 00000100:00100000:3.0:1746147150.474109:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308229504:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 177us (338us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147150.474115:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3789 00002000:00100000:3.0:1746147150.474121:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (2084864->2088959) req@ffff880096cf8a80 x1830967308229504/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.474129:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8a80 with x1830967308229504 ext(2084864->2088959) 00002000:00010000:3.0:1746147150.474131:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf8a80 00000100:00100000:0.0:1746147150.476698:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.476754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.476842:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308229888 00000100:00100000:3.0:1746147150.476851:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308229888 00002000:00100000:3.0:1746147150.476893:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3629056->3633151) req@ffff880096cf9500 x1830967308229888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147150.476894:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308230144 00000100:00100000:1.0:1746147150.476898:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308230144 00002000:00100000:3.0:1746147150.476903:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9500 with x1830967308229888 ext(3629056->3633151) 00010000:00010000:3.0:1746147150.476911:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.476930:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.476938:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9500 00000100:00100000:1.0:1746147150.476951:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5560 00000100:00100000:1.0:1746147150.476959:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+27:32643:x1830967308230144:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147150.476968:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1193 00000100:00100000:3.0:1746147150.476974:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967308229888:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.477132:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967308229888:12345-192.168.204.25@tcp:3:cat.0 Request processed in 157us (442us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147150.477138:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1193 00002000:00100000:3.0:1746147150.477144:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3629056->3633151) req@ffff880096cf9500 x1830967308229888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.477152:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9500 with x1830967308229888 ext(3629056->3633151) 00010000:00010000:3.0:1746147150.477156:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.477166:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.477171:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9500 00000100:00100000:1.0:1746147150.477388:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:32643:x1830967308230144:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 430us (633us total) trans 8589936138 rc 0/0 00000100:00100000:1.0:1746147150.477394:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5560 00000100:00100000:0.0:1746147150.480034:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.480139:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308230400 00000100:00100000:3.0:1746147150.480147:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308230400 00002000:00100000:3.0:1746147150.480193:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3436544->3633151) req@ffff880096cf9180 x1830967308230400/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.480203:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9180 with x1830967308230400 ext(3436544->3633151) 00010000:00010000:3.0:1746147150.480213:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.480228:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 53 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.480235:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9180 00000100:00100000:3.0:1746147150.480256:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1194 00000100:00100000:3.0:1746147150.480263:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2000:x1830967308230400:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147150.484986:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2000:x1830967308230400:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4711us (4950us total) trans 17179874296 rc 0/0 00000100:00100000:3.0:1746147150.484998:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1194 00002000:00100000:3.0:1746147150.485010:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3436544->3633151) req@ffff880096cf9180 x1830967308230400/t17179874296(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.485019:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9180 with x1830967308230400 ext(3436544->3633151) 00010000:00010000:3.0:1746147150.485030:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 55 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.485045:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 55 pid: 1136 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.485052:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9180 00000100:00100000:0.0:1746147150.486885:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.486963:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308230528 00000100:00100000:2.0:1746147150.486973:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308230528 00010000:00010000:2.0:1746147150.487008:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 55 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.487258:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6709 00000100:00100000:2.0:1746147150.487266:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+55:2003:x1830967308230528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.487280:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.487298:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 55 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.487311:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 55 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.487335:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5c00/0x3139939425057b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [3436544->18446744073709551615] (req 3436544->3633151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c2b expref: 55 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.487371:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.487373:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.487381:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.487391:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.487404:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.487406:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.487409:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 54 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.487414:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 54 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.487443:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 54 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.487455:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310769408:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.487543:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.487550:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310769536:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.487569:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.488873:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310769408:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147150.488883:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310769536:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.488900:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.488933:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2003:x1830967308230528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1668us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.488941:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6709 00000100:00100000:0.0:1746147150.489150:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.489616:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308230656 00000100:00100000:2.0:1746147150.489623:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308230656 00000100:00100000:2.0:1746147150.489661:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15123 00000100:00100000:2.0:1746147150.489668:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308230656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.489684:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.489710:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x3139939425057bbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c55 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.489754:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769664:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147150.489837:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.491363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.491457:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769664:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147150.491486:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x3139939425057bbd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c55 expref: 36 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.491501:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x3139939425057bbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c55 expref: 36 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147150.491567:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308230912 00000100:00100000:3.0:1746147150.491573:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308230912 00002000:00100000:3.0:1746147150.491608:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880096cf9880 x1830967308230912/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.491624:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9880 with x1830967308230912 ext(3145728->4194303) 00002000:00010000:3.0:1746147150.491629:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9880 00000100:00100000:3.0:1746147150.491660:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3790 00000100:00100000:3.0:1746147150.491665:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308230912:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147150.491698:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d000, rc 0) 00000100:00100000:2.0:1746147150.491743:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967308230656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2075us (2594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.491750:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15123 00000100:00100000:2.0:1746147150.493221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.493280:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308231168 00000100:00100000:1.0:1746147150.493286:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308231168 00002000:00100000:1.0:1746147150.493319:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff88012f3cc380 x1830967308231168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.493328:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc380 with x1830967308231168 ext(4915200->4919295) 00002000:00010000:1.0:1746147150.493333:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc380 00000100:00100000:1.0:1746147150.493363:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3791 00000100:00100000:1.0:1746147150.493370:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2001:x1830967308231168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147150.493460:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2001:x1830967308231168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 90us (244us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147150.493466:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3791 00002000:00100000:1.0:1746147150.493471:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8f:0x0] (4915200->4919295) req@ffff88012f3cc380 x1830967308231168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.493477:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc380 with x1830967308231168 ext(4915200->4919295) 00002000:00010000:1.0:1746147150.493479:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc380 00000100:00100000:3.0:1746147150.496590:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2000:x1830967308230912:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 4909us (5216us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.496603:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3790 00002000:00100000:3.0:1746147150.496616:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff880096cf9880 x1830967308230912/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.496625:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9880 with x1830967308230912 ext(3145728->4194303) 00002000:00010000:3.0:1746147150.496631:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9880 00000100:00100000:0.0:1746147150.503664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.503750:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308231424 00000100:00100000:3.0:1746147150.503759:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308231424 00002000:00100000:3.0:1746147150.503998:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880096cfb800 x1830967308231424/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.504009:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb800 with x1830967308231424 ext(4194304->4919295) 00002000:00010000:3.0:1746147150.504016:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cfb800 00000100:00100000:3.0:1746147150.504054:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3792 00000100:00100000:3.0:1746147150.504062:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2003:x1830967308231424:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.507846:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+39:2003:x1830967308231424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 3772us (4178us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746147150.507859:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3792 00002000:00100000:3.0:1746147150.507871:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880096cfb800 x1830967308231424/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.507881:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb800 with x1830967308231424 ext(4194304->4919295) 00002000:00010000:3.0:1746147150.507888:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cfb800 00000100:00100000:0.0:1746147150.513486:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.513587:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308231680 00000100:00100000:1.0:1746147150.513598:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308231680 00000100:00100000:1.0:1746147150.513859:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5561 00000100:00100000:1.0:1746147150.513868:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+28:32641:x1830967308231680:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147150.514078:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+29:32641:x1830967308231680:12345-192.168.204.25@tcp:35:cat.0 Request processed in 210us (607us total) trans 8589936139 rc 0/0 00000100:00100000:1.0:1746147150.514112:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5561 00000100:00100000:0.0:1746147150.599894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.600045:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308231936 00000100:00100000:2.0:1746147150.600053:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308231936 00000100:00100000:2.0:1746147150.600136:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15410 00000100:00100000:2.0:1746147150.600144:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+29:32655:x1830967308231936:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147150.600172:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.600190:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425057bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c5c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.600255:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600266:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600275:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600285:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600290:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600294:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600371:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425057bd9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600379:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425057bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600384:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425057bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147150.600392:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147150.600461:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600467:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600472:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600476:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600480:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.600483:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600489:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600497:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147150.600500:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.600503:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600508:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425057bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600531:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600537:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600541:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600545:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0dc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.600547:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600554:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600560:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094f11000) 00010000:00010000:2.0:1746147150.600562:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.600564:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600568:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057bd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.600599:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425057bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c5c expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.600609:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425057bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c5c expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.600614:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.600615:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147150.600617:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c000, rc 0) 00000100:00100000:2.0:1746147150.600669:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+31:32655:x1830967308231936:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 525us (783us total) trans 8589936140 rc 0/0 00000100:00100000:2.0:1746147150.600675:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15410 00000100:00100000:0.0:1746147150.604994:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.605118:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232064 00000100:00100000:2.0:1746147150.605127:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232064 00000100:00100000:2.0:1746147150.605184:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 834 00000100:00100000:2.0:1746147150.605191:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308232064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.605203:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.605223:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c000/0x3139939425057bd9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c5c expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.605238:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.605241:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.605299:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90095e6f-8cef-455a-9171-4caf9b613254+30:2000:x1830967308232064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 108us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.605306:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 834 00000100:00100000:0.0:1746147150.621739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.621878:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232192 00000100:00100000:2.0:1746147150.621888:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232192 00000100:00100000:2.0:1746147150.622125:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15124 00000100:00100000:2.0:1746147150.622134:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967308232192:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.622153:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.622268:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x3139939425057be7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c63 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.622325:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769792:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147150.622864:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.626766:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769792:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147150.626817:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x3139939425057be7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c63 expref: 36 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.626833:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c000/0x3139939425057be7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c63 expref: 36 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.626849:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c000, rc 0) 00000100:00100000:2.0:1746147150.627240:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967308232192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5104us (5508us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147150.627249:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15124 00000100:00100000:2.0:1746147150.633429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.633530:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232320 00000100:00100000:0.0:1746147150.633542:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232320 00000100:00100000:0.0:1746147150.633621:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15125 00000100:00100000:0.0:1746147150.633633:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:32660:x1830967308232320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.633656:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.633679:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c6a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.633715:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.633724:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147150.633726:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147150.633729:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.633772:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.633808:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 21 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.633823:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769920:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.633954:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.638001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.638165:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a499b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310769920:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.638200:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.638219:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43200, rc 0) 00000100:00100000:2.0:1746147150.638274:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32660:x1830967308232320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4642us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.638283:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15125 00000100:00100000:3.0:1746147150.638850:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232448 00000100:00100000:3.0:1746147150.638859:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232448 00002000:00100000:3.0:1746147150.638900:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1314816->2088959) req@ffff8800a4998e00 x1830967308232448/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.638910:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998e00 with x1830967308232448 ext(1314816->2088959) 00010000:00010000:3.0:1746147150.638916:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 22 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.638929:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 22 pid: 17600 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.638935:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4998e00 00000100:00100000:3.0:1746147150.638971:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1195 00000100:00100000:3.0:1746147150.638980:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+22:2000:x1830967308232448:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:2.0:1746147150.650563:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147150.650867:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967308232448:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11879us (12868us total) trans 21474841550 rc 0/0 00000100:00100000:3.0:1746147150.650879:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1195 00002000:00100000:3.0:1746147150.650891:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1314816->2088959) req@ffff8800a4998e00 x1830967308232448/t21474841550(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.650901:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998e00 with x1830967308232448 ext(1314816->2088959) 00010000:00010000:3.0:1746147150.650911:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.650927:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.650935:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4998e00 00000100:00100000:2.0:1746147150.655272:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.655335:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232576 00000100:00100000:0.0:1746147150.655343:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232576 00010000:00010000:0.0:1746147150.655381:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.655419:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6710 00000100:00100000:0.0:1746147150.655427:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967308232576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.655444:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.655467:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.655480:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.655504:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057b8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->2088959) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c24 expref: 24 pid: 17600 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.655535:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.655537:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.655545:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.655554:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.655589:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.655601:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770048:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147150.655811:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.657829:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770048:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.657854:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.657888:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+23:2000:x1830967308232576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2461us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.657898:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6710 00000100:00100000:0.0:1746147150.660763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.660908:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232832 00000100:00100000:3.0:1746147150.660918:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232832 00002000:00100000:3.0:1746147150.660975:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4998000 x1830967308232832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.660987:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998000 with x1830967308232832 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.660993:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4998000 00000100:00100000:3.0:1746147150.661475:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3793 00000100:00100000:3.0:1746147150.661483:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308232832:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147150.676773:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967308232832:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15274us (16010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.676799:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3793 00002000:00100000:3.0:1746147150.676814:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4998000 x1830967308232832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.676824:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998000 with x1830967308232832 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.676831:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4998000 00000100:00100000:2.0:1746147150.684995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.685174:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308232960 00000100:00100000:0.0:1746147150.685184:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308232960 00000100:00100000:0.0:1746147150.685955:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15126 00000100:00100000:0.0:1746147150.685966:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32657:x1830967308232960:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147150.685985:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.686005:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c71 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.686037:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.686044:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.686046:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.686049:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.686109:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.686121:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 37 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.686134:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770176:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.686236:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.689677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.689718:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.689755:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308233344 00000100:00100000:0.0:1746147150.689761:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308233344 00000100:00100000:3.0:1746147150.689766:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308233216 00000100:00100000:3.0:1746147150.689776:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308233216 00002000:00100000:0.0:1746147150.689819:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a4998380 x1830967308233344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147150.689821:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00002000:00100000:0.0:1746147150.689829:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998380 with x1830967308233344 ext(3145728->4194303) 00002000:00010000:0.0:1746147150.689834:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998380 00000100:00100000:2.0:1746147150.689911:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a499ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770176:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.689934:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.689948:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1c00, rc 0) 00000100:00100000:2.0:1746147150.689990:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:32657:x1830967308232960:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4026us (5006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.689999:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15126 00000100:00100000:0.0:1746147150.690183:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3794 00000100:00100000:0.0:1746147150.690190:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2003:x1830967308233344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.690216:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6711 00000100:00100000:3.0:1746147150.690224:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308233216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.690237:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.690257:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 37 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.690269:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 37 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.690292:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425057bee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c6a expref: 37 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.690312:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.690314:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.690321:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.690330:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.690367:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.690381:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770304:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.690467:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.695546:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770304:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147150.695570:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147150.695628:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308233216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5403us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.695639:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6711 00000100:00100000:0.0:1746147150.697158:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.697240:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308233600 00000100:00100000:2.0:1746147150.697258:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308233600 00002000:00100000:2.0:1746147150.697303:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1957888->1961983) req@ffff8800a4998700 x1830967308233600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.697312:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998700 with x1830967308233600 ext(1957888->1961983) 00002000:00010000:2.0:1746147150.697317:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4998700 00000100:00100000:2.0:1746147150.697350:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3795 00000100:00100000:2.0:1746147150.697357:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308233600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.697470:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967308233600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 113us (319us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147150.697475:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3795 00002000:00100000:2.0:1746147150.697480:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1957888->1961983) req@ffff8800a4998700 x1830967308233600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.697487:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998700 with x1830967308233600 ext(1957888->1961983) 00002000:00010000:2.0:1746147150.697489:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4998700 00000100:00100000:1.0:1746147150.697590:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2003:x1830967308233344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7400us (7870us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.697596:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3794 00002000:00100000:1.0:1746147150.697600:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (3145728->4194303) req@ffff8800a4998380 x1830967308233344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.697612:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4998380 with x1830967308233344 ext(3145728->4194303) 00002000:00010000:1.0:1746147150.697615:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4998380 00000100:00100000:0.0:1746147150.702946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.703043:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308233728 00000100:00100000:2.0:1746147150.703054:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308233728 00000100:00100000:0.0:1746147150.703352:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.703437:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308233984 00000100:00100000:1.0:1746147150.703444:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308233984 00002000:00100000:1.0:1746147150.703487:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4915199) req@ffff8800a499bb80 x1830967308233984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.703496:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499bb80 with x1830967308233984 ext(4194304->4915199) 00002000:00010000:1.0:1746147150.703502:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499bb80 00000100:00100000:1.0:1746147150.703522:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3796 00000100:00100000:2.0:1746147150.703595:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15127 00000100:00100000:2.0:1746147150.703604:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:32657:x1830967308233728:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147150.703623:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.703638:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c78 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.703664:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.703672:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 37 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.703678:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.703679:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.703682:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->1462271] (req 1048576->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.703705:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 37 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.703715:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 37 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.703726:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770432:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.703804:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.703811:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 22 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.703818:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.703832:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147150.704011:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2002:x1830967308233984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.707843:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770432:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.709948:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.710029:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308234112 00000100:00100000:3.0:1746147150.710043:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308234112 00010000:00010000:3.0:1746147150.710083:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 38 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.710152:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6712 00000100:00100000:3.0:1746147150.710160:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308234112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.710174:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147150.710181:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770560:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.710189:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 38 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.710197:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 38 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.710215:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fc00/0x3139939425057a4a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b44 expref: 38 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.710218:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [1048576->1462271] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.710229:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d800, rc 0) 00010000:00010000:3.0:1746147150.710235:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.710271:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:32657:x1830967308233728:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6669us (7345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.710274:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308234112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.710278:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15127 00000100:00100000:3.0:1746147150.710279:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6712 00000100:00100000:1.0:1746147150.710379:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2002:x1830967308233984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6847us (7025us total) trans 0 rc 720896/720896 00000100:00100000:1.0:1746147150.710389:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3796 00002000:00100000:1.0:1746147150.710399:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4915199) req@ffff8800a499bb80 x1830967308233984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.710406:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499bb80 with x1830967308233984 ext(4194304->4915199) 00002000:00010000:1.0:1746147150.710411:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a499bb80 00000100:00100000:0.0:1746147150.713268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.713478:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308234240 00000100:00100000:3.0:1746147150.713490:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308234240 00010000:00010000:3.0:1746147150.713526:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.713564:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6713 00000100:00100000:3.0:1746147150.713570:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308234240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.713581:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.713597:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.713608:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.713626:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d800/0x31399394250579f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b1a expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.713640:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.713641:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.713647:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.713654:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.713682:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.713692:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770688:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.713774:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.715368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.715525:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308234368 00000100:00100000:0.0:1746147150.715534:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308234368 00000001:00080000:2.0:1746147150.715539:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874296 is committed 00000001:00080000:2.0:1746147150.715554:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874294 is committed 00000001:00080000:2.0:1746147150.715578:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874284 is committed 00000100:00100000:0.0:1746147150.715586:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15128 00000100:00100000:0.0:1746147150.715593:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+23:32655:x1830967308234368:12345-192.168.204.25@tcp:101:multiop.0 00000001:00080000:2.0:1746147150.715595:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874281 is committed 00010000:00010000:0.0:1746147150.715612:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.715630:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c7f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.715656:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.715664:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147150.715666:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147150.715669:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1228800->1994751] (req 1228800->1994751) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.715879:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.715898:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 35 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.715910:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a499b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770816:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.715986:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.716011:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770688:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.716027:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.716056:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308234240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2486us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.716065:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6713 00000100:00100000:0.0:1746147150.719875:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.720005:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308234624 00000100:00100000:1.0:1746147150.720012:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308234624 00002000:00100000:1.0:1746147150.720050:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1458176->1462271) req@ffff8800a499ad80 x1830967308234624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.720060:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499ad80 with x1830967308234624 ext(1458176->1462271) 00010000:00010000:1.0:1746147150.720068:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.720082:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.720120:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a499ad80 00000100:00100000:1.0:1746147150.720147:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1196 00000100:00100000:1.0:1746147150.720154:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308234624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.720243:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a499b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310770816:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.720275:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1228800->1994751] (req 1228800->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.720277:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308234624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 123us (409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147150.720284:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1196 00002000:00100000:1.0:1746147150.720288:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1458176->1462271) req@ffff8800a499ad80 x1830967308234624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.720296:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499ad80 with x1830967308234624 ext(1458176->1462271) 00010000:00010000:2.0:1746147150.720297:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb6200, rc 0) 00010000:00010000:1.0:1746147150.720300:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.720310:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.720315:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a499ad80 00000100:00100000:2.0:1746147150.720343:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+23:32655:x1830967308234368:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4750us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.720350:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15128 00000100:00100000:0.0:1746147150.727381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.727489:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308234880 00000100:00100000:2.0:1746147150.727499:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308234880 00002000:00100000:2.0:1746147150.727546:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1462271) req@ffff8800a4999180 x1830967308234880/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.727556:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999180 with x1830967308234880 ext(1048576->1462271) 00010000:00010000:2.0:1746147150.727565:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.727580:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.727587:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4999180 00000100:00100000:2.0:1746147150.729480:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1197 00000100:00100000:2.0:1746147150.729502:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967308234880:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147150.732647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.732800:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308235136 00000100:00100000:3.0:1746147150.732809:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308235136 00000100:00100000:3.0:1746147150.732869:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15411 00000100:00100000:3.0:1746147150.732877:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+30:32664:x1830967308235136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.732903:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.732923:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425057c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c86 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.732996:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733009:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733019:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733029:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733034:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733039:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733198:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x3139939425057c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733208:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x3139939425057c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733218:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x3139939425057c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147150.733226:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147150.733281:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733285:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733289:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733292:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733296:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2ba00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147150.733299:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733303:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733311:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147150.733313:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147150.733316:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733319:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733338:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733346:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733350:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733354:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147150.733356:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733360:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733408:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800930f4500) 00010000:00010000:3.0:1746147150.733410:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147150.733413:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733417:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425057c18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.733454:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425057c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c86 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.733465:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x3139939425057c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c86 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.733471:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.733472:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147150.733474:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b000, rc 0) 00000100:00100000:3.0:1746147150.733773:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90095e6f-8cef-455a-9171-4caf9b613254+32:32664:x1830967308235136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 895us (1136us total) trans 8589936141 rc 0/0 00000100:00100000:3.0:1746147150.733780:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15411 00000100:00100000:0.0:1746147150.734214:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308234880:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4721us (6842us total) trans 21474841551 rc 0/0 00000100:00100000:0.0:1746147150.734226:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1197 00002000:00100000:0.0:1746147150.734235:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->1462271) req@ffff8800a4999180 x1830967308234880/t21474841551(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.734245:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4999180 with x1830967308234880 ext(1048576->1462271) 00010000:00010000:0.0:1746147150.734253:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.734267:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746147150.734278:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4999180 00000100:00100000:0.0:1746147150.736977:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.737264:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308235264 00000100:00100000:2.0:1746147150.737277:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308235264 00000100:00100000:2.0:1746147150.737344:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 835 00000100:00100000:2.0:1746147150.737355:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+32:2002:x1830967308235264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.737370:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.737392:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b000/0x3139939425057c1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c86 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.737420:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.737425:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.737473:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+31:2002:x1830967308235264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 121us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.737479:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 835 00000100:00100000:0.0:1746147150.737668:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.738252:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.738291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.738368:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308235520 00000100:00100000:3.0:1746147150.738376:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308235520 00000100:00100000:2.0:1746147150.738452:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308235392 00000100:00100000:2.0:1746147150.738456:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308235392 00010000:00010000:2.0:1746147150.738478:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.738511:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6714 00000100:00100000:2.0:1746147150.738518:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967308235392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.738529:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147150.738545:0:8909:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147149 -> 1746147150 00002000:00010000:2.0:1746147150.738548:0:8909:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147149 -> 1746147150 00010000:00010000:2.0:1746147150.738554:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.738565:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.738584:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d800/0x3139939425057bfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c78 expref: 38 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.738597:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.738599:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.738606:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.738619:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.738652:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.738665:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770944:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.738702:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308235648 00000100:00100000:3.0:1746147150.738707:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308235648 00000100:00100000:3.0:1746147150.738762:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15129 00000100:00100000:3.0:1746147150.738769:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308235520:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147150.738769:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15130 00000100:00100000:0.0:1746147150.738778:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308235648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147150.738797:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.738797:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.738810:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425057c34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c8d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.738811:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x3139939425057c2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c94 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.738847:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310771072:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147150.738847:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310771200:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147150.738935:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.738962:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.739009:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7600 going to sleep for 11 seconds 00002000:00010000:1.0:1746147150.741934:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746147149 -> 1746147150 00000100:00100000:1.0:1746147150.741966:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310771200:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147150.742001:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x3139939425057c2d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c94 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.742015:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212800/0x3139939425057c2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c94 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.742042:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212800, rc 0) 00000100:00100000:1.0:1746147150.742133:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308235648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3355us (3839us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147150.742142:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15130 00000100:00100000:2.0:1746147150.742315:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310770944:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.742327:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.742365:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308235392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3847us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.742373:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6714 00000100:00100000:0.0:1746147150.743677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.744130:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308235904 00000100:00100000:2.0:1746147150.744138:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308235904 00000100:00100000:3.0:1746147150.744163:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310771072:192.168.204.25@tcp:106: 00002000:00100000:2.0:1746147150.744182:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1228800->1232895) req@ffff8800a499b100 x1830967308235904/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.744192:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499b100 with x1830967308235904 ext(1228800->1232895) 00010000:00010000:3.0:1746147150.744196:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425057c34 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c8d expref: 25 pid: 1854 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746147150.744197:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a499b100 00010000:00010000:3.0:1746147150.744209:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425057c34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c8d expref: 25 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147150.744220:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3797 00010000:00010000:3.0:1746147150.744230:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:3.0:1746147150.744278:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308235520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5508us (6026us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147150.744286:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15129 00000100:00100000:2.0:1746147150.744595:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308235904:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147150.744736:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+23:2003:x1830967308235904:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 509us (1063us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147150.744747:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3797 00002000:00100000:2.0:1746147150.744752:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1228800->1232895) req@ffff8800a499b100 x1830967308235904/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.744759:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a499b100 with x1830967308235904 ext(1228800->1232895) 00002000:00010000:2.0:1746147150.744763:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a499b100 00000100:00100000:0.0:1746147150.752172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.752217:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.752302:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308236160 00000100:00100000:2.0:1746147150.752311:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308236160 00000100:00100000:3.0:1746147150.752351:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308236032 00000100:00100000:2.0:1746147150.752355:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15131 00000100:00100000:3.0:1746147150.752356:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308236032 00000100:00100000:2.0:1746147150.752361:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+23:32664:x1830967308236160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.752377:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147150.752391:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15412 00010000:00010000:2.0:1746147150.752392:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ca2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.752396:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:32666:x1830967308236032:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.752410:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.752417:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.752420:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78c9b expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147150.752445:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147150.752463:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752473:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752483:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752494:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752498:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752502:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752556:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752565:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 46 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.752570:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.752598:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 46 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.752608:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 46 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.752618:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310771328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.752693:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147150.753617:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.753618:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147150.753623:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.753642:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.753650:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 36 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.753663:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310771456:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.753845:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.758010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.758160:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308236416 00000100:00100000:2.0:1746147150.758173:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308236416 00002000:00100000:2.0:1746147150.758213:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1990656->1994751) req@ffff8801323d6680 x1830967308236416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.758224:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6680 with x1830967308236416 ext(1990656->1994751) 00002000:00010000:2.0:1746147150.758229:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d6680 00000100:00100000:2.0:1746147150.758703:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3798 00000100:00100000:2.0:1746147150.758711:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308236416:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147150.759045:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967310771456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.759076:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.759125:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:2.0:1746147150.759215:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308236416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 504us (1214us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147150.759222:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3798 00002000:00100000:2.0:1746147150.759228:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (1990656->1994751) req@ffff8801323d6680 x1830967308236416/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.759234:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d6680 with x1830967308236416 ext(1990656->1994751) 00002000:00010000:2.0:1746147150.759237:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d6680 00000100:00100000:1.0:1746147150.759458:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.759485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.759541:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310771328:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.759557:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147150.759572:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308236544 00000100:00100000:2.0:1746147150.759575:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308236544 00002000:00100000:2.0:1746147150.759589:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1957888->2097151) req@ffff88011e4c7480 x1830967308236544/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147150.759596:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c7480 with x1830967308236544 ext(1957888->2097151) 00010000:00010000:2.0:1746147150.759603:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 37 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.759612:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 37 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746147150.759619:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e4c7480 00000100:00100000:2.0:1746147150.759630:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1198 00000100:00100000:2.0:1746147150.759635:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967308236544:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147150.759825:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+24:32664:x1830967308236160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7462us (7604us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.759834:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15131 00000100:00100000:0.0:1746147150.760014:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308236800 00000100:00100000:0.0:1746147150.760020:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308236800 00000100:00100000:0.0:1746147150.760167:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5562 00000100:00100000:0.0:1746147150.760174:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:16261:x1830967308236800:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147150.761700:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:16261:x1830967308236800:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 1521us (2208us total) trans 8589936142 rc 0/0 00000100:00100000:2.0:1746147150.761708:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5562 00000100:00100000:0.0:1746147150.763057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.763119:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308236928 00000100:00100000:2.0:1746147150.763127:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308236928 00010000:00010000:2.0:1746147150.763156:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.763191:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6715 00000100:00100000:2.0:1746147150.763197:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967308236928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.763207:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.763212:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.763260:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.763276:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e000/0x3139939425057af2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bc9 expref: 48 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.763288:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.763293:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.763302:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.763306:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.763330:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.763364:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967308236928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 167us (313us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147150.763364:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147150.763369:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6715 00010000:00010000:0.0:1746147150.763372:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147150.763424:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:0.0:1746147150.763430:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147150.763445:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.763457:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.763476:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.763483:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765320:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765333:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765344:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2ae00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147150.765349:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765357:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765374:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147150.765376:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147150.765380:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765385:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425057c49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765402:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765406:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765410:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765414:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147150.765416:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765420:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765426:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800930f4100) 00010000:00010000:0.0:1746147150.765428:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147150.765430:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765434:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057c50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147150.765477:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057c42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.765488:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.765494:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147150.765496:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147150.765498:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b800, rc 0) 00000100:00100000:3.0:1746147150.765576:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308236544:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5938us (6116us total) trans 21474841552 rc 0/0 00000100:00100000:3.0:1746147150.765588:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1198 00002000:00100000:3.0:1746147150.765599:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8c:0x0] (1957888->2097151) req@ffff88011e4c7480 x1830967308236544/t21474841552(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.765608:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e4c7480 with x1830967308236544 ext(1957888->2097151) 00010000:00010000:3.0:1746147150.765617:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 39 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.765634:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 39 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746147150.765641:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e4c7480 00000100:00100000:3.0:1746147150.765689:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32666:x1830967308236032:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 13292us (13524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.765695:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15412 00000100:00100000:3.0:1746147150.765764:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.765893:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237184 00000100:00100000:3.0:1746147150.765900:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237184 00000100:00100000:3.0:1746147150.765931:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5563 00000100:00100000:3.0:1746147150.765938:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+31:32655:x1830967308237184:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147150.766116:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+32:32655:x1830967308237184:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 178us (351us total) trans 8589936143 rc 0/0 00000100:00100000:3.0:1746147150.766122:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5563 00000100:00100000:0.0:1746147150.769644:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.769700:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.769901:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237440 00000100:00100000:3.0:1746147150.769909:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237440 00000100:00100000:3.0:1746147150.769956:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15132 00000100:00100000:3.0:1746147150.769964:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308237440:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.769981:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.769996:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ca9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.770016:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.770017:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.770025:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147150.770205:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237312 00000100:00100000:2.0:1746147150.770209:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237312 00010000:00010000:2.0:1746147150.770227:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 39 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.770256:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6716 00000100:00100000:2.0:1746147150.770261:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967308237312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.770271:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.770286:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 39 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.770305:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 39 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.770324:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425057bf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c71 expref: 39 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.770335:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.770337:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147150.770401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.770425:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.770445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147150.770551:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.770561:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b000, rc 0) 00010000:00010000:2.0:1746147150.770608:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.770615:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.770854:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237568 00000100:00100000:1.0:1746147150.770863:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237568 00000100:00100000:0.0:1746147150.770868:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.771155:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237824 00000100:00100000:3.0:1746147150.771159:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237824 00000100:00100000:3.0:1746147150.771179:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237696 00000100:00100000:3.0:1746147150.771181:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237696 00000100:00100000:3.0:1746147150.771197:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308237952 00000100:00100000:3.0:1746147150.771199:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308237952 00000100:00100000:3.0:1746147150.771213:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15133 00000100:00100000:3.0:1746147150.771219:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308237568:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.771227:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.771237:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cb0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.771247:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.771248:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.771252:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.771261:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.771267:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79bc00, rc 0) 00000100:00100000:3.0:1746147150.771306:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308237568:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 86us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.771312:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15133 00000100:00100000:3.0:1746147150.771326:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15134 00000100:00100000:3.0:1746147150.771330:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308237824:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.771336:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.771344:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cbe expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.771353:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.771354:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.771358:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.771366:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.771372:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79ac00, rc 0) 00000100:00100000:3.0:1746147150.771387:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308237824:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 56us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.771392:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15134 00000100:00100000:3.0:1746147150.771403:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15135 00000100:00100000:3.0:1746147150.771407:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308237696:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.771412:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.771418:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425057c73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cb7 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.771451:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310771584:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147150.771509:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.771529:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15136 00000100:00100000:3.0:1746147150.771534:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308237952:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.771540:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.771546:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cc5 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.771555:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.771556:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.771561:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.771569:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.771575:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00000100:00100000:3.0:1746147150.771588:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308237952:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 55us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.771593:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15136 00000100:00100000:3.0:1746147150.771614:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308237440:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1652us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.771619:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15132 00010000:00010000:3.0:1746147150.771755:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.771763:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310771712:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147150.771797:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.772797:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.772856:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308238080 00000100:00100000:3.0:1746147150.772861:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308238080 00000100:00100000:3.0:1746147150.772883:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15137 00000100:00100000:3.0:1746147150.772888:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308238080:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.772896:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.772904:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ccc expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.772915:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.772917:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.772922:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.772931:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.772938:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f400, rc 0) 00000100:00100000:3.0:1746147150.772959:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308238080:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.772964:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15137 00000100:00100000:2.0:1746147150.774229:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310771712:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147150.774244:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.774268:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967308237312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4007us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.774277:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6716 00000100:00100000:3.0:1746147150.774345:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310771584:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147150.774365:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425057c73 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb7 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.774376:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425057c73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb7 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.774393:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:3.0:1746147150.774411:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2000:x1830967308237696:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3003us (3965us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147150.774416:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15135 00000100:00100000:0.0:1746147150.780324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.780636:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308238336 00000100:00100000:3.0:1746147150.780770:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308238336 00000100:00100000:3.0:1746147150.780849:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15413 00000100:00100000:3.0:1746147150.780858:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:32666:x1830967308238336:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.780879:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.780901:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e600/0x3139939425057c88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cd3 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.781007:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.781021:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.781028:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.781067:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.781078:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 15 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.781125:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310771840:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.781225:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.783888:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310771840:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.783920:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147150.784770:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.784809:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.784848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.784895:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308238592 00000100:00100000:1.0:1746147150.784901:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308238592 00002000:00100000:1.0:1746147150.784936:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801323d5f80 x1830967308238592/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.784944:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5f80 with x1830967308238592 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.784948:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d5f80 00000100:00100000:1.0:1746147150.784963:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308238720 00000100:00100000:1.0:1746147150.784965:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308238720 00002000:00100000:1.0:1746147150.784974:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801323d7800 x1830967308238720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 504/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.784981:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7800 with x1830967308238720 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.784984:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7800 00000100:00100000:1.0:1746147150.784995:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3799 00000100:00100000:1.0:1746147150.785001:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308238592:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147150.785169:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3800 00000100:00100000:0.0:1746147150.785182:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308238720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147150.785668:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308238976 00000100:00100000:2.0:1746147150.785673:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308238976 00010000:00010000:2.0:1746147150.785691:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 16 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.785713:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6717 00000100:00100000:2.0:1746147150.785718:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308238976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.785726:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.785731:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 16 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.785742:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 16 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.785759:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b800/0x3139939425057c57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c9b expref: 16 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.785769:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.785774:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.785781:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.785801:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.785818:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147150.785831:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.785839:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147150.785842:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308238976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 124us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.785848:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6717 00000004:00200000:3.0:1746147150.785855:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147150.785955:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e600/0x3139939425057c88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.785985:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.785991:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.785994:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147150.785996:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504fa00, rc 0) 00000100:00100000:3.0:1746147150.786016:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32666:x1830967308238336:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5160us (5700us total) trans 8589936144 rc 0/0 00000100:00100000:3.0:1746147150.786022:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15413 00000100:00100000:0.0:1746147150.792515:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+26:2003:x1830967308238720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7324us (7691us total) trans 0 rc 282624/282624 00000100:00100000:0.0:1746147150.792532:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3800 00002000:00100000:0.0:1746147150.792545:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff8801323d7800 x1830967308238720/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 504/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 282624/282624 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.792555:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7800 with x1830967308238720 ext(1048576->2097151) 00002000:00010000:0.0:1746147150.792561:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7800 00000100:00100000:0.0:1746147150.795550:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.795691:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308239104 00000100:00100000:3.0:1746147150.795702:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308239104 00000100:00100000:3.0:1746147150.795749:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15414 00000100:00100000:3.0:1746147150.795757:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32666:x1830967308239104:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.795799:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.795821:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x3139939425057c9d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cda expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.795912:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.795927:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.795934:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.795965:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.795976:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 16 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.795989:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310771968:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.796673:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147150.796952:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+24:2003:x1830967308238592:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11941us (12179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.796964:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3799 00002000:00100000:1.0:1746147150.796975:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801323d5f80 x1830967308238592/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.796983:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5f80 with x1830967308238592 ext(1048576->2097151) 00002000:00010000:1.0:1746147150.796987:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d5f80 00000100:00100000:0.0:1746147150.798759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.798841:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308239232 00000100:00100000:1.0:1746147150.798852:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308239232 00010000:00010000:1.0:1746147150.798892:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 17 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746147150.798942:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6718 00000100:00100000:1.0:1746147150.798949:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308239232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147150.798961:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.798968:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 17 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.798979:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 17 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.799002:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147150.799007:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147150.799016:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147150.799027:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147150.799048:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.799126:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308239232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 177us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.799132:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6718 00010000:00010000:3.0:1746147150.799280:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057c8f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cd3 expref: 16 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.799310:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310771968:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.799329:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.799338:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.799344:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147150.799399:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:3.0:1746147150.799404:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147150.799422:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.799454:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x3139939425057c9d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cda expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.799578:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cda expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.799587:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.799589:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147150.799592:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e200, rc 0) 00000100:00100000:3.0:1746147150.799774:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32666:x1830967308239104:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4015us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.799794:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15414 00000100:00100000:0.0:1746147150.808576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.808710:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308239360 00000100:00100000:3.0:1746147150.808722:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308239360 00000100:00100000:3.0:1746147150.808856:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15138 00000100:00100000:3.0:1746147150.808865:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308239360:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.808885:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.808909:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425057cab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ce1 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.808969:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310772096:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147150.809108:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.811174:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310772096:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147150.811208:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425057cab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce1 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.811223:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f800/0x3139939425057cab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce1 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.811251:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f800, rc 0) 00000100:00100000:3.0:1746147150.811296:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308239360:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2432us (2733us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147150.811306:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15138 00000100:00100000:0.0:1746147150.814963:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.815053:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308239616 00000100:00100000:3.0:1746147150.815061:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308239616 00000100:00100000:3.0:1746147150.815114:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5564 00000100:00100000:3.0:1746147150.815120:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+32:32664:x1830967308239616:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147150.815294:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90095e6f-8cef-455a-9171-4caf9b613254+33:32664:x1830967308239616:12345-192.168.204.25@tcp:35:cat.0 Request processed in 172us (336us total) trans 8589936145 rc 0/0 00000100:00100000:3.0:1746147150.815300:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5564 00000100:00100000:0.0:1746147150.816268:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.816335:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308239872 00000100:00100000:3.0:1746147150.816341:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308239872 00000100:00100000:3.0:1746147150.816368:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15415 00000100:00100000:3.0:1746147150.816374:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:32666:x1830967308239872:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147150.816385:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147150.816401:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x3139939425057cb2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ce8 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.816468:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.816479:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.816488:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147150.816498:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:3.0:1746147150.816555:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x3139939425057cb2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 18 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.816569:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.816575:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.816578:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147150.816580:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504fa00, rc 0) 00000100:00100000:3.0:1746147150.816894:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32666:x1830967308239872:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 519us (627us total) trans 8589936146 rc 0/0 00000100:00100000:3.0:1746147150.816901:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15415 00000100:00100000:0.0:1746147150.819721:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.819763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.819804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.819828:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240000 00000100:00100000:3.0:1746147150.819838:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240000 00000100:00100000:0.0:1746147150.819855:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240128 00000100:00100000:0.0:1746147150.819859:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240128 00000100:00100000:1.0:1746147150.819876:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240256 00000100:00100000:1.0:1746147150.819880:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240256 00000100:00100000:3.0:1746147150.819897:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15139 00000100:00100000:0.0:1746147150.819903:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15140 00000100:00100000:3.0:1746147150.819904:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308240000:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:0.0:1746147150.819910:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308240128:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:1.0:1746147150.819912:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15141 00000100:00100000:1.0:1746147150.819917:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308240256:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147150.819944:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.819944:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.819948:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.819961:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.819961:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.819962:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.819969:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.819969:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147150.819969:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.819970:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147150.819973:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.819975:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.819979:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.819979:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.819980:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.819981:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.819982:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.819982:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.820001:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147150.820001:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.820001:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820012:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.820012:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 23 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.820012:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 14 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.820024:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310772480:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.820024:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310772352:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.820025:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310772224:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.820119:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc000 going to sleep for 11 seconds 00010000:00010000:0.0:1746147150.820122:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.820129:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 23 pid: 1854 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.820134:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.820137:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095235500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310772608:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.820151:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240384 00000100:00100000:3.0:1746147150.820154:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240384 00000100:00100000:0.0:1746147150.820156:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.820177:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.820182:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240512 00000100:00100000:3.0:1746147150.820184:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240512 00000100:00100000:2.0:1746147150.820198:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15142 00000100:00100000:3.0:1746147150.820203:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15143 00000100:00100000:0.0:1746147150.820203:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.820205:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308240384:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:3.0:1746147150.820209:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308240512:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147150.820223:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820225:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.820226:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240640 00000100:00100000:0.0:1746147150.820228:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240640 00010000:00010000:3.0:1746147150.820232:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820236:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.820238:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820243:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820244:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147150.820244:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15144 00000100:00100000:0.0:1746147150.820249:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308240640:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147150.820250:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820250:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820256:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820256:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.820257:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.820259:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.820260:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147150.820261:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147150.820263:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.820263:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.820271:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820274:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820277:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.820278:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.820282:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 8 pid: 9586 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.820284:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820285:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 25 pid: 1853 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.820289:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310772736:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.820290:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.820291:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147150.820293:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310772864:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.820293:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.820304:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.820311:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 23 pid: 1853 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.820318:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095234a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310772992:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.820320:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820325:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820327:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 25 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.820333:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310773120:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.820336:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.820337:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 13 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.820344:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310773248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.820350:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.820356:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 13 pid: 12201 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.820360:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 15 pid: 1136 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.820363:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310773504:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.820365:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.820368:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095237b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310773376:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.820371:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 25 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.820377:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.820379:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310773632:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.820384:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 8 pid: 12201 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.820388:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.820390:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310773760:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.820390:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7e40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147150.820396:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 37 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.820403:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095235f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310773888:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.820411:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147150.820415:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658300 going to sleep for 11 seconds 00010000:00010000:2.0:1746147150.820418:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 13 pid: 1854 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.820425:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310774016:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.820447:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820455:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 8 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.820466:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c30b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310774144:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.820481:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147150.820499:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.820506:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.820513:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c309c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310774272:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.820531:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147150.827666:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310772352:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.827680:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095235500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310772608:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.827685:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967310772224:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.827698:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095234a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310772992:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.827705:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.827705:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.827733:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310772736:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.827877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.827900:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.827925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.827940:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.827959:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240768 00000100:00100000:0.0:1746147150.827965:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240768 00010000:00010000:0.0:1746147150.827996:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 16 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.828018:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241024 00000100:00100000:0.0:1746147150.828020:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241024 00010000:00010000:0.0:1746147150.828030:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 26 pid: 1853 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.828041:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241408 00000100:00100000:0.0:1746147150.828043:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241408 00000100:00100000:2.0:1746147150.828051:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310772864:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.828051:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 9 pid: 9586 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.828059:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310773120:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.828065:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6719 00000100:00100000:0.0:1746147150.828072:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308240768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147150.828078:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6720 00010000:00010000:0.0:1746147150.828083:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147150.828085:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308241024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.828117:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147150.828122:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6721 00010000:00010000:0.0:1746147150.828127:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 16 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746147150.828128:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308241408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.828131:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 26 pid: 1853 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.828135:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.828137:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 16 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.828139:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 26 pid: 1853 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.828143:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 9 pid: 9586 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.828150:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 9 pid: 9586 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.828157:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32800/0x3139939425057a9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b98 expref: 26 pid: 1853 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.828157:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x3139939425057c65 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cb0 expref: 16 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.828160:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64ae00/0x3139939425057a74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b6e expref: 9 pid: 9586 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.828174:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147150.828174:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147150.828179:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.828216:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308241408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.828222:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6721 00000100:00100000:3.0:1746147150.828232:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310772480:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.828246:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308240896 00000100:00100000:1.0:1746147150.828250:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308240896 00002000:00100000:1.0:1746147150.828275:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1228800->1994751) req@ffff880095234700 x1830967308240896/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.828283:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234700 with x1830967308240896 ext(1228800->1994751) 00010000:00010000:1.0:1746147150.828289:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.828298:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.828304:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095234700 00000100:00100000:1.0:1746147150.828317:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1199 00000100:00100000:1.0:1746147150.828322:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967308240896:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147150.828934:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308241024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 847us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.828940:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6720 00000100:00100000:0.0:1746147150.829013:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308240768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 939us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.829021:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6719 00000100:00100000:0.0:1746147150.829080:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.829113:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241152 00000100:00100000:2.0:1746147150.829116:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241152 00010000:00010000:2.0:1746147150.829132:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.829142:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.829219:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241536 00000100:00100000:2.0:1746147150.829223:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241536 00010000:00010000:2.0:1746147150.829237:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 26 pid: 1853 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746147150.829252:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6722 00000100:00100000:2.0:1746147150.829258:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308241152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.829265:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.829276:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746147150.829277:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6723 00000100:00100000:3.0:1746147150.829282:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+26:2002:x1830967308241536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.829289:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.829291:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.829299:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 26 pid: 1853 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.829304:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32a00/0x3139939425057b77 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c0f expref: 25 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.829307:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 26 pid: 1853 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746147150.829314:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147150.829318:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212c00/0x3139939425057b46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78bfa expref: 26 pid: 1853 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.829331:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.829331:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967308241152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.829337:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6722 00000100:00100000:3.0:1746147150.829343:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967308241536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.829348:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6723 00000100:00100000:1.0:1746147150.829442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.829510:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310773248:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.829521:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310773632:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.829522:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.829539:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095237b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310773376:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.829540:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.829555:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241280 00000100:00100000:0.0:1746147150.829558:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241280 00010000:00010000:0.0:1746147150.829569:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 25 pid: 1854 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.829582:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241792 00000100:00100000:0.0:1746147150.829584:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241792 00010000:00010000:0.0:1746147150.829592:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 14 pid: 12201 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.829604:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6724 00000100:00100000:0.0:1746147150.829609:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967308241280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.829615:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.829624:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 25 pid: 1854 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.829631:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 25 pid: 1854 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.829641:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057c3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca2 expref: 25 pid: 1854 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.829649:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.829651:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.829655:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.829658:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6725 00010000:00010000:0.0:1746147150.829662:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.829665:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308241792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.829673:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.829681:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 14 pid: 12201 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.829684:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147150.829694:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.829696:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 14 pid: 12201 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.829701:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.829708:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147150.829716:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.829723:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.829729:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.829735:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147150.829739:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.829745:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.829755:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.829760:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057cd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.830230:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.830241:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241664 00000100:00100000:1.0:1746147150.830244:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241664 00010000:00010000:2.0:1746147150.830249:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x3139939425057c7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cc5 expref: 15 pid: 12201 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.830257:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 15 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.830263:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308240128:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 10353us (10498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.830271:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6726 00000100:00100000:0.0:1746147150.830271:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15140 00000100:00100000:1.0:1746147150.830276:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308241664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147150.830282:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.830290:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 15 pid: 17600 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.830294:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308241280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 686us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.830299:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6724 00010000:00010000:1.0:1746147150.830302:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 15 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.830313:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x3139939425057c6c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cbe expref: 15 pid: 17600 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746147150.830321:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.830335:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308241664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.830340:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6726 00000100:00100000:2.0:1746147150.830365:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310773504:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.830370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.830384:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308241920 00000100:00100000:0.0:1746147150.830387:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308241920 00000100:00100000:1.0:1746147150.830396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147150.830396:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 14 pid: 1136 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746147150.830408:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242048 00000100:00100000:0.0:1746147150.830409:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242048 00000100:00100000:3.0:1746147150.830416:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308241792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 751us (893us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147150.830416:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.830421:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6725 00000100:00100000:0.0:1746147150.830428:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6727 00000100:00100000:0.0:1746147150.830432:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308241920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147150.830433:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6728 00000100:00100000:3.0:1746147150.830437:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967308242048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.830437:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.830443:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.830444:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 14 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.830451:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.830452:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 14 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.830458:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.830468:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425057c81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ccc expref: 14 pid: 1136 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.830469:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425057bb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4915200->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c4e expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.830476:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147150.830477:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147150.830495:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967308242048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.830504:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308241920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.830510:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6727 00000100:00100000:1.0:1746147150.830513:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310774016:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147150.830532:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310773760:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.830547:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095235f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967310773888:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147150.830555:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c30b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967310774144:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.830563:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.830573:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.830599:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6728 00000100:00100000:2.0:1746147150.830664:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c309c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967310774272:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.830700:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.831727:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.831752:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.831773:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.831795:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242176 00000100:00100000:0.0:1746147150.831799:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242176 00010000:00010000:0.0:1746147150.831819:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.831824:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242304 00000100:00100000:3.0:1746147150.831828:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242304 00000100:00100000:0.0:1746147150.831837:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242560 00000100:00100000:0.0:1746147150.831839:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242560 00010000:00010000:3.0:1746147150.831843:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 12 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.831847:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.831873:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6729 00000100:00100000:0.0:1746147150.831878:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6730 00000100:00100000:3.0:1746147150.831880:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967308242176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147150.831884:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2002:x1830967308242304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.831890:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.831892:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.831901:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.831902:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 12 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.831910:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.831911:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 12 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746147150.831924:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64aa00/0x3139939425057a6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b67 expref: 23 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.831924:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b000/0x3139939425057c5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ca9 expref: 12 pid: 1854 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746147150.831933:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147150.831935:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.831937:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.831941:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.831949:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.831959:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2002:x1830967308242304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.831964:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6730 00010000:00010000:3.0:1746147150.831965:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147150.831975:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6731 00000100:00100000:0.0:1746147150.831979:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308242560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147150.831980:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967308242176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.831985:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6729 00010000:00010000:0.0:1746147150.831985:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.831992:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.831999:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.832009:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8ea00/0x3139939425057a5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b59 expref: 8 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.832020:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147150.832034:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967308242560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.832039:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6731 00010000:00010000:2.0:1746147150.832047:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832054:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832069:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.832070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147150.832075:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832082:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.832082:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242432 00000100:00100000:0.0:1746147150.832085:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242432 00010000:00010000:2.0:1746147150.832105:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147150.832108:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832115:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.832115:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 7 pid: 12201 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.832125:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832130:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x3139939425057ce3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.832136:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6732 00000100:00100000:0.0:1746147150.832141:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+7:2000:x1830967308242432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147150.832147:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147150.832154:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 7 pid: 12201 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746147150.832162:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 7 pid: 12201 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.832171:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2001:x1830967308240384:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 11966us (12037us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147150.832172:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f213000/0x3139939425057ba1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c39 expref: 7 pid: 12201 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.832178:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15142 00010000:00010000:0.0:1746147150.832181:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.832183:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.832185:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.832195:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832315:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832324:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832336:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832342:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832348:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832354:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147150.832356:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832362:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832370:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832377:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057cdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.832398:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.832402:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2001:x1830967308240512:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 12193us (12224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.832406:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15143 00000100:00100000:1.0:1746147150.832413:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242688 00000100:00100000:1.0:1746147150.832416:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242688 00010000:00010000:1.0:1746147150.832427:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 7 pid: 1136 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746147150.832441:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6733 00000100:00100000:1.0:1746147150.832446:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+7:2003:x1830967308242688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147150.832452:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.832458:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 7 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.832465:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 7 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.832475:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212a00/0x3139939425057b4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c01 expref: 7 pid: 1136 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.832485:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.832486:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.832488:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.832494:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.832529:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147150.832543:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+6:2003:x1830967308242688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.832548:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6733 00010000:00010000:0.0:1746147150.832673:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147150.832689:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+5:2000:x1830967308242432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 547us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.832695:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6732 00010000:00010000:2.0:1746147150.832831:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832839:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832851:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832856:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832862:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832866:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147150.832869:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832874:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832884:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.832889:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x3139939425057cc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.832936:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:2001:x1830967308240000:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 13032us (13223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.832942:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15139 00000100:00100000:0.0:1746147150.835025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.835087:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242816 00000100:00100000:2.0:1746147150.835125:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242816 00010000:00010000:2.0:1746147150.835162:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 38 pid: 9586 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.835192:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6734 00000100:00100000:2.0:1746147150.835199:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967308242816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.835213:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.835237:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 38 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.835249:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 38 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.835271:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49200/0x3139939425057aa5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b9f expref: 38 pid: 9586 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.835290:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.835292:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.835297:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.835305:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.835328:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.835413:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967308242816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 213us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.835420:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6734 00010000:00010000:0.0:1746147150.837751:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837770:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837809:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837817:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837825:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837832:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0d600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147150.837836:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837850:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837868:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.837875:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425057cea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.838693:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308240640:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 18436us (18481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.838704:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15144 00000100:00100000:1.0:1746147150.841249:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+24:2000:x1830967308240896:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12915us (13311us total) trans 21474841553 rc 0/0 00000100:00100000:1.0:1746147150.841261:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1199 00002000:00100000:1.0:1746147150.841273:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1228800->1994751) req@ffff880095234700 x1830967308240896/t21474841553(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:526/0 lens 488/448 e 0 to 0 dl 1746147161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147150.841287:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234700 with x1830967308240896 ext(1228800->1994751) 00010000:00010000:1.0:1746147150.841297:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.841311:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746147150.841317:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095234700 00000100:00100000:0.0:1746147150.843269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.843973:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308242944 00000100:00100000:2.0:1746147150.843986:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308242944 00010000:00010000:2.0:1746147150.844027:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.844355:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6735 00000100:00100000:2.0:1746147150.844363:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308242944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.844378:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.844396:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.844408:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.844430:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6200/0x3139939425057c03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1994751) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78c7f expref: 24 pid: 12225 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.844442:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.844444:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.844448:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.844456:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.844634:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.844691:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308242944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 328us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.844697:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6735 00010000:00010000:1.0:1746147150.844756:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844764:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844779:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844799:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844805:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844811:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147150.844814:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844825:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844834:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.844838:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261200/0x3139939425057cce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.844894:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308240256:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 24975us (25089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.844901:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15141 00000100:00100000:0.0:1746147150.848615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.848666:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308243200 00000100:00100000:3.0:1746147150.848675:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308243200 00000100:00100000:3.0:1746147150.848727:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15416 00000100:00100000:3.0:1746147150.848735:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:32666:x1830967308243200:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:3.0:1746147150.848774:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746147150.848812:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e200/0x3139939425057ca4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cda expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848838:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbe00/0x3139939425057699 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7895a expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848847:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.848851:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147150.848871:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.848882:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848888:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 46 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848894:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 46 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848899:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848903:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848909:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.848932:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.848946:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.848957:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774400:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.850535:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.850547:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 32 pid: 6215 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.850558:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774528:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.850603:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 46 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.850611:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 46 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.850617:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774656:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.850650:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 46 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.850657:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 46 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.850665:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774784:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147150.850701:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.850708:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.850715:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774912:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.850742:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147150.852048:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774400:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.852061:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774528:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147150.852068:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774656:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.852078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.852318:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308243456 00000100:00100000:2.0:1746147150.852327:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308243456 00000100:00100000:3.0:1746147150.852523:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5565 00000100:00100000:3.0:1746147150.852532:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:8487:x1830967308243456:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147150.852720:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:8487:x1830967308243456:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 189us (649us total) trans 8589936147 rc 0/0 00000100:00100000:3.0:1746147150.852726:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5565 00000100:00100000:0.0:1746147150.853588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.853624:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.853655:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308243712 00000100:00100000:2.0:1746147150.853660:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308243712 00000100:00100000:1.0:1746147150.853670:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308243584 00000100:00100000:1.0:1746147150.853673:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308243584 00010000:00010000:1.0:1746147150.853697:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 33 pid: 6215 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.853715:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 48 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746147150.853725:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6736 00000100:00100000:2.0:1746147150.853730:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6737 00000100:00100000:1.0:1746147150.853731:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+33:2001:x1830967308243584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147150.853734:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967308243712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.853741:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.853741:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.853746:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 33 pid: 6215 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.853755:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 33 pid: 6215 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.853756:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 48 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.853768:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 48 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.853803:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774912:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147150.853859:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa800/0x3139939425057692 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78953 expref: 33 pid: 6215 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.853864:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0a00/0x313993942505768b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7894c expref: 48 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.853873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147150.853874:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.853883:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.853894:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147150.853894:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147150.853896:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147150.853900:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.853918:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967308243712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 182us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.853918:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+32:2001:x1830967308243584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 187us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.853923:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6737 00000100:00100000:1.0:1746147150.853926:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6736 00000100:00100000:0.0:1746147150.853929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.853935:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308243840 00000100:00100000:1.0:1746147150.853935:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308243968 00000100:00100000:2.0:1746147150.853937:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308243840 00000100:00100000:1.0:1746147150.853937:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308243968 00010000:00010000:2.0:1746147150.853945:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.853945:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 47 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.853954:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6738 00000100:00100000:1.0:1746147150.853957:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6739 00000100:00100000:2.0:1746147150.853958:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+32:2000:x1830967308243840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147150.853961:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967308243968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147150.853964:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147150.853966:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.853967:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.853968:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 47 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.853974:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.853984:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 47 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.854194:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310774784:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.854253:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942505771e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789a0 expref: 32 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746147150.854257:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbee600/0x313993942505776b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e789b5 expref: 47 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.854262:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.854265:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.854270:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147150.854270:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147150.854272:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147150.854277:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147150.854288:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90095e6f-8cef-455a-9171-4caf9b613254+31:2000:x1830967308243840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 328us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.854288:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308243968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 326us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.854293:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6739 00000100:00100000:2.0:1746147150.854300:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6738 00010000:00010000:3.0:1746147150.854368:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147150.854395:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.854871:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244096 00000100:00100000:3.0:1746147150.854875:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244096 00010000:00010000:3.0:1746147150.854889:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.854921:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6740 00000100:00100000:3.0:1746147150.854927:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967308244096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147150.854934:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147150.854938:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.854947:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.854957:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x3139939425057a2e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78b2f expref: 46 pid: 7239 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.854966:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.854969:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.854975:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.854981:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.855007:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147150.855075:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967308244096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 147us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.855081:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6740 00010000:00010000:2.0:1746147150.855148:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.855154:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000040:00080000:2.0:1746147150.855497:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].623, 88 off62888 00000004:00080000:2.0:1746147150.855504:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845414480ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.855545:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].556, 88 off56984 00000004:00080000:2.0:1746147150.855549:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845459628ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.855566:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].557, 88 off57072 00000004:00080000:2.0:1746147150.855569:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845479302ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.855578:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].624, 88 off62976 00000004:00080000:2.0:1746147150.855580:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845491032ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.855588:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].625, 88 off63064 00000004:00080000:2.0:1746147150.855591:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845501302ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.855601:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].558, 88 off57160 00000004:00080000:2.0:1746147150.855604:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845514735ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.855763:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].559, 88 off57248 00000004:00080000:2.0:1746147150.855768:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845678472ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.855947:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].561, 88 off57432 00000004:00080000:2.0:1746147150.855952:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845862416ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.855976:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].626, 88 off63152 00000004:00080000:2.0:1746147150.855978:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845888972ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.855995:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].562, 88 off57520 00000004:00080000:2.0:1746147150.855997:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845908120ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.856003:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].627, 88 off63240 00000004:00080000:2.0:1746147150.856006:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845916516ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.856012:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].563, 88 off57608 00000004:00080000:2.0:1746147150.856015:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688845925427ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147150.856022:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].628, 88 off63328 00000004:00080000:2.0:1746147150.856024:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845934672ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.856031:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].629, 88 off63416 00000004:00080000:2.0:1746147150.856034:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845944621ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.856043:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].630, 88 off63504 00000004:00080000:2.0:1746147150.856045:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845955917ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.856059:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].631, 88 off63592 00000004:00080000:2.0:1746147150.856061:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688845971926ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147150.856137:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].564, 88 off57696 00000004:00080000:2.0:1746147150.856141:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688846051806ns, next at 554081490131ns, rc = 0 00000001:00080000:0.0:1746147150.859255:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936148 is committed 00000004:00080000:0.0:1746147150.859266:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 558 committed 00000004:00080000:0.0:1746147150.859287:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 623 committed 00000004:00080000:0.0:1746147150.859294:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 622 committed 00000004:00080000:0.0:1746147150.859296:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 621 committed 00000004:00080000:0.0:1746147150.859297:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 620 committed 00000004:00080000:0.0:1746147150.859299:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 557 committed 00000004:00080000:0.0:1746147150.859301:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 619 committed 00000004:00080000:0.0:1746147150.859303:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 556 committed 00000004:00080000:0.0:1746147150.859304:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 618 committed 00000004:00080000:0.0:1746147150.859444:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 555 committed 00000004:00080000:0.0:1746147150.859449:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 554 committed 00000004:00080000:0.0:1746147150.859450:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 553 committed 00000004:00080000:0.0:1746147150.859451:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 617 committed 00000004:00080000:0.0:1746147150.859453:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 616 committed 00000004:00080000:0.0:1746147150.859454:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 552 committed 00000004:00080000:0.0:1746147150.859456:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 551 committed 00000004:00080000:0.0:1746147150.859457:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 615 committed 00000001:00080000:0.0:1746147150.859461:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936147 is committed 00000001:00080000:0.0:1746147150.859465:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936145 is committed 00000100:00100000:2.0:1746147150.859565:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310775040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.859644:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310775424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.859698:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.859723:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310775936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.859736:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.859764:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147150.859769:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310775552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.859794:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.859800:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.859818:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775424 00000100:00100000:3.0:1746147150.859824:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775424 00000100:00100000:1.0:1746147150.859824:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.859841:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147150.859854:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.859859:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775936 00000100:00100000:3.0:1746147150.859861:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775936 00000100:00100000:1.0:1746147150.859868:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147150.859871:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775552 00000100:00100000:3.0:1746147150.859872:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775552 00000100:00100000:1.0:1746147150.859872:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.859881:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775168 00000100:00100000:3.0:1746147150.859882:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775168 00000100:00100000:1.0:1746147150.859886:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.859910:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.859925:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.860510:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775680 00000100:00100000:3.0:1746147150.860514:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775680 00000100:00100000:3.0:1746147150.860531:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775296 00000100:00100000:3.0:1746147150.860533:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775296 00000100:00100000:3.0:1746147150.860542:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15145 00000100:00100000:3.0:1746147150.860549:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967310775424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147150.860652:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147150.860654:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147150.860657:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147150.860658:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147150.860660:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:3.0:1746147150.860688:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310775424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (989us total) trans 21474841554 rc 0/0 00000100:00100000:3.0:1746147150.860693:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15145 00000100:00100000:3.0:1746147150.860706:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15146 00000100:00100000:3.0:1746147150.860710:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967310775936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.860763:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310775936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1025us total) trans 21474841555 rc 0/0 00000100:00100000:3.0:1746147150.860768:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15146 00000100:00100000:3.0:1746147150.860778:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15147 00000100:00100000:3.0:1746147150.860793:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967310775552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.860845:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310775552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1050us total) trans 21474841556 rc 0/0 00000100:00100000:3.0:1746147150.860850:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15147 00000100:00100000:3.0:1746147150.860858:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15148 00000100:00100000:3.0:1746147150.860862:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3764:x1830967310775168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.860908:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310775168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1083us total) trans 21474841557 rc 0/0 00000100:00100000:3.0:1746147150.860913:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15148 00000100:00100000:3.0:1746147150.860921:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15149 00000100:00100000:3.0:1746147150.860924:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3764:x1830967310775680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147150.860952:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147150.860954:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147150.860956:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147150.860957:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147150.860959:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:3.0:1746147150.860975:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310775680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (1120us total) trans 21474841558 rc 0/0 00000100:00100000:3.0:1746147150.860979:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15149 00000100:00100000:3.0:1746147150.860988:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15150 00000100:00100000:3.0:1746147150.860992:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3764:x1830967310775296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.861036:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967310775296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (1149us total) trans 21474841559 rc 0/0 00000100:00100000:3.0:1746147150.861043:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15150 00000004:00080000:3.0:1746147150.861076:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4e00/2, rc 0, transno 21474841556 00000100:00100000:3.0:1746147150.861081:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310775552:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147150.861113:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6300/2, rc 0, transno 21474841554 00000100:00100000:3.0:1746147150.861116:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310775424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147150.861125:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e503800/2, rc 0, transno 21474841555 00000100:00100000:3.0:1746147150.861127:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310775936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147150.861176:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775040 00000100:00100000:1.0:1746147150.861181:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775040 00000100:00100000:1.0:1746147150.861205:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15151 00000100:00100000:1.0:1746147150.861209:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967310775040:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746147150.861263:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098823800 reply state ffff88008f38b400 transno 8589936148 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147150.861282:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967310775040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1356us total) trans 21474841560 rc 0/0 00010000:00010000:2.0:1746147150.861286:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147150.861288:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15151 00010000:00010000:2.0:1746147150.861293:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.861296:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147150.861299:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1746147150.861319:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4380/2, rc 0, transno 21474841560 00000100:00100000:2.0:1746147150.861323:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310775040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.861330:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.861349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.861363:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.861377:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.861379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.861389:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147150.861393:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.861399:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.861410:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776064 00000100:00100000:2.0:1746147150.861413:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776064 00000100:00100000:1.0:1746147150.861416:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.861429:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.861439:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147150.861443:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.861457:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.861579:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776576 00000100:00100000:2.0:1746147150.861582:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776576 00000100:00100000:2.0:1746147150.861597:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776320 00000100:00100000:2.0:1746147150.861598:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776320 00000100:00100000:2.0:1746147150.861606:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776832 00000100:00100000:2.0:1746147150.861608:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776832 00000100:00100000:2.0:1746147150.861614:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15152 00000100:00100000:2.0:1746147150.861618:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967310776064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.861689:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967310776064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (338us total) trans 17179874297 rc 0/0 00000100:00100000:2.0:1746147150.861693:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15152 00000100:00100000:2.0:1746147150.861701:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15153 00000100:00100000:2.0:1746147150.861705:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967310776576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147150.861733:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:2.0:1746147150.861735:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:2.0:1746147150.861737:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147150.861738:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147150.861740:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:2.0:1746147150.861752:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967310776576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (373us total) trans 17179874298 rc 0/0 00000100:00100000:2.0:1746147150.861756:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15153 00000100:00100000:2.0:1746147150.861762:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15154 00000100:00100000:2.0:1746147150.861766:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967310776320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.861820:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967310776320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (420us total) trans 17179874299 rc 0/0 00000100:00100000:2.0:1746147150.861824:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15154 00000100:00100000:2.0:1746147150.861831:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15155 00000100:00100000:2.0:1746147150.861834:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967310776832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147150.861860:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147150.861862:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.861864:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147150.861865:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.861867:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147150.861878:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967310776832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (448us total) trans 17179874300 rc 0/0 00000100:00100000:2.0:1746147150.861882:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15155 00000100:00100000:3.0:1746147150.861918:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776192 00000100:00100000:3.0:1746147150.861922:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776192 00000100:00080000:0.0:1746147150.861927:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147150.861929:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147150.861931:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.861939:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15156 00000100:00100000:3.0:1746147150.861943:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967310776192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.861947:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.861963:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874281 gen 2 00000004:00080000:1.0:1746147150.861967:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095236300, transno 17179874263 00000100:00100000:0.0:1746147150.861968:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776704 00000100:00100000:0.0:1746147150.861971:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776704 00000004:00080000:1.0:1746147150.861972:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095237800, transno 17179874264 00000004:00080000:1.0:1746147150.861974:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f084000, transno 17179874265 00000004:00080000:1.0:1746147150.861976:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0700, transno 17179874266 00000004:00080000:1.0:1746147150.861978:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096898000, transno 17179874267 00000004:00080000:1.0:1746147150.861980:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095236a00, transno 17179874268 00000004:00080000:1.0:1746147150.861982:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e59f80, transno 17179874269 00000004:00080000:1.0:1746147150.861984:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011da9ce00, transno 17179874270 00000004:00080000:1.0:1746147150.861986:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a1f80, transno 17179874271 00000100:00100000:0.0:1746147150.861987:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15157 00000004:00080000:1.0:1746147150.861989:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5a300, transno 17179874273 00000004:00080000:1.0:1746147150.861991:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5aa00, transno 17179874274 00000100:00100000:0.0:1746147150.861991:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3765:x1830967310776704:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147150.861993:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5bb80, transno 17179874275 00000100:00100000:3.0:1746147150.861994:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3765:x1830967310776192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (537us total) trans 17179874301 rc 0/0 00000004:00080000:1.0:1746147150.861995:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5b100, transno 17179874276 00000004:00080000:1.0:1746147150.861997:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e4c4000, transno 17179874277 00000100:00100000:3.0:1746147150.861999:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15156 00000004:00080000:1.0:1746147150.861999:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5a680, transno 17179874278 00000004:00080000:1.0:1746147150.862002:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e58a80, transno 17179874279 00000004:00080000:1.0:1746147150.862004:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5ad80, transno 17179874280 00000004:00080000:1.0:1746147150.862006:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e59500, transno 17179874281 00000100:00100000:1.0:1746147150.862011:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88011e4c5180 x1830967310776320/t17179874299(17179874299) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147166 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147150.862018:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c5180/2, rc 0, transno 17179874299 00000100:00100000:1.0:1746147150.862021:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147150.862031:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd47b80/2, rc 0, transno 17179874300 00000100:00100000:1.0:1746147150.862034:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147150.862040:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c5f80/2, rc 0, transno 17179874301 00000100:00100000:1.0:1746147150.862043:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.862139:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.862153:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.862170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147150.862184:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c7b80/2, rc 0, transno 17179874298 00000100:00100000:2.0:1746147150.862188:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776576:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147150.862188:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 18 done 00000004:00080000:2.0:1746147150.862194:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c5c00/2, rc 0, transno 17179874297 00000100:00100000:2.0:1746147150.862197:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.862207:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776448 00000100:00100000:2.0:1746147150.862209:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776448 00000100:00100000:1.0:1746147150.862216:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310776960 00000100:00100000:1.0:1746147150.862219:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310776960 00000100:00100000:0.0:1746147150.862233:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310776704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (284us total) trans 17179874302 rc 0/0 00000100:00100000:1.0:1746147150.862235:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15158 00000100:00100000:0.0:1746147150.862238:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15157 00000100:00100000:1.0:1746147150.862240:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967310776448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.862247:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147150.862247:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15159 00000100:00100000:0.0:1746147150.862252:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967310776960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.862253:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310777088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.862270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.862287:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777088 00000100:00100000:3.0:1746147150.862289:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777088 00002000:00010000:0.0:1746147150.862289:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00002000:00010000:0.0:1746147150.862291:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147150.862293:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147150.862295:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00000100:00100000:1.0:1746147150.862297:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967310776448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (157us total) trans 17179874303 rc 0/0 00002000:00010000:0.0:1746147150.862297:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:3.0:1746147150.862301:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15160 00000100:00100000:1.0:1746147150.862304:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15158 00000100:00100000:3.0:1746147150.862305:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3766:x1830967310777088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147150.862314:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967310776960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (143us total) trans 17179874304 rc 0/0 00000100:00100000:0.0:1746147150.862319:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15159 00000100:00100000:1.0:1746147150.862320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.862327:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310775808 00000100:00100000:0.0:1746147150.862330:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310775808 00000004:00080000:1.0:1746147150.862339:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6680/2, rc 0, transno 21474841557 00000100:00100000:0.0:1746147150.862342:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15161 00000100:00100000:1.0:1746147150.862343:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147150.862346:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967310775808:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147150.862350:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7b80/2, rc 0, transno 21474841558 00000100:00100000:1.0:1746147150.862352:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.862356:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3766:x1830967310777088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (86us total) trans 17179874305 rc 0/0 00000004:00080000:1.0:1746147150.862359:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4a80/2, rc 0, transno 21474841559 00000100:00100000:1.0:1746147150.862361:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.862362:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15160 00000004:00080000:1.0:1746147150.862374:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c6a00/2, rc 0, transno 17179874302 00000100:00100000:1.0:1746147150.862376:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310776704:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147150.862380:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd47100/2, rc 0, transno 17179874305 00000100:00100000:3.0:1746147150.862383:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310777088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147150.862396:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967310775808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (75us total) trans 21474841561 rc 0/0 00000100:00100000:0.0:1746147150.862401:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15161 00000004:00080000:1.0:1746147150.862406:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e503480/2, rc 0, transno 21474841561 00000100:00100000:1.0:1746147150.862409:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310775808:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147150.862449:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c4700/2, rc 0, transno 17179874303 00000100:00100000:2.0:1746147150.862453:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776448:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147150.862457:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd45880/2, rc 0, transno 17179874304 00000100:00100000:2.0:1746147150.862459:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310776960:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746147150.862488:0:7238:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147150.862497:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32666:x1830967308243200:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 13763us (13891us total) trans 8589936148 rc 0/0 00000100:00100000:2.0:1746147150.862504:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15416 00010000:00010000:3.0:1746147150.862654:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.862665:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.862671:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.862677:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38cc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147150.862680:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.862686:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.862696:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.862699:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147150.862702:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.862706:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38cc00/0x3139939425057cf1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147150.864412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.864537:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244224 00000100:00100000:2.0:1746147150.864544:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244224 00000100:00100000:2.0:1746147150.864584:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15417 00000100:00100000:2.0:1746147150.864591:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:32666:x1830967308244224:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147150.864612:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.864629:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cef expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.864677:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.864689:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.864703:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.864706:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147150.864708:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d200, rc 0) 00000100:00100000:2.0:1746147150.864758:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32666:x1830967308244224:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 168us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.864764:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15417 00000100:00100000:0.0:1746147150.867714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.867823:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244352 00000100:00100000:2.0:1746147150.867831:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244352 00000100:00100000:2.0:1746147150.867885:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15418 00000100:00100000:2.0:1746147150.867893:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+8:32666:x1830967308244352:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147150.867911:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.867930:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057cff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cf6 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.868006:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425057d06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.868017:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425057d06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.868027:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425057d06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147150.868053:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147150.868056:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147150.868070:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425057d06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.868128:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0dc00/0x3139939425057cff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cf6 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.868144:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425057d06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cf6 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.868151:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.868153:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147150.868156:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:2.0:1746147150.868190:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32666:x1830967308244352:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 299us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.868196:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15418 00000100:00100000:0.0:1746147150.870343:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.870379:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.870408:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244480 00000100:00100000:0.0:1746147150.870412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.870417:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244480 00000100:00100000:0.0:1746147150.870430:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244608 00000100:00100000:0.0:1746147150.870437:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244608 00000100:00100000:2.0:1746147150.870461:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244864 00000100:00100000:2.0:1746147150.870464:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244864 00000100:00100000:0.0:1746147150.870472:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15162 00000100:00100000:0.0:1746147150.870481:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308244480:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147150.870489:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15163 00000100:00100000:2.0:1746147150.870496:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308244608:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147150.870498:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147150.870509:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15164 00010000:00010000:2.0:1746147150.870511:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147150.870516:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:2000:x1830967308244864:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147150.870519:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x3139939425057d0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78cfd expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.870523:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.870526:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057d14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d04 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.870532:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d12 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147150.870540:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814174e, atime: 0x6814174c, ctime: 0x6814174e, blocks: 0x7c8 00002000:00010000:3.0:1746147150.870544:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814174d, atime: 0x6814174d, ctime: 0x6814174d, blocks: 0x800 00002000:00010000:2.0:1746147150.870544:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6814174e, atime: 0x6814174e, ctime: 0x6814174e, blocks: 0x808 00010000:00010000:3.0:1746147150.870558:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.870558:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.870560:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.870560:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.870568:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.870569:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x3139939425057d0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cfd expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.870581:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.870582:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x3139939425057d0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cfd expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147150.870589:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c800, rc 0) 00010000:00010000:0.0:1746147150.870591:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd200, rc 0) 00000100:00100000:3.0:1746147150.870652:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308244864:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 136us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.870658:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15164 00010000:00010000:2.0:1746147150.870662:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.870664:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.870668:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d04 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.870678:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d04 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147150.870754:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308244480:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 274us (420us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147150.870760:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c600, rc 0) 00000100:00100000:0.0:1746147150.870761:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15162 00000100:00100000:2.0:1746147150.870792:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308244608:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 286us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.870797:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15163 00000100:00100000:0.0:1746147150.870805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.870872:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245120 00000100:00100000:2.0:1746147150.870874:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245120 00000100:00100000:2.0:1746147150.870892:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15165 00000100:00100000:2.0:1746147150.870897:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308245120:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147150.870903:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.870910:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x3139939425057d22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d20 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.870913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:2.0:1746147150.870919:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x6814174d, atime: 0x6814174d, ctime: 0x6814174d, blocks: 0x1008 00000100:00100000:1.0:1746147150.870925:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244736 00010000:00010000:2.0:1746147150.870927:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.870928:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147150.870929:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244736 00010000:00010000:2.0:1746147150.870932:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x3139939425057d22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d20 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.870940:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x3139939425057d22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d20 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.870947:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ce00, rc 0) 00000100:00100000:1.0:1746147150.870949:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15166 00000100:00100000:1.0:1746147150.870954:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308244736:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147150.870961:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147150.870967:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308245120:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 69us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147150.870971:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d0b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.870972:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15165 00002000:00010000:1.0:1746147150.870983:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814174e, atime: 0x6814174e, ctime: 0x6814174e, blocks: 0x808 00000100:00100000:0.0:1746147150.870986:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147150.870992:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.870994:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.870997:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147150.871006:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308244992 00010000:00010000:1.0:1746147150.871007:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147150.871009:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308244992 00010000:00010000:1.0:1746147150.871014:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9be00, rc 0) 00000100:00100000:2.0:1746147150.871035:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15167 00000100:00100000:2.0:1746147150.871040:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308244992:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147150.871105:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.871114:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425057d30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d19 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147150.871124:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x6814174e, atime: 0x6814174d, ctime: 0x6814174e, blocks: 0x1590 00010000:00010000:2.0:1746147150.871131:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.871133:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.871137:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425057d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d19 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.871146:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425057d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d19 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.871152:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:2.0:1746147150.871552:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308244992:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 511us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.871553:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308244736:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 597us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.871557:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15167 00000100:00100000:1.0:1746147150.871561:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15166 00000100:00100000:0.0:1746147150.875885:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.875929:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.875954:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.876491:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245248 00000100:00100000:0.0:1746147150.876497:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.876498:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245504 00000100:00100000:1.0:1746147150.876501:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245248 00000100:00100000:2.0:1746147150.876507:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245504 00000100:00100000:0.0:1746147150.877063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.877116:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245760 00000100:00100000:1.0:1746147150.877116:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245376 00000100:00100000:3.0:1746147150.877120:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245760 00000100:00100000:1.0:1746147150.877120:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245376 00000100:00100000:1.0:1746147150.877135:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245632 00000100:00100000:1.0:1746147150.877137:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245632 00000100:00100000:3.0:1746147150.877150:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15168 00000100:00100000:3.0:1746147150.877158:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308245248:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147150.877263:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15169 00000100:00100000:1.0:1746147150.877270:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308245504:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147150.877387:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308245248:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 228us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.877393:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15168 00000100:00100000:3.0:1746147150.877409:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15170 00000100:00100000:3.0:1746147150.877414:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308245376:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147150.877467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.877590:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308245888 00000100:00100000:0.0:1746147150.877593:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308245888 00000100:00100000:0.0:1746147150.877608:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15171 00000100:00100000:0.0:1746147150.877613:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308245760:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147150.877650:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2001:x1830967308245760:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 37us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.877656:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15171 00000100:00100000:0.0:1746147150.877666:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15172 00000100:00100000:0.0:1746147150.877671:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308245632:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147150.877695:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308245632:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.877699:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15172 00000100:00100000:0.0:1746147150.877707:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15173 00000100:00100000:0.0:1746147150.877711:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308245888:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147150.877736:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308245888:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 24us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.877740:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15173 00000100:00100000:1.0:1746147150.878107:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308245504:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 836us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.878113:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15169 00000100:00100000:3.0:1746147150.878215:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308245376:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 800us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.878221:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15170 00000100:00100000:0.0:1746147150.881799:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.881837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.881851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.881990:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246016 00000100:00100000:3.0:1746147150.882001:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246016 00000100:00100000:2.0:1746147150.882007:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246272 00000100:00100000:2.0:1746147150.882018:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246272 00000100:00100000:2.0:1746147150.882066:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15174 00000100:00100000:2.0:1746147150.882074:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308246016:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147150.882188:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15175 00000100:00100000:3.0:1746147150.882196:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308246272:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147150.882201:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308246016:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 127us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.882208:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15174 00000100:00100000:2.0:1746147150.882457:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246528 00000100:00100000:2.0:1746147150.882461:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246528 00000100:00100000:2.0:1746147150.882480:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15176 00000100:00100000:3.0:1746147150.882485:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308246272:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 290us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.882485:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308246528:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147150.882523:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308246528:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 38us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.882528:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15176 00000100:00100000:3.0:1746147150.882576:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15175 00000100:00100000:0.0:1746147150.882586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.882631:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246144 00000100:00100000:3.0:1746147150.882634:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246144 00000100:00100000:3.0:1746147150.882649:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15177 00000100:00100000:3.0:1746147150.882653:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308246144:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147150.882657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.882691:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308246144:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.882696:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15177 00000100:00100000:3.0:1746147150.882704:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246400 00000100:00100000:3.0:1746147150.882706:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246400 00000100:00100000:0.0:1746147150.882710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.883145:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246656 00000100:00100000:3.0:1746147150.883148:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246656 00000100:00100000:3.0:1746147150.883164:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15178 00000100:00100000:3.0:1746147150.883168:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308246400:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147150.883199:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2001:x1830967308246400:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 31us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.883204:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15178 00000100:00100000:3.0:1746147150.883211:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15179 00000100:00100000:3.0:1746147150.883215:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308246656:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147150.883238:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308246656:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.883242:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15179 00000100:00100000:0.0:1746147150.885807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.885887:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246784 00000100:00100000:2.0:1746147150.885895:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246784 00000100:00100000:2.0:1746147150.885931:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15180 00000100:00100000:2.0:1746147150.885939:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308246784:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147150.886154:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147150.886158:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.886160:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147150.886161:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.886163:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147150.886198:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308246784:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 259us (396us total) trans 21474841562 rc 0/0 00000100:00100000:2.0:1746147150.886203:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15180 00000100:00100000:0.0:1746147150.887777:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.887899:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308246912 00000100:00100000:2.0:1746147150.887905:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308246912 00000100:00100000:2.0:1746147150.887930:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15181 00000100:00100000:2.0:1746147150.887936:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308246912:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147150.888064:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147150.888068:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.888070:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147150.888072:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.888074:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147150.888130:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308246912:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 193us (355us total) trans 17179874306 rc 0/0 00000100:00100000:2.0:1746147150.888136:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15181 00000100:00100000:0.0:1746147150.892544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.892615:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308247168 00000100:00100000:1.0:1746147150.892623:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308247168 00000100:00100000:1.0:1746147150.892799:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3801 00000100:00100000:1.0:1746147150.892805:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308247168:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147150.892835:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.892847:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.892849:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.892853:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.892865:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.896901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.896946:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.896971:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308247424 00000100:00100000:2.0:1746147150.896979:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308247424 00000100:00100000:2.0:1746147150.897024:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308247552 00000100:00100000:2.0:1746147150.897026:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308247552 00000100:00100000:2.0:1746147150.897042:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3802 00000100:00100000:2.0:1746147150.897049:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308247424:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147150.897078:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.897108:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.897110:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.897113:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.897125:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.897206:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3803 00000100:00100000:0.0:1746147150.897227:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308247552:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147150.897243:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.897253:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.897255:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.897257:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.897264:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900888:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900902:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900909:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900917:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147150.900921:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900928:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900943:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.900949:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x3139939425057d37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.903515:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308247168:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 10700us (10969us total) trans 0 rc 1019904/1019904 00000100:00100000:1.0:1746147150.903528:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3801 00000100:00100000:0.0:1746147150.905443:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.907629:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.907709:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308247936 00000100:00100000:1.0:1746147150.907717:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308247936 00000100:00100000:1.0:1746147150.907761:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308248192 00000100:00100000:1.0:1746147150.907763:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308248192 00000100:00100000:1.0:1746147150.907779:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3804 00000100:00100000:1.0:1746147150.907797:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+13:2001:x1830967308247936:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147150.907826:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.907838:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.907840:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.907844:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.907856:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.908085:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3805 00000100:00100000:3.0:1746147150.908132:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308248192:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147150.908218:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.908230:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.908232:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.908236:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.908249:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908571:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908578:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908584:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908591:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffa800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147150.908594:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908600:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908614:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.908618:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x3139939425057d3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.908664:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967308247424:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 11615us (11771us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.908671:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3802 00000100:00100000:0.0:1746147150.910621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147150.910889:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.910900:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.910908:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.910913:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dacf400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147150.910916:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.910923:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.910938:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.910942:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dacf400/0x3139939425057d45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.911017:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308247552:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 13803us (14069us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.911028:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3803 00000100:00100000:1.0:1746147150.911050:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308248448 00000100:00100000:1.0:1746147150.911056:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308248448 00000100:00100000:1.0:1746147150.911120:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3806 00000100:00100000:1.0:1746147150.911127:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308248448:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147150.911157:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.911167:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.911169:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147150.911173:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.911182:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.912482:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.913037:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308248704 00000100:00100000:3.0:1746147150.913043:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308248704 00000100:00100000:3.0:1746147150.913084:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3807 00000100:00100000:3.0:1746147150.913106:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308248704:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147150.913132:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.913142:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.913143:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147150.913147:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.913162:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147150.916804:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147150.916967:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.916978:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.916985:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.917339:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ae00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147150.917343:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.917354:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.917371:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.917377:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844ae00/0x3139939425057d4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.917448:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308247936:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 9649us (12009us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.917457:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3804 00000100:00100000:2.0:1746147150.917458:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308248960 00000100:00100000:2.0:1746147150.917465:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308248960 00000100:00100000:2.0:1746147150.917500:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3808 00000100:00100000:2.0:1746147150.917507:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308248960:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147150.917533:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.917542:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.917543:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.917547:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.917557:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922607:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922623:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922631:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922637:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38cc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147150.922641:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922647:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922663:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.922668:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x3139939425057d53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.922777:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308248192:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 14648us (15148us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.922806:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3805 00010000:00010000:3.0:1746147150.926306:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.926321:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.926328:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.926334:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9b400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147150.926338:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.926344:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.926362:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147150.926367:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425057d61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.926428:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:2000:x1830967308248704:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 13333us (13947us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.926438:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3807 00010000:00010000:1.0:1746147150.926720:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.926728:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.926734:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.926739:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147150.926741:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.926746:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.926760:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.926765:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425057d5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147150.926807:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967308248448:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 15681us (16192us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147150.926813:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3806 00010000:00010000:2.0:1746147150.928078:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.928389:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.928396:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.928402:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147150.928404:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.928410:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.928426:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.928431:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x3139939425057d68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.928495:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308248960:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 10986us (11697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147150.928502:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3808 00000100:00100000:0.0:1746147150.936861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.937046:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249216 00000100:00100000:2.0:1746147150.937058:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249216 00000100:00100000:2.0:1746147150.938388:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15419 00000100:00100000:2.0:1746147150.938397:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:32666:x1830967308249216:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147150.938439:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147150.938465:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425057d06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cf6 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.938490:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.938494:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147150.938532:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.938543:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.938550:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00010000:2.0:1746147150.938637:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801323d5c00 reply state ffff8800993ce000 transno 8589936149 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.938645:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.938650:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.938652:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147150.938655:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147150.938737:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32666:x1830967308249216:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 342us (1886us total) trans 8589936149 rc 0/0 00000100:00100000:2.0:1746147150.938743:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15419 00000100:00100000:0.0:1746147150.941974:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.942015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.942041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.942067:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.942083:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.942135:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249472 00000100:00100000:0.0:1746147150.942144:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249472 00000100:00100000:0.0:1746147150.942186:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249344 00000100:00100000:0.0:1746147150.942188:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249344 00000100:00100000:0.0:1746147150.942200:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249600 00000100:00100000:0.0:1746147150.942202:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249600 00000100:00100000:0.0:1746147150.942211:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249728 00000100:00100000:0.0:1746147150.942213:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249728 00000100:00100000:0.0:1746147150.942222:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249856 00000100:00100000:0.0:1746147150.942224:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249856 00000100:00100000:0.0:1746147150.942239:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15182 00000100:00100000:0.0:1746147150.942247:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2000:x1830967308249472:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147150.942318:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15183 00000100:00100000:3.0:1746147150.942333:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2001:x1830967308249344:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147150.942420:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147150.942423:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942426:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942428:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942429:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746147150.942459:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147150.942462:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:3.0:1746147150.942464:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147148 -> 1746147150 00002000:00010000:3.0:1746147150.942466:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:3.0:1746147150.942468:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147150.942477:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967308249472:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 230us (513us total) trans 21474841563 rc 0/0 00000100:00100000:0.0:1746147150.942484:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15182 00000100:00100000:0.0:1746147150.942500:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15184 00000100:00100000:0.0:1746147150.942505:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+16:2001:x1830967308249600:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147150.942511:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308249344:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 182us (494us total) trans 17179874307 rc 0/0 00000100:00100000:3.0:1746147150.942517:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15183 00000100:00100000:3.0:1746147150.942534:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15185 00000100:00100000:3.0:1746147150.942539:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:2000:x1830967308249728:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147150.942545:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147150.942548:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942549:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942551:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942553:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147150.942573:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308249600:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 68us (531us total) trans 21474841564 rc 0/0 00002000:00010000:3.0:1746147150.942578:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746147150.942579:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15184 00002000:00010000:3.0:1746147150.942581:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147149 -> 1746147150 00002000:00010000:3.0:1746147150.942582:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147149 -> 1746147150 00002000:00010000:3.0:1746147150.942584:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147149 -> 1746147150 00002000:00010000:3.0:1746147150.942586:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147150.942589:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15186 00000100:00100000:0.0:1746147150.942594:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308249856:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147150.942603:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308249728:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 64us (535us total) trans 17179874308 rc 0/0 00000100:00100000:3.0:1746147150.942609:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15185 00000100:00100000:1.0:1746147150.942738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.942763:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308249984 00000100:00100000:1.0:1746147150.942768:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308249984 00000100:00100000:1.0:1746147150.942800:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15187 00000100:00100000:1.0:1746147150.942805:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2000:x1830967308249984:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147150.942859:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147150.942861:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147149 -> 1746147150 00002000:00010000:1.0:1746147150.942863:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147149 -> 1746147150 00002000:00010000:1.0:1746147150.942864:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147149 -> 1746147150 00002000:00010000:1.0:1746147150.942866:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147150.942880:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2000:x1830967308249984:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 75us (143us total) trans 21474841565 rc 0/0 00000100:00100000:1.0:1746147150.942884:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15187 00002000:00010000:0.0:1746147150.942894:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147150.942897:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942900:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147149 -> 1746147150 00002000:00010000:0.0:1746147150.942902:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.942904:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147150.942925:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2001:x1830967308249856:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 331us (840us total) trans 17179874309 rc 0/0 00000100:00100000:0.0:1746147150.942931:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15186 00000100:00100000:0.0:1746147150.944467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.944964:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308250240 00000100:00100000:2.0:1746147150.944972:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308250240 00000100:00100000:2.0:1746147150.945207:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15420 00000100:00100000:2.0:1746147150.945215:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32672:x1830967308250240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147150.945515:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.945532:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425057d76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d27 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.945591:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945602:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945612:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945623:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945630:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945635:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945713:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945723:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.945730:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.945754:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.945764:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 9 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.945774:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310777216:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.946035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.946683:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308250496 00000100:00100000:3.0:1746147150.946688:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308250496 00000100:00100000:3.0:1746147150.946718:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5566 00000100:00100000:3.0:1746147150.946723:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32666:x1830967308250496:12345-192.168.204.25@tcp:35:lfs.0 00010000:00010000:3.0:1746147150.946753:0:7240:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 10 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746147150.946769:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147150.946772:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147150.946774:0:7240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.946790:0:7240:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147150.946795:0:7240:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147150.946878:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32666:x1830967308250496:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 154us (843us total) trans 8589936150 rc -16/-16 00000100:00100000:3.0:1746147150.946884:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5566 00000100:00100000:2.0:1746147150.947750:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00010000:00010000:2.0:1746147150.951291:0:7238:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from blocking AST (req@ffff88012f3cc000 x1830967310777216) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 10 pid: 7238 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746147150.951310:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057cb9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ce8 expref: 10 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746147150.951330:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967310777216:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147150.951522:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.951529:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951536:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951541:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147150.951555:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147150.951627:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951633:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951637:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951641:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.951643:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951648:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951657:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.951658:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147150.951661:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951665:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057d8b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951679:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951684:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951688:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951691:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951694:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.951696:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951699:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951705:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147150.951706:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.951708:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951712:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951717:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951721:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951725:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951729:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.951730:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951734:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951738:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800958e2f00) 00010000:00010000:2.0:1746147150.951739:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147150.951740:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951745:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057d84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.951790:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425057d76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d27 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.951796:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425057d76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d27 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.951803:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:2.0:1746147150.951920:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32672:x1830967308250240:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6704us (7455us total) trans 8589936151 rc 301/301 00000100:00100000:2.0:1746147150.951926:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15420 00000100:00100000:3.0:1746147150.954184:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830967310777600:0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954235:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.954256:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3766:1830967310778112:0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.954285:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147150.954289:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310777728:0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954307:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.954318:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3766:1830967310778240:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954370:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310777472:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.954413:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967310777984:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954428:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.954439:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830967310778496:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954453:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.954465:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746147150.954469:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3765:1830967310777344:0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.954488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.954507:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777472 00000100:00100000:3.0:1746147150.954513:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777472 00000100:00100000:0.0:1746147150.954516:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967310777856:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954533:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.954543:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1746147150.954543:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310778368:0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954549:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310777472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147150.954572:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777600 00000100:00100000:0.0:1746147150.954575:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777600 00000100:00100000:3.0:1746147150.954589:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967310777472:12345-0@lo:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.954591:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310778112 00000100:00100000:0.0:1746147150.954593:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310778112 00000100:00100000:3.0:1746147150.954595:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1746147150.954604:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310778368 00000100:00100000:3.0:1746147150.954606:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310778368 00000100:00100000:0.0:1746147150.954606:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777984 00000100:00100000:0.0:1746147150.954608:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777984 00000100:00100000:3.0:1746147150.954614:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1746147150.954617:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310778496 00000100:00100000:3.0:1746147150.954618:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310778368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954618:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310778496 00000100:00100000:0.0:1746147150.954625:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310778240 00000100:00100000:0.0:1746147150.954626:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310778240 00000100:00100000:0.0:1746147150.954633:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777856 00000100:00100000:0.0:1746147150.954635:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777856 00000100:00100000:3.0:1746147150.954637:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3765:x1830967310778368:12345-0@lo:400:kworker.0 Request processed in 18us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.954641:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1746147150.954643:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1746147150.954647:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3766:x1830967310777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954654:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1746147150.954657:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830967310778112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954667:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3766:x1830967310777600:12345-0@lo:400:kworker.0 Request processed in 19us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.954672:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1746147150.954674:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830967310778112:12345-0@lo:400:kworker.0 Request processed in 17us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.954678:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1746147150.954680:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1746147150.954683:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967310777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954685:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1746147150.954688:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830967310778496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954699:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967310777984:12345-0@lo:400:kworker.0 Request processed in 15us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.954704:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830967310778496:12345-0@lo:400:kworker.0 Request processed in 15us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.954704:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1746147150.954707:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1746147150.954710:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1746147150.954714:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1746147150.954714:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830967310778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954717:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967310777856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954729:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830967310778240:12345-0@lo:400:kworker.0 Request processed in 15us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147150.954731:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967310777856:12345-0@lo:400:kworker.0 Request processed in 14us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.954733:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1746147150.954735:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1746147150.954745:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777344 00000100:00100000:0.0:1746147150.954748:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777344 00000100:00100000:3.0:1746147150.954762:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3766:1830967310778240:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954763:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1746147150.954767:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3765:x1830967310777344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954770:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830967310777600:0@lo:400:kworker.0 00000100:00100000:3.0:1746147150.954776:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3766:1830967310778112:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954800:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3765:x1830967310777344:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.954804:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1746147150.954822:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746147150.954824:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147150.954835:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3765:1830967310777344:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954842:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967310777856:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954848:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310778368:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954853:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310777472:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954859:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967310777984:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954864:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830967310778496:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954907:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310777728 00000100:00100000:0.0:1746147150.954909:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310777728 00000100:00100000:0.0:1746147150.954938:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1746147150.954942:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310777728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.954962:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830967310777728:12345-0@lo:400:kworker.0 Request processed in 20us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.954966:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:0.0:1746147150.954974:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147150.955292:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310777728:0@lo:400:kworker.0 00000100:00100000:0.0:1746147150.960815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147150.960903:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308250752 00000100:00100000:2.0:1746147150.960914:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308250752 00000100:00100000:0.0:1746147150.961127:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15421 00000100:00100000:0.0:1746147150.961139:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32673:x1830967308250752:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.961167:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.961189:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d2e expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.961275:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961289:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961300:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961312:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961318:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961323:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961429:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x3139939425057dae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961437:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x3139939425057dae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961442:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x3139939425057dae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147150.961450:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:0.0:1746147150.961535:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961540:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961549:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961555:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961561:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504e400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147150.961564:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961571:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961582:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147150.961585:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147150.961589:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961594:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425057da0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961615:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961620:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961624:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961629:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147150.961631:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961639:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961646:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094553d00) 00010000:00010000:0.0:1746147150.961648:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147150.961650:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961655:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425057da7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.961691:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x3139939425057d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d2e expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.961703:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x3139939425057dae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d2e expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.961710:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147150.961712:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147150.961714:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00000100:00100000:0.0:1746147150.961772:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32673:x1830967308250752:12345-192.168.204.25@tcp:101:cat.0 Request processed in 635us (968us total) trans 8589936152 rc 0/0 00000100:00100000:0.0:1746147150.961778:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15421 00000100:00100000:0.0:1746147150.964384:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.964441:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251008 00000100:00100000:3.0:1746147150.964449:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251008 00000100:00100000:0.0:1746147150.964473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.964496:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5567 00000100:00100000:3.0:1746147150.964503:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:32666:x1830967308251008:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1746147150.964643:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251136 00000100:00100000:0.0:1746147150.964646:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251136 00000100:00100000:0.0:1746147150.964671:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15188 00000100:00100000:3.0:1746147150.964675:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:32666:x1830967308251008:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 171us (302us total) trans 8589936153 rc 0/0 00000100:00100000:0.0:1746147150.964676:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967308251136:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147150.964681:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5567 00010000:00010000:0.0:1746147150.964688:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.964704:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d35 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.964724:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.964726:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.964735:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 23 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.964750:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 23 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.964760:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f200, rc 0) 00000100:00100000:0.0:1746147150.964778:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967308251136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.964794:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15188 00000100:00100000:0.0:1746147150.965347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.965397:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.965740:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.965757:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251264 00000100:00100000:0.0:1746147150.965761:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251264 00000100:00100000:0.0:1746147150.965789:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251392 00000100:00100000:0.0:1746147150.965791:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251392 00000100:00100000:0.0:1746147150.965807:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251520 00000100:00100000:0.0:1746147150.965809:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251520 00000100:00100000:0.0:1746147150.966353:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15189 00000100:00100000:0.0:1746147150.966362:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967308251264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.966374:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.966391:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d3c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.966409:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.966410:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.966416:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.966430:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.966440:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b800, rc 0) 00000100:00100000:0.0:1746147150.966469:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308251264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 108us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.966474:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15189 00000100:00100000:0.0:1746147150.966487:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15190 00000100:00100000:0.0:1746147150.966492:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967308251392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.966497:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.966503:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d43 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.966618:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15191 00000100:00100000:2.0:1746147150.966626:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967308251520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147150.966634:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147150.966643:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d4a expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147150.966653:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.966655:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147150.966659:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 24 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.966668:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 24 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147150.966674:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:2.0:1746147150.966689:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967308251520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 65us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147150.966694:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15191 00010000:00010000:0.0:1746147150.966795:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.966796:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.966800:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.966808:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.966820:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:0.0:1746147150.966832:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967308251392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 341us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.966836:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15190 00000100:00100000:0.0:1746147150.966875:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.967084:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147150.967350:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251648 00000100:00100000:1.0:1746147150.967355:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251648 00000100:00100000:1.0:1746147150.967374:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308251776 00000100:00100000:1.0:1746147150.967377:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308251776 00000100:00100000:0.0:1746147150.967419:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15192 00000100:00100000:0.0:1746147150.967424:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967308251648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.967431:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.967437:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d51 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.967447:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.967449:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.967452:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.967461:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.967467:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ae00, rc 0) 00000100:00100000:0.0:1746147150.967479:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308251648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 55us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.967483:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15192 00000100:00100000:0.0:1746147150.968167:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15193 00000100:00100000:0.0:1746147150.968177:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967308251776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147150.968183:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.968191:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d58 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.968200:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.968202:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147150.968205:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 40 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.968213:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 40 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147150.968219:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b600, rc 0) 00000100:00100000:0.0:1746147150.968234:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967308251776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.968239:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15193 00000100:00100000:3.0:1746147150.969272:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310778624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746147150.969315:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.969480:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310778624 00000100:00100000:1.0:1746147150.969485:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310778624 00000100:00100000:1.0:1746147150.969534:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1746147150.969656:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967310778624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746147150.969687:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445646336 avail 1316184064 00000100:00100000:1.0:1746147150.969820:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967310778624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.969825:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1746147150.969871:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967310778624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746147150.970220:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310778752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746147150.970252:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.970296:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310778752 00000100:00100000:1.0:1746147150.970299:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310778752 00000100:00100000:1.0:1746147150.970315:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1746147150.970323:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310778752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746147150.970340:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:1.0:1746147150.970365:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967310778752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147150.970370:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1746147150.970378:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310778752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746147150.974792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.975172:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308252032 00000100:00100000:0.0:1746147150.975183:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308252032 00000100:00100000:0.0:1746147150.975246:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15422 00000100:00100000:0.0:1746147150.975255:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32672:x1830967308252032:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147150.975280:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147150.975284:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147150.975312:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x3139939425057dae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d2e expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.975328:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147150.975333:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147150.975345:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057de6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d5f expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.975394:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.975407:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.975414:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.975447:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147150.975459:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 10 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746147150.975471:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310778880:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147150.976187:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147150.978464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.978495:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.978515:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.978536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.978591:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801323d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967310778880:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147150.978615:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147150.978701:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308252544 00000100:00100000:3.0:1746147150.978709:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308252544 00000100:00100000:0.0:1746147150.978722:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147150.978755:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308253184 00000100:00100000:0.0:1746147150.978758:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308253184 00002000:00100000:3.0:1746147150.978759:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801323d4e00 x1830967308252544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.978769:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4e00 with x1830967308252544 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.978774:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d4e00 00010000:00010000:0.0:1746147150.978777:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 11 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.978796:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308252800 00000100:00100000:3.0:1746147150.978799:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308252800 00000100:00100000:0.0:1746147150.978807:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6741 00002000:00100000:3.0:1746147150.978813:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801323d7480 x1830967308252800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147150.978815:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+11:2000:x1830967308253184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746147150.978826:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7480 with x1830967308252800 ext(1048576->2097151) 00010000:00010000:0.0:1746147150.978828:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147150.978829:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7480 00010000:00010000:0.0:1746147150.978834:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 11 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.978839:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308252288 00000100:00100000:3.0:1746147150.978842:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308252288 00010000:00010000:0.0:1746147150.978844:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 11 pid: 7238 timeout: 788 lvb_type: 0 00002000:00100000:3.0:1746147150.978851:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801323d5880 x1830967308252288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.978857:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5880 with x1830967308252288 ext(0->1048575) 00002000:00010000:3.0:1746147150.978860:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5880 00010000:00010000:0.0:1746147150.978864:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425057cf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cef expref: 11 pid: 7238 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746147150.978867:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308252928 00000100:00100000:3.0:1746147150.978869:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308252928 00002000:00100000:3.0:1746147150.978876:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009cd44a80 x1830967308252928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/0 e 0 to 0 dl 1746147161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746147150.978877:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:0.0:1746147150.978881:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00002000:00100000:3.0:1746147150.978882:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44a80 with x1830967308252928 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.978885:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd44a80 00010000:00010000:0.0:1746147150.978890:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147150.978893:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3809 00010000:00010000:0.0:1746147150.978897:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147150.978898:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967308252544:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:0.0:1746147150.978912:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147150.978943:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+10:2000:x1830967308253184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 130us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147150.978952:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6741 00010000:00010000:0.0:1746147150.978992:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147150.978997:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000040:00080000:0.0:1746147150.979258:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].632, 88 off63680 00000004:00080000:0.0:1746147150.979263:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969172631ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979288:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].565, 88 off57784 00000004:00080000:0.0:1746147150.979291:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969201761ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979300:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].566, 88 off57872 00000004:00080000:0.0:1746147150.979302:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969212911ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979308:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].633, 88 off63768 00000004:00080000:0.0:1746147150.979310:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969221107ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979316:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].634, 88 off63856 00000004:00080000:0.0:1746147150.979318:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969229001ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979324:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].567, 88 off57960 00000004:00080000:0.0:1746147150.979326:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969236350ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979331:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].568, 88 off58048 00000004:00080000:0.0:1746147150.979333:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969243760ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979339:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].569, 88 off58136 00000004:00080000:0.0:1746147150.979341:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969251201ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979346:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].635, 88 off63944 00000004:00080000:0.0:1746147150.979348:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969259072ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979354:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].570, 88 off58224 00000004:00080000:0.0:1746147150.979356:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969266442ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979364:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].636, 88 off64032 00000004:00080000:0.0:1746147150.979366:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969276861ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979374:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].571, 88 off58312 00000004:00080000:0.0:1746147150.979376:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969286855ns, next at 554081490131ns, rc = 0 00000040:00080000:0.0:1746147150.979384:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].637, 88 off64120 00000004:00080000:0.0:1746147150.979386:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969296962ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979394:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].638, 88 off64208 00000004:00080000:0.0:1746147150.979396:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969306792ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979404:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].639, 88 off64296 00000004:00080000:0.0:1746147150.979406:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969316772ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979413:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].640, 88 off64384 00000004:00080000:0.0:1746147150.979416:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688969326247ns, next at 554081470618ns, rc = 0 00000040:00080000:0.0:1746147150.979424:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].572, 88 off58400 00000004:00080000:0.0:1746147150.979426:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 688969336772ns, next at 554081490131ns, rc = 0 00000100:00100000:3.0:1746147150.979649:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3810 00000100:00100000:3.0:1746147150.979655:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967308252800:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147150.980708:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3811 00000100:00100000:0.0:1746147150.980719:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967308252288:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147150.981056:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3812 00000100:00100000:2.0:1746147150.981066:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308252928:12345-192.168.204.25@tcp:3:multiop.0 00000001:00080000:1.0:1746147150.984637:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936154 is committed 00000004:00080000:1.0:1746147150.984653:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 566 committed 00000004:00080000:1.0:1746147150.984672:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 632 committed 00000004:00080000:1.0:1746147150.984679:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 631 committed 00000004:00080000:1.0:1746147150.984681:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 630 committed 00000004:00080000:1.0:1746147150.984682:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 629 committed 00000004:00080000:1.0:1746147150.984684:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 565 committed 00000004:00080000:1.0:1746147150.984686:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 628 committed 00000004:00080000:1.0:1746147150.984687:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 564 committed 00000004:00080000:1.0:1746147150.984689:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 627 committed 00000004:00080000:1.0:1746147150.984690:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 563 committed 00000004:00080000:1.0:1746147150.984694:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 562 committed 00000004:00080000:1.0:1746147150.984695:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 561 committed 00000004:00080000:1.0:1746147150.984697:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 626 committed 00000004:00080000:1.0:1746147150.984699:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 625 committed 00000004:00080000:1.0:1746147150.984701:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 560 committed 00000004:00080000:1.0:1746147150.984702:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 559 committed 00000004:00080000:1.0:1746147150.984704:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 624 committed 00000001:00080000:1.0:1746147150.984723:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936153 is committed 00010000:00010000:2.0:1746147150.984759:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.984771:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.984788:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.984794:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147150.984797:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.984804:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.984821:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147150.984823:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746147150.984827:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310779136:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147150.984827:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147150.984831:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x3139939425057d6f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147150.984859:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779392:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147150.984878:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d5f expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147150.984888:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310779008:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147150.984888:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:2.0:1746147150.984889:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147150.984890:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147150.984904:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a600/0x3139939425057de6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d5f expref: 28 pid: 9138 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746147150.984916:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147150.984918:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d5f expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147150.984920:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.984934:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310779520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.984936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.984949:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147150.984952:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00000100:00100000:3.0:1746147150.984958:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310780032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.984970:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.984976:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147150.984981:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.984989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.984999:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.985002:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310779648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.985012:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.985017:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.985029:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779392 00000100:00100000:1.0:1746147150.985030:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779008 00000100:00100000:3.0:1746147150.985032:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310780160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.985035:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779392 00000100:00100000:1.0:1746147150.985035:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779008 00000100:00100000:3.0:1746147150.985045:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.985058:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310780672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.985062:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779904 00000100:00100000:2.0:1746147150.985063:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779520 00000100:00100000:1.0:1746147150.985064:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779904 00000100:00100000:2.0:1746147150.985065:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779520 00000100:00100000:3.0:1746147150.985072:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147150.985072:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780032 00000100:00100000:1.0:1746147150.985072:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779136 00000100:00100000:2.0:1746147150.985073:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780032 00000100:00100000:1.0:1746147150.985074:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779136 00000100:00100000:2.0:1746147150.985077:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779264 00000100:00100000:2.0:1746147150.985078:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779264 00000100:00100000:3.0:1746147150.985079:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147150.985081:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779648 00000100:00100000:3.0:1746147150.985082:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310780544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.985083:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779648 00000100:00100000:2.0:1746147150.985084:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780160 00000100:00100000:2.0:1746147150.985085:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780160 00000100:00100000:1.0:1746147150.985103:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780672 00000100:00100000:1.0:1746147150.985105:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780672 00000100:00100000:2.0:1746147150.985107:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15194 00000100:00100000:2.0:1746147150.985112:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310779008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147150.985114:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15195 00000100:00100000:3.0:1746147150.985117:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147150.985120:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967310779392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.985136:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.985149:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.985156:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.985168:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.985175:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147150.985178:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.985190:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.985196:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.985209:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147150.985213:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147150.985213:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147150.985215:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:1.0:1746147150.985216:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985217:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985218:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:1.0:1746147150.985218:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985219:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746147150.985220:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00000100:00100000:3.0:1746147150.985222:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780544 00002000:00010000:1.0:1746147150.985222:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147150.985225:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780544 00000100:00100000:3.0:1746147150.985238:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780288 00000100:00100000:3.0:1746147150.985240:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780288 00000100:00100000:2.0:1746147150.985242:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967310779008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (326us total) trans 21474841566 rc 0/0 00000100:00100000:2.0:1746147150.985247:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15194 00000100:00100000:1.0:1746147150.985247:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3767:x1830967310779392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (359us total) trans 17179874310 rc 0/0 00000100:00100000:3.0:1746147150.985250:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780800 00000100:00100000:3.0:1746147150.985251:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780800 00000100:00100000:1.0:1746147150.985253:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15195 00000100:00100000:2.0:1746147150.985256:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780416 00000100:00100000:3.0:1746147150.985258:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310780928 00000100:00100000:2.0:1746147150.985258:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780416 00000100:00100000:3.0:1746147150.985260:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310780928 00000100:00100000:1.0:1746147150.985264:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15196 00000100:00100000:2.0:1746147150.985268:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15197 00000100:00100000:1.0:1746147150.985268:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3767:x1830967310779904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.985272:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15198 00000100:00100000:2.0:1746147150.985272:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310779520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.985277:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967310780032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147150.985304:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147150.985306:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985307:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985309:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985311:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:1.0:1746147150.985312:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147150.985315:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147150.985317:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147150.985318:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147150.985320:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x90:0x0] updating lvb blocks from disk: 1896 -> 1896 00000100:00100000:2.0:1746147150.985326:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3764:x1830967310779520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (377us total) trans 21474841567 rc 0/0 00000100:00100000:2.0:1746147150.985334:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15197 00000100:00100000:3.0:1746147150.985340:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3764:x1830967310780032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (368us total) trans 21474841569 rc 0/0 00000100:00100000:1.0:1746147150.985340:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967310779904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (403us total) trans 21474841568 rc 0/0 00000100:00100000:2.0:1746147150.985344:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15199 00000100:00100000:3.0:1746147150.985347:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15198 00000100:00100000:2.0:1746147150.985348:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967310779136:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147150.985380:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147150.985383:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ba00, rc 0) 00002000:00010000:2.0:1746147150.985387:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147150.985390:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985392:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985393:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:2.0:1746147150.985395:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147150.985415:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32672:x1830967308252032:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10161us (10646us total) trans 8589936154 rc 0/0 00000100:00100000:2.0:1746147150.985416:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967310779136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (426us total) trans 17179874311 rc 0/0 00000100:00100000:0.0:1746147150.985422:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15422 00000100:00100000:1.0:1746147150.985941:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15196 00000100:00100000:1.0:1746147150.985954:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15200 00000100:00100000:1.0:1746147150.985960:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3767:x1830967310779264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147150.986002:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147150.986005:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:1.0:1746147150.986007:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:1.0:1746147150.986009:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:1.0:1746147150.986010:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147150.986030:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3767:x1830967310779264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1029us total) trans 21474841570 rc 0/0 00000100:00100000:1.0:1746147150.986035:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15200 00000100:00100000:1.0:1746147150.986046:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15201 00000100:00100000:1.0:1746147150.986050:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967310779648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147150.986116:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147150.986119:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147150.986120:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147150.986122:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:1.0:1746147150.986123:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:1.0:1746147150.986145:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3765:x1830967310779648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1126us total) trans 21474841571 rc 0/0 00000100:00100000:1.0:1746147150.986151:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15201 00000100:00100000:1.0:1746147150.986160:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15202 00000100:00100000:1.0:1746147150.986165:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967310780160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147150.986220:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3765:x1830967310780160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1174us total) trans 21474841572 rc 0/0 00000100:00100000:1.0:1746147150.986225:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15202 00000100:00100000:1.0:1746147150.986235:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15203 00000100:00100000:1.0:1746147150.986239:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967310780672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.986258:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15204 00000100:00100000:3.0:1746147150.986275:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3765:x1830967310780544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147150.986294:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3765:x1830967310780672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1220us total) trans 17179874312 rc 0/0 00000100:00100000:2.0:1746147150.986299:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15199 00002000:00010000:3.0:1746147150.986324:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb size from disk: 3670016 -> 3670016 00002000:00010000:3.0:1746147150.986326:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb mtime from disk: 1746147097 -> 1746147097 00002000:00010000:3.0:1746147150.986328:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147150.986330:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746147150.986331:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x91:0x0] updating lvb blocks from disk: 1024 -> 1024 00000100:00100000:1.0:1746147150.986346:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15203 00000100:00100000:3.0:1746147150.986352:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3765:x1830967310780544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1234us total) trans 17179874313 rc 0/0 00000100:00100000:0.0:1746147150.987552:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15205 00000100:00100000:2.0:1746147150.987560:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15206 00000100:00100000:0.0:1746147150.987562:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310780288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.987576:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967310780800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.987589:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15204 00000100:00100000:3.0:1746147150.987606:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15207 00000100:00100000:3.0:1746147150.987612:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3766:x1830967310780416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.987633:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15208 00000100:00100000:2.0:1746147150.987638:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310780928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147150.987644:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147150.987646:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.987648:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.987650:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147150 -> 1746147150 00002000:00010000:0.0:1746147150.987651:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000004:00080000:3.0:1746147150.987658:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3ea00/2, rc 0, transno 17179874313 00000100:00100000:3.0:1746147150.987670:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310780544:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147150.987676:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb size from disk: 7864320 -> 7864320 00000004:00080000:3.0:1746147150.987679:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3ce00/2, rc 0, transno 17179874312 00002000:00010000:2.0:1746147150.987679:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.987681:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147150.987681:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3766:x1830967310780288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (2531us total) trans 17179874314 rc 0/0 00000100:00100000:3.0:1746147150.987682:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310780672:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147150.987683:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.987685:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x93:0x0] updating lvb blocks from disk: 7016 -> 7016 00000100:00100000:0.0:1746147150.987686:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15205 00000004:00080000:3.0:1746147150.987692:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c4000/2, rc 0, transno 17179874311 00000100:00100000:3.0:1746147150.987695:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310779136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.987708:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310780928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (2498us total) trans 17179874316 rc 0/0 00000004:00080000:3.0:1746147150.987709:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5180/2, rc 0, transno 21474841571 00000100:00100000:3.0:1746147150.987712:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310779648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.987714:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15208 00000004:00080000:3.0:1746147150.987720:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e503b80/2, rc 0, transno 21474841572 00000100:00100000:3.0:1746147150.987722:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310780160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.987734:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147150.987744:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305f2680/2, rc 0, transno 21474841566 00000100:00100000:3.0:1746147150.987746:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310779008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147150.987752:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:3.0:1746147150.987754:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5880/2, rc 0, transno 21474841567 00000100:00100000:3.0:1746147150.987756:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310779520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147150.987759:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310781056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147150.987762:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c4380/2, rc 0, transno 17179874310 00000004:00080000:3.0:1746147150.987763:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e502d80/2, rc 0, transno 21474841569 00000100:00100000:2.0:1746147150.987765:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.987766:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310780032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147150.987774:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e501c00/2, rc 0, transno 21474841568 00000100:00100000:2.0:1746147150.987777:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147150.987792:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3e680/2, rc 0, transno 17179874316 00000100:00100000:0.0:1746147150.987792:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147150.987796:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780928:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147150.987801:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305f2300/2, rc 0, transno 21474841570 00000004:00080000:3.0:1746147150.987803:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c6d80/2, rc 0, transno 17179874314 00000100:00100000:2.0:1746147150.987803:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.987806:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147150.987811:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310779776 00000100:00100000:2.0:1746147150.987813:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310781056 00000100:00100000:2.0:1746147150.987817:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310781056 00000100:00100000:0.0:1746147150.987817:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310779776 00000100:00100000:0.0:1746147150.987835:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15209 00000100:00100000:2.0:1746147150.987838:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15210 00000100:00100000:0.0:1746147150.987839:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3767:x1830967310779776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147150.987842:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3765:x1830967310781056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147150.987890:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3765:x1830967310781056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (97us total) trans 17179874317 rc 0/0 00000100:00100000:2.0:1746147150.987895:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15210 00002000:00010000:2.0:1746147150.987916:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147150.987918:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.987920:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147150.987922:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147150.987924:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147150.987939:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310780800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 366us (2770us total) trans 17179874315 rc 0/0 00000100:00100000:2.0:1746147150.987944:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15206 00000004:00080000:3.0:1746147150.988413:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c3f480/2, rc 0, transno 17179874315 00000100:00100000:3.0:1746147150.988419:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147150.988492:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967310780416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 879us (3300us total) trans 17179874318 rc 0/0 00000100:00100000:3.0:1746147150.988497:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15207 00000004:00080000:2.0:1746147150.988500:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e4c6680/2, rc 0, transno 17179874318 00000100:00100000:2.0:1746147150.988504:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310780416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147150.989170:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967310779776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1329us (1435us total) trans 21474841573 rc 0/0 00000100:00100000:0.0:1746147150.989177:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15209 00000004:00080000:0.0:1746147150.989202:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd46300/2, rc 0, transno 17179874317 00000100:00100000:0.0:1746147150.989205:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310781056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147150.989284:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e502680/2, rc 0, transno 21474841573 00000100:00100000:2.0:1746147150.989287:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310779776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147150.989977:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967308252544:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11075us (11518us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.989989:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3809 00002000:00100000:3.0:1746147150.989997:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff8801323d4e00 x1830967308252544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.990007:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d4e00 with x1830967308252544 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.990013:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d4e00 00000100:00100000:3.0:1746147150.991523:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308252800:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11858us (13016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.991534:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3810 00002000:00100000:3.0:1746147150.991543:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8801323d7480 x1830967308252800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.991552:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d7480 with x1830967308252800 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.991557:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801323d7480 00000100:00100000:0.0:1746147150.993314:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147150.993499:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308252928:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12433us (14959us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147150.993510:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3812 00002000:00100000:3.0:1746147150.993524:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff88009cd44a80 x1830967308252928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147150.993534:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd44a80 with x1830967308252928 ext(1048576->2097151) 00002000:00010000:3.0:1746147150.993539:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd44a80 00000100:00100000:1.0:1746147150.994969:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308253440 00000100:00100000:1.0:1746147150.994980:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308253440 00000100:00100000:1.0:1746147150.995031:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15423 00000100:00100000:1.0:1746147150.995037:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:32676:x1830967308253440:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147150.995059:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147150.995080:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d66 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.995171:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995184:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995194:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995205:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995210:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995214:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995310:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057e09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995316:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057e09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995321:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057e09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147150.995327:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:1.0:1746147150.995396:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995401:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995406:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995411:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995416:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147150.995420:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995426:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995437:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147150.995440:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147150.995444:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995449:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425057dfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995463:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995468:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995473:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995477:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147150.995480:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995485:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995490:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bf4ee00) 00010000:00010000:1.0:1746147150.995493:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147150.995495:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995499:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x3139939425057e02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147150.995531:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x3139939425057df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d66 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.995540:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057e09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d66 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147150.995547:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147150.995548:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147150.995550:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:1.0:1746147150.995583:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+9:32676:x1830967308253440:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 546us (2277us total) trans 8589936155 rc 0/0 00000100:00100000:1.0:1746147150.995588:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15423 00000100:00100000:0.0:1746147150.996192:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308252288:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15473us (17672us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147150.996201:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3811 00002000:00100000:0.0:1746147150.996209:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff8801323d5880 x1830967308252288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:526/0 lens 488/440 e 0 to 0 dl 1746147161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147150.996352:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801323d5880 with x1830967308252288 ext(0->1048575) 00002000:00010000:0.0:1746147150.996356:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801323d5880 00000100:00100000:0.0:1746147151.015426:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.015554:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308253568 00000100:00100000:2.0:1746147151.015564:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308253568 00000100:00100000:2.0:1746147151.015621:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15211 00000100:00100000:2.0:1746147151.015629:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:32672:x1830967308253568:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147151.015649:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147151.015669:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d6d expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.015703:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.015711:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.015718:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.015719:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.015722:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1085440->1441791] (req 1085440->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.015751:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.015760:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 41 pid: 1854 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.015772:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310781184:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147151.016058:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.016068:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 17 pid: 1854 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.016077:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310781312:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147151.016151:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147151.022409:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310781184:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147151.025494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.025718:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.025770:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308253824 00000100:00100000:2.0:1746147151.025789:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308253824 00000100:00100000:0.0:1746147151.025795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147151.025838:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f54380 x1830967308253824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.025848:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967308253824 ext(1048576->2097151) 00002000:00010000:2.0:1746147151.025853:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f54380 00000100:00100000:3.0:1746147151.025938:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308254080 00000100:00100000:2.0:1746147151.025939:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308254336 00000100:00100000:2.0:1746147151.025942:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308254336 00000100:00100000:3.0:1746147151.025946:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308254080 00002000:00100000:2.0:1746147151.025956:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880129f55180 x1830967308254336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.025963:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967308254336 ext(1048576->2097151) 00002000:00010000:2.0:1746147151.025966:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55180 00000100:00100000:2.0:1746147151.025978:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3813 00002000:00100000:3.0:1746147151.025980:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880129f57480 x1830967308254080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147151.025985:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308253824:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147151.025996:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57480 with x1830967308254080 ext(1048576->2097151) 00010000:00010000:3.0:1746147151.026005:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 43 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746147151.026017:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 43 pid: 1854 timeout: 789 lvb_type: 1 00002000:00010000:3.0:1746147151.026023:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129f57480 00000100:00100000:3.0:1746147151.026042:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1200 00000100:00100000:3.0:1746147151.026049:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308254080:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147151.026500:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3814 00000100:00100000:0.0:1746147151.026508:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308254336:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147151.026538:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967310781312:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147151.026565:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1085440->1441791] (req 1085440->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 44 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.026578:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:1.0:1746147151.026619:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:32672:x1830967308253568:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10990us (11202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147151.026626:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15211 00000100:00100000:0.0:1746147151.032134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147151.032272:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308254464 00000100:00100000:3.0:1746147151.032284:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308254464 00010000:00010000:3.0:1746147151.032324:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 18 pid: 1854 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.032699:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308253824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6710us (7207us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147151.032710:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3813 00002000:00100000:2.0:1746147151.032722:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f54380 x1830967308253824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.032732:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967308253824 ext(1048576->2097151) 00002000:00010000:2.0:1746147151.032738:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f54380 00000100:00100000:3.0:1746147151.033215:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6742 00000100:00100000:3.0:1746147151.033224:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+18:2001:x1830967308254464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147151.033239:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147151.033258:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 18 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746147151.033270:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 18 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746147151.033290:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9be00/0x3139939425057d29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d0b expref: 18 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746147151.033323:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147151.033363:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+17:2001:x1830967308254464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 141us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.033369:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6742 00000100:00100000:3.0:1746147151.033460:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746147151.033471:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310781440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147151.033511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147151.033533:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310781440 00000100:00100000:0.0:1746147151.033539:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310781440 00000100:00100000:0.0:1746147151.033575:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1746147151.033581:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967310781440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147151.033612:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1167070272 pending 0 free 3904991232 avail 3673468928 00000100:00100000:1.0:1746147151.033663:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967310781440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147151.033671:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1746147151.033723:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147151.033730:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310781440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746147151.033734:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310781568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147151.033787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147151.033886:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310781568 00000100:00100000:1.0:1746147151.033891:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310781568 00000100:00100000:1.0:1746147151.033910:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1746147151.033915:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967310781568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746147151.033932:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1224995904 pending 8720384 free 3909718016 avail 3678195712 00000100:00100000:1.0:1746147151.033968:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967310781568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147151.033973:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1746147151.034002:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310781568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147151.037507:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147151.037653:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308254080:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11601us (11932us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147151.037664:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1200 00002000:00100000:3.0:1746147151.037675:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880129f57480 x1830967308254080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147151.037684:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57480 with x1830967308254080 ext(1048576->2097151) 00010000:00010000:3.0:1746147151.037693:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 41 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746147151.037707:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 41 pid: 1854 timeout: 789 lvb_type: 1 00002000:00010000:3.0:1746147151.037714:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129f57480 00000100:00100000:2.0:1746147151.037971:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308254720 00000100:00100000:2.0:1746147151.037978:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308254720 00000100:00100000:2.0:1746147151.038011:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15424 00000100:00100000:2.0:1746147151.038023:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+9:32679:x1830967308254720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147151.038038:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147151.038052:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094008000/0x3139939425057e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d74 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.038161:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094008400/0x3139939425057e25 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147151.038173:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094008400/0x3139939425057e25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147151.038184:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094008400/0x3139939425057e25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147151.038193:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147151.038274:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094008000/0x3139939425057e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d74 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.038296:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094008400/0x3139939425057e25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d74 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.038303:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147151.038305:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746147151.038307:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008400, rc 0) 00000100:00100000:2.0:1746147151.038327:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:90095e6f-8cef-455a-9171-4caf9b613254+11:32679:x1830967308254720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 311us (828us total) trans 8589936156 rc 0/0 00000100:00100000:2.0:1746147151.038332:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15424 00000100:00100000:1.0:1746147151.039236:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308254336:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12727us (13438us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147151.039244:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3814 00002000:00100000:1.0:1746147151.039250:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880129f55180 x1830967308254336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.039257:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967308254336 ext(1048576->2097151) 00002000:00010000:1.0:1746147151.039260:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55180 00000100:00100000:0.0:1746147151.041006:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.041329:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308254848 00000100:00100000:1.0:1746147151.041338:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308254848 00000100:00100000:1.0:1746147151.041395:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15212 00000100:00100000:1.0:1746147151.041402:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:32673:x1830967308254848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147151.041414:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147151.041429:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d7b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.041448:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147151.041453:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1085440->1441791] (req 1085440->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 42 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.041458:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147151.041461:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 42 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.041493:0:17600:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1085440->1441791] (req 1085440->1441791) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 42 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.041506:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 42 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.041513:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32200, rc 0) 00000100:00100000:1.0:1746147151.041558:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32673:x1830967308254848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 156us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147151.041564:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15212 00000100:00100000:0.0:1746147151.043044:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.043077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.043120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.043141:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308254976 00000100:00100000:0.0:1746147151.043146:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308254976 00000100:00100000:0.0:1746147151.043184:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255232 00000100:00100000:0.0:1746147151.043187:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255232 00000100:00100000:0.0:1746147151.043197:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255488 00000100:00100000:0.0:1746147151.043199:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255488 00000100:00100000:0.0:1746147151.043209:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15213 00000100:00100000:0.0:1746147151.043214:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+6:2002:x1830967308254976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147151.043224:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147151.043236:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098886400/0x3139939425057e3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d82 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147151.043251:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147151.043252:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147151.043260:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098886400/0x3139939425057e3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d82 expref: 7 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147151.043262:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15214 00000100:00100000:2.0:1746147151.043272:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15215 00000100:00100000:3.0:1746147151.043279:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+23:2002:x1830967308255232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147151.043279:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098886400/0x3139939425057e3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d82 expref: 7 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147151.043280:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967308255488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147151.043287:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147151.043287:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098886400, rc 0) 00010000:00010000:2.0:1746147151.043295:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094009e00/0x3139939425057e41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d9e expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.043299:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147151.043305:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.043307:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.043311:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094009e00/0x3139939425057e41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d9e expref: 8 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147151.043313:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308254976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 98us (272us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147151.043314:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d90 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147151.043318:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15213 00010000:00010000:2.0:1746147151.043320:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094009e00/0x3139939425057e41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d9e expref: 8 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.043327:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009e00, rc 0) 00010000:00010000:3.0:1746147151.043334:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.043344:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d90 expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147151.043344:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.043346:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967308255488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 68us (226us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147151.043354:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d90 expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147151.043355:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15215 00000100:00100000:2.0:1746147151.043366:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255104 00000100:00100000:2.0:1746147151.043369:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255104 00010000:00010000:3.0:1746147151.043374:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:0.0:1746147151.043378:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.043385:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255360 00000100:00100000:2.0:1746147151.043387:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255360 00000100:00100000:2.0:1746147151.043398:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15216 00000100:00100000:2.0:1746147151.043403:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308255104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147151.043409:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147151.043417:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308255232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 145us (339us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147151.043418:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094008200/0x3139939425057e4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d89 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147151.043423:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15214 00010000:00010000:2.0:1746147151.043427:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.043429:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.043433:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094008200/0x3139939425057e4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d89 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147151.043439:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15217 00010000:00010000:2.0:1746147151.043442:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094008200/0x3139939425057e4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d89 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147151.043445:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+7:2002:x1830967308255360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147151.043448:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008200, rc 0) 00010000:00010000:3.0:1746147151.043453:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147151.043453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147151.043463:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78d97 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147151.043463:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308255104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.043467:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15216 00010000:00010000:3.0:1746147151.043475:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147151.043476:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255616 00010000:00010000:3.0:1746147151.043477:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147151.043479:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255616 00010000:00010000:3.0:1746147151.043484:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147151.043494:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15218 00000100:00100000:2.0:1746147151.043498:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+24:2002:x1830967308255616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147151.043499:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.043504:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147151.043510:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425057e5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78da5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.043519:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.043520:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00010000:00010000:2.0:1746147151.043520:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.043524:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425057e5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78da5 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.043533:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425057e5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78da5 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.043540:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009a00, rc 0) 00000100:00100000:3.0:1746147151.043554:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308255360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 108us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.043557:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90095e6f-8cef-455a-9171-4caf9b613254+25:2002:x1830967308255616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 59us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.043560:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15217 00000100:00100000:2.0:1746147151.043564:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15218 00000100:00100000:0.0:1746147151.044180:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.044331:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255744 00000100:00100000:0.0:1746147151.044334:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255744 00010000:00010000:0.0:1746147151.044349:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 42 pid: 1854 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746147151.044375:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6743 00000100:00100000:0.0:1746147151.044380:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967308255744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147151.044388:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147151.044403:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 42 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746147151.044532:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 42 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746147151.044547:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a800/0x3139939425057dca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d43 expref: 42 pid: 1854 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746147151.044624:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147151.044626:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147151.044630:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147151.044637:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147151.044659:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147151.044669:0:8909:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746147151.044733:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310781824:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147151.044803:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147151.047922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.048002:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.048063:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308256000 00000100:00100000:1.0:1746147151.048070:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308256000 00000100:00100000:1.0:1746147151.048132:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15219 00000100:00100000:1.0:1746147151.048139:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:32672:x1830967308256000:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:2.0:1746147151.048149:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310781824:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147151.048155:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147151.048170:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78dac expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.048173:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147151.048194:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147151.048199:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 43 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.048205:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147151.048208:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1085440->1441791] (req 1085440->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 43 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147151.048232:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308255744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3849us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.048242:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6743 00000100:00100000:2.0:1746147151.048270:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308255872 00000100:00100000:2.0:1746147151.048275:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308255872 00010000:00010000:1.0:1746147151.048602:0:1398:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 43 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.048616:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [1085440->1441791] (req 1085440->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 43 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.048617:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 43 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746147151.048633:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32000, rc 0) 00000100:00100000:2.0:1746147151.048658:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6744 00000100:00100000:2.0:1746147151.048670:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967308255872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147151.048680:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:32672:x1830967308256000:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 541us (677us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147151.048681:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147151.048686:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15219 00010000:00010000:2.0:1746147151.048703:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 42 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.048749:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 42 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.048772:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425057e17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d6d expref: 42 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.048795:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.048797:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.048804:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.048810:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.048837:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.048847:0:8909:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746147151.048857:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310782080:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147151.048924:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147151.052901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.053153:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310782080:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147151.053171:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147151.053220:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967308255872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4553us (5302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.053229:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6744 00000100:00100000:0.0:1746147151.053926:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.054051:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308256256 00000100:00100000:1.0:1746147151.054057:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308256256 00002000:00100000:1.0:1746147151.054108:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098822300 x1830967308256256/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.054116:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822300 with x1830967308256256 ext(0->1048575) 00002000:00010000:1.0:1746147151.054120:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822300 00000100:00100000:3.0:1746147151.054126:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308256512 00000100:00100000:3.0:1746147151.054135:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308256512 00000100:00100000:1.0:1746147151.054137:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3815 00000100:00100000:1.0:1746147151.054144:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308256256:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147151.054172:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098821180 x1830967308256512/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147151.054181:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821180 with x1830967308256512 ext(1048576->2097151) 00002000:00010000:3.0:1746147151.054186:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821180 00000100:00100000:3.0:1746147151.054203:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3816 00000100:00100000:3.0:1746147151.054210:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308256512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147151.056912:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147151.057418:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308256768 00000100:00100000:3.0:1746147151.057427:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308256768 00002000:00100000:3.0:1746147151.057467:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098820380 x1830967308256768/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147151.057478:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967308256768 ext(1048576->2097151) 00010000:00010000:3.0:1746147151.057489:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746147151.057503:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746147151.057509:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098820380 00000100:00100000:3.0:1746147151.057544:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1201 00000100:00100000:3.0:1746147151.057551:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967308256768:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147151.064801:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+25:2003:x1830967308256512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10569us (10853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147151.064812:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3816 00002000:00100000:3.0:1746147151.064823:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098821180 x1830967308256512/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147151.064831:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821180 with x1830967308256512 ext(1048576->2097151) 00002000:00010000:3.0:1746147151.064838:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821180 00000100:00100000:1.0:1746147151.065082:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308256256:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10936us (12186us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147151.065111:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3815 00002000:00100000:1.0:1746147151.065116:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x8c:0x0] (0->1048575) req@ffff880098822300 x1830967308256256/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.065129:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822300 with x1830967308256256 ext(0->1048575) 00002000:00010000:1.0:1746147151.065133:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822300 00000100:00100000:3.0:1746147151.068415:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967308256768:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10857us (11502us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147151.068425:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1201 00002000:00100000:3.0:1746147151.068435:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880098820380 x1830967308256768/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147151.068444:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967308256768 ext(1048576->2097151) 00010000:00010000:3.0:1746147151.068452:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746147151.068466:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746147151.068472:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098820380 00000100:00100000:0.0:1746147151.075944:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.076035:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308256896 00000100:00100000:2.0:1746147151.076043:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308256896 00010000:00010000:2.0:1746147151.076074:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746147151.076134:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6745 00000100:00100000:2.0:1746147151.076145:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967308256896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147151.076157:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147151.076174:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.076185:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.076204:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x3139939425057e33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d7b expref: 41 pid: 17600 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.076233:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.076235:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.076241:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.076253:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.076282:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147151.076293:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310782208:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147151.076374:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147151.079173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.079255:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308257024 00000100:00100000:2.0:1746147151.079262:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308257024 00000100:00100000:0.0:1746147151.080859:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.080905:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308257280 00000100:00100000:0.0:1746147151.080911:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308257280 00002000:00100000:0.0:1746147151.080959:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1085440->1089535) req@ffff880098822d80 x1830967308257280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147151.080968:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822d80 with x1830967308257280 ext(1085440->1089535) 00002000:00010000:0.0:1746147151.080974:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098822d80 00000100:00100000:2.0:1746147151.081046:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15220 00000100:00100000:2.0:1746147151.081056:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967308257024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147151.081070:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147151.081086:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425057e6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78db3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147151.081156:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310782336:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147151.081239:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c9c600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147151.081635:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310782208:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147151.081647:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147151.081669:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967308256896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5528us (5732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.081676:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6745 00000100:00100000:0.0:1746147151.081889:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3817 00000100:00100000:0.0:1746147151.081896:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308257280:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147151.082028:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308257280:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 130us (1173us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147151.082036:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3817 00002000:00100000:1.0:1746147151.082042:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1085440->1089535) req@ffff880098822d80 x1830967308257280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.082049:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822d80 with x1830967308257280 ext(1085440->1089535) 00002000:00010000:1.0:1746147151.082052:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098822d80 00000100:00100000:0.0:1746147151.083479:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.083671:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308257408 00000100:00100000:1.0:1746147151.083678:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308257408 00000100:00100000:1.0:1746147151.083725:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15221 00000100:00100000:1.0:1746147151.083731:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+25:32679:x1830967308257408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147151.083745:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147151.083757:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78dba expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.083792:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 41 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.083799:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147151.083801:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147151.083803:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 26 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.083832:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 41 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.083843:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 41 pid: 1398 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746147151.083854:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310782464:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147151.083938:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147151.086458:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310782336:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147151.086485:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425057e6b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78db3 expref: 41 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.086498:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094008e00/0x3139939425057e6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78db3 expref: 41 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.086530:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094008e00, rc 0) 00000100:00100000:2.0:1746147151.086569:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967308257024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5515us (7402us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147151.086577:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15220 00000100:00100000:0.0:1746147151.095149:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.095560:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308257664 00000100:00100000:1.0:1746147151.095569:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308257664 00002000:00100000:1.0:1746147151.095617:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1437696->1441791) req@ffff880098823b80 x1830967308257664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.095627:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823b80 with x1830967308257664 ext(1437696->1441791) 00010000:00010000:1.0:1746147151.095637:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746147151.095650:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746147151.095656:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098823b80 00000100:00100000:1.0:1746147151.096072:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1202 00000100:00100000:1.0:1746147151.096081:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308257664:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147151.096270:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967310782464:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147151.096301:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 26 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.096315:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe000, rc 0) 00000100:00100000:1.0:1746147151.096454:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308257664:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 373us (1317us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147151.096464:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1202 00002000:00100000:1.0:1746147151.096470:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (1437696->1441791) req@ffff880098823b80 x1830967308257664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746147162 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.096477:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823b80 with x1830967308257664 ext(1437696->1441791) 00010000:00010000:1.0:1746147151.096482:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746147151.096492:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 40 pid: 1398 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746147151.096497:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098823b80 00000100:00100000:2.0:1746147151.096724:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:90095e6f-8cef-455a-9171-4caf9b613254+26:32679:x1830967308257408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 12990us (13248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.096732:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15221 00000100:00100000:0.0:1746147151.098900:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.098960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.099115:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308257920 00000100:00100000:1.0:1746147151.099125:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308257920 00000100:00100000:0.0:1746147151.099130:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.099145:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308258560 00000100:00100000:2.0:1746147151.099146:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308258432 00000100:00100000:0.0:1746147151.099148:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308258560 00000100:00100000:2.0:1746147151.099156:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308258432 00002000:00100000:1.0:1746147151.099168:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098821880 x1830967308257920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147151.099168:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880098820a80 x1830967308258560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.099177:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821880 with x1830967308257920 ext(2097152->4194303) 00002000:00100000:0.0:1746147151.099177:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820a80 with x1830967308258560 ext(2097152->4194303) 00002000:00010000:1.0:1746147151.099183:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821880 00002000:00010000:0.0:1746147151.099183:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820a80 00000100:00100000:2.0:1746147151.099423:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5568 00000100:00100000:2.0:1746147151.099431:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32672:x1830967308258432:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147151.099527:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3818 00000100:00100000:0.0:1746147151.099531:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3819 00000100:00100000:1.0:1746147151.099534:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308257920:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147151.099536:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967308258560:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147151.099765:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32672:x1830967308258432:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 334us (803us total) trans 8589936157 rc 0/0 00000100:00100000:2.0:1746147151.099771:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5568 00000100:00100000:2.0:1746147151.099840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.103150:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308258176 00000100:00100000:2.0:1746147151.103161:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308258176 00002000:00100000:2.0:1746147151.103198:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1085440->1441791) req@ffff880096cfa300 x1830967308258176/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.103213:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa300 with x1830967308258176 ext(1085440->1441791) 00010000:00010000:2.0:1746147151.103221:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 42 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.103234:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 42 pid: 1398 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746147151.103240:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cfa300 00000100:00100000:2.0:1746147151.103257:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1203 00000100:00100000:2.0:1746147151.103264:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308258176:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147151.115277:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967308258176:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12005us (15428us total) trans 21474841574 rc 0/0 00000100:00100000:2.0:1746147151.115288:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1203 00002000:00100000:2.0:1746147151.115299:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1085440->1441791) req@ffff880096cfa300 x1830967308258176/t21474841574(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/448 e 0 to 0 dl 1746147162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.115307:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa300 with x1830967308258176 ext(1085440->1441791) 00010000:00010000:2.0:1746147151.115316:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 44 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746147151.115329:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 44 pid: 1398 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746147151.115336:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cfa300 00000100:00100000:1.0:1746147151.117670:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967308258560:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18116us (18523us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147151.117686:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3819 00002000:00100000:1.0:1746147151.117701:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880098820a80 x1830967308258560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.117716:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820a80 with x1830967308258560 ext(2097152->4194303) 00002000:00010000:1.0:1746147151.117723:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820a80 00000001:00080000:0.0:1746147151.125762:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841574 is committed 00000001:00080000:0.0:1746147151.125789:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841573 is committed 00000001:00080000:0.0:1746147151.125807:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841565 is committed 00000001:00080000:0.0:1746147151.125829:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841553 is committed 00000100:00100000:0.0:1746147151.127282:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.128524:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967308257920:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28985us (29627us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147151.128537:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3818 00002000:00100000:1.0:1746147151.128549:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff880098821880 x1830967308257920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.128558:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821880 with x1830967308257920 ext(2097152->4194303) 00002000:00010000:1.0:1746147151.128565:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821880 00000100:00100000:3.0:1746147151.128648:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308258816 00000100:00100000:3.0:1746147151.128657:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308258816 00010000:00010000:3.0:1746147151.128688:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 22 pid: 1398 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746147151.128714:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6746 00000100:00100000:3.0:1746147151.128721:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308258816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147151.128735:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147151.128751:0:8909:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147150 -> 1746147151 00002000:00010000:3.0:1746147151.128754:0:8909:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147150 -> 1746147151 00010000:00010000:3.0:1746147151.128759:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 22 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746147151.128771:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 22 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746147151.128804:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32000/0x3139939425057e64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1441791) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dac expref: 22 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746147151.128823:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.128826:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.128833:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 7 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.128841:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 7 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.128875:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 7 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147151.128888:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310782592:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147151.128972:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147151.141482:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.141535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.141587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.141658:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308259328 00000100:00100000:1.0:1746147151.141669:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308259456 00000100:00100000:0.0:1746147151.141669:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308259328 00000100:00100000:1.0:1746147151.141687:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308259456 00002000:00100000:0.0:1746147151.141734:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880095237b80 x1830967308259328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.141743:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880095234a80 x1830967308259456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147151.141747:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237b80 with x1830967308259328 ext(1048576->2097151) 00002000:00010000:0.0:1746147151.141753:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237b80 00002000:00100000:1.0:1746147151.141754:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234a80 with x1830967308259456 ext(1048576->2097151) 00002000:00010000:1.0:1746147151.141759:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234a80 00000100:00100000:0.0:1746147151.141799:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3820 00000100:00100000:0.0:1746147151.141810:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308259328:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147151.141811:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3821 00000100:00100000:1.0:1746147151.141818:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308259456:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147151.143642:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967310782592:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147151.143668:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147151.143705:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967308258816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 14983us (16428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.143715:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6746 00000100:00100000:2.0:1746147151.143874:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308258944 00000100:00100000:2.0:1746147151.143883:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308258944 00000100:00100000:2.0:1746147151.143916:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15222 00000100:00100000:2.0:1746147151.143922:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967308258944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147151.143937:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147151.143960:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78dc1 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.143983:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.143985:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.143995:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 22 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.144012:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 22 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147151.144023:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094009000, rc 0) 00000100:00100000:2.0:1746147151.144063:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308258944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 141us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.144068:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15222 00000100:00100000:0.0:1746147151.155872:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147151.156054:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308259712 00000100:00100000:1.0:1746147151.156065:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308259712 00002000:00100000:1.0:1746147151.156148:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095235500 x1830967308259712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.156159:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235500 with x1830967308259712 ext(4194304->4919295) 00002000:00010000:1.0:1746147151.156165:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095235500 00000100:00100000:1.0:1746147151.156203:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3822 00000100:00100000:1.0:1746147151.156212:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308259712:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147151.158409:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308259328:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16590us (16863us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147151.158421:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3820 00002000:00100000:2.0:1746147151.158432:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (1048576->2097151) req@ffff880095237b80 x1830967308259328/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.158441:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237b80 with x1830967308259328 ext(1048576->2097151) 00002000:00010000:2.0:1746147151.158447:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237b80 00000100:00100000:1.0:1746147151.159661:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308259456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17835us (18065us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147151.159670:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3821 00002000:00100000:1.0:1746147151.159679:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->2097151) req@ffff880095234a80 x1830967308259456/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.159687:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234a80 with x1830967308259456 ext(1048576->2097151) 00002000:00010000:1.0:1746147151.159691:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234a80 00000100:00100000:1.0:1746147151.162625:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308259712:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6406us (6757us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746147151.162635:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3822 00002000:00100000:1.0:1746147151.162644:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880095235500 x1830967308259712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.162652:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095235500 with x1830967308259712 ext(4194304->4919295) 00002000:00010000:1.0:1746147151.162657:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095235500 00000100:00100000:0.0:1746147151.169901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147151.170017:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308259840 00000100:00100000:3.0:1746147151.170032:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308259840 00000100:00100000:3.0:1746147151.170152:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15223 00000100:00100000:3.0:1746147151.170162:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:32676:x1830967308259840:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147151.170183:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147151.170201:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78dc8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.170228:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147151.170231:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147151.170236:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 21 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.170242:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.170244:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.170248:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc8 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.170276:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 21 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147151.170276:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308260096 00000100:00100000:0.0:1746147151.170283:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308260096 00010000:00010000:3.0:1746147151.170286:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 21 pid: 1398 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.170297:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310782720:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147151.170323:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5569 00000100:00100000:0.0:1746147151.170331:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32673:x1830967308260096:12345-192.168.204.25@tcp:35:cat.0 00010000:00010000:3.0:1746147151.170410:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.170418:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746147151.170425:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310782848:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147151.170444:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147151.170559:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32673:x1830967308260096:12345-192.168.204.25@tcp:35:cat.0 Request processed in 227us (326us total) trans 8589936158 rc 0/0 00000100:00100000:0.0:1746147151.170669:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5569 00000100:00100000:3.0:1746147151.174493:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310782720:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147151.174505:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310782848:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147151.174531:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc8 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.174548:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:3.0:1746147151.174602:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+9:32676:x1830967308259840:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4441us (4716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.174611:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15223 00000100:00100000:0.0:1746147151.175039:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147151.175111:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308260224 00000100:00100000:3.0:1746147151.175117:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308260224 00010000:00010000:3.0:1746147151.175140:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 22 pid: 1398 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.175168:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6747 00000100:00100000:3.0:1746147151.175174:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967308260224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147151.175185:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147151.175202:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 22 pid: 1398 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746147151.175212:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 22 pid: 1398 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746147151.175217:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147151.175232:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094009000/0x3139939425057e79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc1 expref: 22 pid: 1398 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746147151.175240:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308260352 00000100:00100000:1.0:1746147151.175245:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308260352 00010000:00010000:3.0:1746147151.175259:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147151.175271:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746147151.175280:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967308260224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.175286:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6747 00000100:00100000:1.0:1746147151.175303:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6748 00000100:00100000:1.0:1746147151.175310:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308260352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147151.175325:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147151.175339:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746147151.176358:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746147151.176386:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425057e72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dba expref: 9 pid: 1398 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746147151.176419:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147151.176421:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147151.176429:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc8 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.176439:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc8 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147151.176479:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc8 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147151.176494:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310782976:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147151.176595:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147151.183156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.183256:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308260608 00000100:00100000:2.0:1746147151.183267:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308260608 00002000:00100000:2.0:1746147151.183320:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->1724415) req@ffff880098859180 x1830967308260608/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.183330:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859180 with x1830967308260608 ext(1720320->1724415) 00002000:00010000:2.0:1746147151.183336:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098859180 00000100:00100000:2.0:1746147151.183358:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3823 00000100:00100000:2.0:1746147151.183366:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+9:2001:x1830967308260608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147151.183478:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967310782976:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147151.183500:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147151.183543:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:90095e6f-8cef-455a-9171-4caf9b613254+9:2000:x1830967308260352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8232us (8325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147151.183552:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6748 00000100:00100000:2.0:1746147151.183768:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967308260608:12345-192.168.204.25@tcp:3:cat.0 Request processed in 401us (620us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147151.183782:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3823 00002000:00100000:2.0:1746147151.183788:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->1724415) req@ffff880098859180 x1830967308260608/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.183795:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859180 with x1830967308260608 ext(1720320->1724415) 00002000:00010000:2.0:1746147151.183798:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098859180 00000100:00100000:0.0:1746147151.188497:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147151.188536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.188598:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308260864 00000100:00100000:2.0:1746147151.188607:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308260864 00000100:00100000:0.0:1746147151.188618:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147151.188653:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009885ad80 x1830967308260864/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.188663:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885ad80 with x1830967308260864 ext(2097152->4194303) 00002000:00010000:2.0:1746147151.188669:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885ad80 00000100:00100000:2.0:1746147151.188686:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308261120 00000100:00100000:2.0:1746147151.188687:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308261120 00000100:00100000:1.0:1746147151.188693:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3824 00002000:00100000:2.0:1746147151.188696:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880098859f80 x1830967308261120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.188702:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859f80 with x1830967308261120 ext(2097152->4194303) 00002000:00010000:2.0:1746147151.188705:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098859f80 00000100:00100000:1.0:1746147151.188705:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308260864:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147151.188719:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3825 00000100:00100000:2.0:1746147151.188724:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308261120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147151.189143:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308261248 00000100:00100000:3.0:1746147151.189156:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308261248 00000100:00100000:3.0:1746147151.189211:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15224 00000100:00100000:3.0:1746147151.189220:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:32676:x1830967308261248:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147151.189238:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147151.189257:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78dcf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.189282:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.189290:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.189297:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 24 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.189303:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.189304:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147151.189307:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [1048576->1503231] (req 1048576->1503231) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dcf expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.189339:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 24 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.189352:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 24 pid: 12201 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.189363:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310783104:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147151.189449:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.189461:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 11 pid: 9585 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.189468:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310783232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147151.189490:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147151.189496:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 14 pid: 1136 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.189503:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310783360:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147151.189516:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147151.196623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.196643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.196668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.196695:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308261376 00000100:00100000:2.0:1746147151.196704:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308261376 00010000:00010000:2.0:1746147151.196741:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 25 pid: 12201 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.196765:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308261504 00000100:00100000:2.0:1746147151.196767:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308261504 00010000:00010000:2.0:1746147151.196786:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 15 pid: 1136 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.196798:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308261632 00000100:00100000:2.0:1746147151.196800:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308261632 00010000:00010000:2.0:1746147151.196808:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 12 pid: 9585 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.196828:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6749 00000100:00100000:2.0:1746147151.196835:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308261376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147151.196848:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147151.196867:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 25 pid: 12201 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746147151.196882:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 25 pid: 12201 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746147151.196905:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147151.196947:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308261376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.196953:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6749 00000100:00100000:2.0:1746147151.196965:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6750 00000100:00100000:2.0:1746147151.196969:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308261504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147151.196975:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147151.196980:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 15 pid: 1136 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746147151.196986:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 15 pid: 1136 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746147151.196995:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147151.197005:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+15:2000:x1830967308261504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.197008:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6750 00000100:00100000:2.0:1746147151.197014:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6751 00000100:00100000:2.0:1746147151.197018:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:2001:x1830967308261632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147151.197023:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147151.197027:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 12 pid: 9585 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746147151.197035:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 12 pid: 9585 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746147151.197044:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.197046:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147151.197053:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dcf expref: 12 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.197060:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dcf expref: 12 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147151.197109:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dcf expref: 12 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147151.197120:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310783488:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147151.197162:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x3139939425057dd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d4a expref: 24 pid: 12201 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746147151.197163:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c9c780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147151.197184:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310783104:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147151.197195:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x3139939425057e56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d97 expref: 12 pid: 9585 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.197204:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310783232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147151.197212:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x3139939425057d1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d12 expref: 14 pid: 1136 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746147151.197225:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967310783360:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147151.197248:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dcf expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147151.197257:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94e00, rc 0) 00000100:00100000:3.0:1746147151.197294:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+11:32676:x1830967308261248:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8075us (8674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147151.197302:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15224 00000100:00100000:1.0:1746147151.202760:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90095e6f-8cef-455a-9171-4caf9b613254+9:2002:x1830967308260864:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14045us (14260us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147151.202773:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3824 00002000:00100000:1.0:1746147151.202795:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8f:0x0] (2097152->4194303) req@ffff88009885ad80 x1830967308260864/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147151.202805:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885ad80 with x1830967308260864 ext(2097152->4194303) 00002000:00010000:1.0:1746147151.202811:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885ad80 00000100:00100000:2.0:1746147151.204982:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967310783488:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147151.205002:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147151.205052:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90095e6f-8cef-455a-9171-4caf9b613254+8:2001:x1830967308261632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8031us (8382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147151.205063:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6751 00000100:00100000:2.0:1746147151.205423:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2002:x1830967308261120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16689us (16876us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147151.205435:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3825 00002000:00100000:2.0:1746147151.205445:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8e:0x0] (2097152->4194303) req@ffff880098859f80 x1830967308261120/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.205454:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859f80 with x1830967308261120 ext(2097152->4194303) 00002000:00010000:2.0:1746147151.205459:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098859f80 00000100:00100000:0.0:1746147151.205579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.205748:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308261888 00000100:00100000:2.0:1746147151.205756:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308261888 00002000:00100000:2.0:1746147151.205797:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1499136->1503231) req@ffff88009885a300 x1830967308261888/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.205804:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885a300 with x1830967308261888 ext(1499136->1503231) 00002000:00010000:2.0:1746147151.205808:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885a300 00000100:00100000:2.0:1746147151.205832:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3826 00000100:00100000:2.0:1746147151.205839:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308261888:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147151.206004:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2000:x1830967308261888:12345-192.168.204.25@tcp:3:cat.0 Request processed in 165us (425us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147151.206011:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3826 00002000:00100000:2.0:1746147151.206016:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8e:0x0] (1499136->1503231) req@ffff88009885a300 x1830967308261888/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.206022:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885a300 with x1830967308261888 ext(1499136->1503231) 00002000:00010000:2.0:1746147151.206025:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885a300 00000100:00100000:0.0:1746147151.208044:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.208138:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308262144 00000100:00100000:2.0:1746147151.208147:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308262144 00000100:00100000:2.0:1746147151.208204:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5570 00000100:00100000:2.0:1746147151.208211:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+11:32676:x1830967308262144:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147151.208405:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:32676:x1830967308262144:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 193us (367us total) trans 8589936159 rc 0/0 00000100:00100000:2.0:1746147151.208414:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5570 00000100:00100000:1.0:1746147151.211675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147151.211864:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308262400 00000100:00100000:2.0:1746147151.211873:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308262400 00002000:00100000:2.0:1746147151.211914:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094e5a300 x1830967308262400/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/0 e 0 to 0 dl 1746147162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.211923:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e5a300 with x1830967308262400 ext(4194304->4919295) 00002000:00010000:2.0:1746147151.211928:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e5a300 00000100:00100000:2.0:1746147151.211958:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3827 00000100:00100000:2.0:1746147151.211964:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308262400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147151.217574:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308262400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5595us (5893us total) trans 0 rc 724992/724992 00000100:00100000:2.0:1746147151.217587:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3827 00002000:00100000:2.0:1746147151.217599:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x8f:0x0] (4194304->4919295) req@ffff880094e5a300 x1830967308262400/t0(0) o3->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:527/0 lens 488/440 e 0 to 0 dl 1746147162 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147151.217607:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e5a300 with x1830967308262400 ext(4194304->4919295) 00002000:00010000:2.0:1746147151.217614:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e5a300 00010000:00010000:1.0:1746147151.653345:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.042979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.043021:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.043066:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308262528 00000100:00100000:2.0:1746147152.043078:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308262528 00002000:00100000:2.0:1746147152.043175:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->2097151) req@ffff88009885b480 x1830967308262528/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:528/0 lens 488/0 e 0 to 0 dl 1746147163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147152.043184:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308262656 00002000:00100000:2.0:1746147152.043185:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b480 with x1830967308262528 ext(1720320->2097151) 00000100:00100000:1.0:1746147152.043189:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308262656 00002000:00010000:2.0:1746147152.043191:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009885b480 00000100:00100000:2.0:1746147152.043213:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3828 00002000:00100000:1.0:1746147152.043213:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1503231) req@ffff88009885a680 x1830967308262656/t0(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:528/0 lens 488/0 e 0 to 0 dl 1746147163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147152.043221:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885a680 with x1830967308262656 ext(1048576->1503231) 00000100:00100000:2.0:1746147152.043223:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308262528:12345-192.168.204.25@tcp:4:cat.0 00002000:00010000:1.0:1746147152.043225:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885a680 00000100:00100000:1.0:1746147152.043245:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3829 00000100:00100000:1.0:1746147152.043250:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+8:2003:x1830967308262656:12345-192.168.204.25@tcp:4:cat.0 00000100:00080000:0.0:1746147152.043552:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147152.043556:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147152.051684:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308262528:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8451us (8699us total) trans 21474841575 rc 0/0 00000100:00100000:2.0:1746147152.052283:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3828 00002000:00100000:2.0:1746147152.052298:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (1720320->2097151) req@ffff88009885b480 x1830967308262528/t21474841575(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:528/0 lens 488/448 e 0 to 0 dl 1746147163 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147152.052308:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b480 with x1830967308262528 ext(1720320->2097151) 00002000:00010000:2.0:1746147152.052314:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009885b480 00000100:00100000:1.0:1746147152.052356:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:90095e6f-8cef-455a-9171-4caf9b613254+10:2003:x1830967308262656:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9104us (9332us total) trans 17179874319 rc 0/0 00000100:00100000:1.0:1746147152.052364:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3829 00002000:00100000:1.0:1746147152.052371:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x8e:0x0] (1048576->1503231) req@ffff88009885a680 x1830967308262656/t17179874319(0) o4->90095e6f-8cef-455a-9171-4caf9b613254@192.168.204.25@tcp:528/0 lens 488/448 e 0 to 0 dl 1746147163 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147152.052379:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885a680 with x1830967308262656 ext(1048576->1503231) 00002000:00010000:1.0:1746147152.052383:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885a680 00000100:00100000:0.0:1746147152.064935:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.065059:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308262912 00000100:00100000:2.0:1746147152.065069:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308262912 00000100:00100000:2.0:1746147152.065166:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5571 00000100:00100000:2.0:1746147152.065176:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+12:32704:x1830967308262912:12345-192.168.204.25@tcp:35:umount.0 00000100:00080000:0.0:1746147152.065295:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147152.065531:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90095e6f-8cef-455a-9171-4caf9b613254+13:32704:x1830967308262912:12345-192.168.204.25@tcp:35:umount.0 Request processed in 355us (605us total) trans 8589936160 rc 0/0 00000100:00100000:2.0:1746147152.065539:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5571 00000100:00100000:0.0:1746147152.069593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.069633:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.069675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.069939:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308263168 00000100:00100000:2.0:1746147152.069949:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308263168 00000100:00100000:2.0:1746147152.069998:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308263040 00000100:00100000:2.0:1746147152.070001:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308263040 00000100:00100000:2.0:1746147152.070013:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308263296 00000100:00100000:2.0:1746147152.070015:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308263296 00000100:00100000:2.0:1746147152.070029:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 836 00000100:00100000:2.0:1746147152.070037:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+17:2000:x1830967308263168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.070052:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.070074:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f38f000/0x313993942504c6ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e72507 expref: 17 pid: 8099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.070127:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147152.070172:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+16:2000:x1830967308263168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 135us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.070178:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 836 00000100:00100000:2.0:1746147152.070192:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 837 00000100:00100000:2.0:1746147152.070197:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2000:x1830967308263040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.070205:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.070213:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880096d90600/0x313993942504c6f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e724d6 expref: 15 pid: 8098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.070219:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147152.070232:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+14:2000:x1830967308263040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 35us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.070237:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 837 00000100:00100000:2.0:1746147152.070245:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 838 00000100:00100000:2.0:1746147152.070249:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+13:2000:x1830967308263296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.070255:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.070262:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f38ec00/0x313993942504c706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7250e expref: 13 pid: 8099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.070268:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147152.070905:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.071748:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+12:2000:x1830967308263296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1492us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.071756:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 838 00000100:00100000:3.0:1746147152.072000:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308263808 00000100:00100000:3.0:1746147152.072007:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308263808 00000100:00100000:3.0:1746147152.072044:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15225 00000100:00100000:3.0:1746147152.072050:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:1999:x1830967308263808:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:3.0:1746147152.072076:0:9586:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c722 00000020:00010000:3.0:1746147152.072083:0:9586:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a0d99000: total 0 00000100:00080000:3.0:1746147152.072087:0:9586:0:(import.c:66:import_set_state_nolock()) ffff8800a0d9d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147152.072237:0:9586:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874319 00000100:00100000:3.0:1746147152.072365:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:1999:x1830967308263808:12345-192.168.204.25@tcp:9:umount.0 Request processed in 314us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.072370:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15225 00000020:00010000:1.0:1746147152.072527:0:7228:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a0d99000: total 0 00010000:00010000:1.0:1746147152.072567:0:7228:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a0d99000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746147152.072612:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098886400/0x3139939425057e3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d82 expref: 7 pid: 1854 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746147152.072644:0:7228:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.072647:0:7228:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147150 -> 1746147151 00010000:00010000:1.0:1746147152.072656:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94e00/0x3139939425057e87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dcf expref: 6 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.072683:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094009e00/0x3139939425057e41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d9e expref: 5 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147152.072692:0:7228:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a0d99000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746147152.072707:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147152.072709:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147152.072710:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.085597:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.085726:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308264320 00000100:00100000:3.0:1746147152.085736:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308264320 00000100:00100000:3.0:1746147152.085844:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15226 00000100:00100000:3.0:1746147152.085853:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+10:1999:x1830967308264320:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:3.0:1746147152.085888:0:9586:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c71b 00000020:00010000:3.0:1746147152.085899:0:9586:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a0d9f000: total 0 00000100:00080000:3.0:1746147152.085904:0:9586:0:(import.c:66:import_set_state_nolock()) ffff8800a0d9b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147152.085958:0:9586:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841575 00000100:00100000:3.0:1746147152.086143:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90095e6f-8cef-455a-9171-4caf9b613254+8:1999:x1830967308264320:12345-192.168.204.25@tcp:9:umount.0 Request processed in 290us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.086151:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15226 00000020:00010000:2.0:1746147152.086218:0:12215:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a0d9f000: total 0 00010000:00010000:2.0:1746147152.086263:0:12215:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a0d9f000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746147152.086315:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094008200/0x3139939425057e4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d89 expref: 7 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.086349:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057e80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dc8 expref: 6 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.086374:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094009a00/0x3139939425057e5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78da5 expref: 5 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.086383:0:12215:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a0d9f000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746147152.086395:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147152.086397:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147152.086398:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.099183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.099284:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308264704 00000100:00100000:2.0:1746147152.099294:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308264704 00000100:00100000:2.0:1746147152.099673:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15425 00000100:00100000:2.0:1746147152.099681:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+13:1999:x1830967308264704:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:2.0:1746147152.099718:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c70d 00000020:00010000:2.0:1746147152.099734:0:9138:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a4662800: total 0 00000100:00080000:2.0:1746147152.099739:0:9138:0:(import.c:66:import_set_state_nolock()) ffff8800a4660000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147152.099777:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936160 00000020:00010000:3.0:1746147152.099867:0:10927:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a4662800: total 0 00010000:00010000:3.0:1746147152.099871:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147152.099924:0:10927:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a4662800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1746147152.099956:0:10927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147152.099959:0:10927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746147152.099966:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fe00/0x313993942504c7e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e725cb expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.099992:0:10927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147152.099994:0:10927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147152.099997:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425057e09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d66 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.100007:0:10927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147152.100009:0:10927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746147152.100011:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b64a800/0x313993942505004f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e74521 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.100022:0:10927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147152.100024:0:10927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147152.100027:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094008400/0x3139939425057e25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d74 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.100036:0:10927:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a4662800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1746147152.100046:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147152.100048:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147152.100049:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147152.100291:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+7:1999:x1830967308264704:12345-192.168.204.25@tcp:39:umount.0 Request processed in 601us (1111us total) trans 8589936161 rc 0/0 00000100:00100000:2.0:1746147152.100302:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15425 00000100:00100000:0.0:1746147152.109663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.109790:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308264832 00000100:00100000:2.0:1746147152.109801:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308264832 00000100:00100000:2.0:1746147152.109971:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15426 00000100:00100000:2.0:1746147152.109981:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+5:1999:x1830967308264832:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:2.0:1746147152.110017:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c714 00000100:00080000:2.0:1746147152.110027:0:9138:0:(import.c:66:import_set_state_nolock()) ffff8800a4661000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147152.110053:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977417 00010000:00010000:1.0:1746147152.110065:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746147152.110125:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147152.110489:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90095e6f-8cef-455a-9171-4caf9b613254+3:1999:x1830967308264832:12345-192.168.204.25@tcp:39:umount.0 Request processed in 507us (835us total) trans 4294977418 rc 0/0 00000100:00100000:2.0:1746147152.110496:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15426 00000100:00100000:0.0:1746147152.507551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.507585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.507605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.507644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.507668:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308265984 00000100:00100000:1.0:1746147152.507670:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308264960 00000100:00100000:0.0:1746147152.507677:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308265984 00000100:00100000:1.0:1746147152.507679:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308264960 00000100:00100000:0.0:1746147152.507719:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15227 00000100:00100000:0.0:1746147152.507726:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+14:1999:x1830967308265984:12345-192.168.204.25@tcp:9:umount.0 00000100:00100000:1.0:1746147152.507730:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308265216 00000100:00100000:1.0:1746147152.507732:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308265216 00000100:00100000:1.0:1746147152.507744:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308265088 00000100:00100000:1.0:1746147152.507746:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308265088 00000020:00000080:0.0:1746147152.507767:0:1398:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c753 00000020:00010000:0.0:1746147152.507774:0:1398:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a4667000: total 0 00000100:00100000:1.0:1746147152.507776:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 839 00000100:00080000:0.0:1746147152.507778:0:1398:0:(import.c:66:import_set_state_nolock()) ffff8800a4666800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1746147152.507783:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+14:2000:x1830967308264960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147152.507796:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147152.507813:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880096d9a400/0x313993942504c729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7253f expref: 14 pid: 8098 timeout: 0 lvb_type: 0 00000001:00000004:0.0:1746147152.507819:0:1398:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874319 00000100:00100000:0.0:1746147152.507952:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+12:1999:x1830967308265984:12345-192.168.204.25@tcp:9:umount.0 Request processed in 224us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.507958:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15227 00000100:00100000:3.0:1746147152.507968:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 840 00000100:00100000:3.0:1746147152.507976:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+13:2000:x1830967308265216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147152.507983:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147152.507986:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 841 00010000:00010000:3.0:1746147152.507991:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f38e800/0x313993942504c737 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e72577 expref: 13 pid: 8099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.507993:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+13:2000:x1830967308265088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147152.508003:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147152.508004:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147152.508018:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880096d9b600/0x313993942504c730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e72570 expref: 12 pid: 8098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.508037:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.508051:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+11:2000:x1830967308265216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.508054:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+11:2000:x1830967308265088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.508057:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 840 00000100:00100000:0.0:1746147152.508062:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 841 00000100:00080000:0.0:1746147152.508080:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1746147152.508136:0:7228:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a4667000: total 0 00010000:00010000:0.0:1746147152.508155:0:7228:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a4667000, canceled 0 locks, left on hash table 5. 00010000:00010000:0.0:1746147152.508194:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425057d30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d19 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147152.508212:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x313993942504d84e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3670016->3911679) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e72e5a expref: 10 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.508229:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147152.508233:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7400/0x313993942504f3ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 6578176->6655999) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e73dc6 expref: 9 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.508250:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+9:2000:x1830967308264960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 467us (709us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147152.508250:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db32a00/0x313993942504fe49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e743ed expref: 8 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.508256:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 839 00010000:00010000:0.0:1746147152.508267:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x3139939425057d0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78cfd expref: 7 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147152.508276:0:7228:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a4667000, canceled 5 locks, left on hash table 0. 00010000:00010000:0.0:1746147152.508284:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147152.508285:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147152.508286:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.513919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.514140:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308266624 00000100:00100000:3.0:1746147152.514153:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308266624 00000100:00100000:3.0:1746147152.514217:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15228 00000100:00100000:3.0:1746147152.514225:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+9:1999:x1830967308266624:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:3.0:1746147152.514254:0:9586:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c74c 00000020:00010000:3.0:1746147152.514260:0:9586:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880099036800: total 0 00000100:00080000:3.0:1746147152.514264:0:9586:0:(import.c:66:import_set_state_nolock()) ffff880099032800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147152.514311:0:9586:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841575 00000100:00100000:3.0:1746147152.514435:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+7:1999:x1830967308266624:12345-192.168.204.25@tcp:9:umount.0 Request processed in 210us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.514441:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15228 00000100:00080000:1.0:1746147152.514612:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1746147152.514821:0:12215:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880099036800: total 0 00010000:00010000:2.0:1746147152.514856:0:12215:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880099036800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1746147152.514897:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ce00/0x3139939425057d22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d20 expref: 6 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.514920:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c600/0x3139939425057d14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d04 expref: 5 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.514935:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x3139939425051a9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e75455 expref: 4 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.514957:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7e00/0x313993942504f3a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3432448->3510271) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e73dbf expref: 3 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.514969:0:12215:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880099036800, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1746147152.514979:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147152.514980:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147152.514981:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.522744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.522792:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308266880 00000100:00100000:0.0:1746147152.522799:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308266880 00000100:00100000:0.0:1746147152.525160:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15427 00000100:00100000:0.0:1746147152.525172:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+6:1999:x1830967308266880:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:0.0:1746147152.525202:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c73e 00000020:00010000:0.0:1746147152.525209:0:9138:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009cc2f800: total 0 00000100:00080000:0.0:1746147152.525213:0:9138:0:(import.c:66:import_set_state_nolock()) ffff88009cc2e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746147152.525243:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936161 00000100:00100000:0.0:1746147152.525370:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:1999:x1830967308266880:12345-192.168.204.25@tcp:39:umount.0 Request processed in 201us (2632us total) trans 8589936162 rc 0/0 00000100:00100000:0.0:1746147152.525376:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15427 00000020:00010000:3.0:1746147152.525553:0:10927:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009cc2f800: total 0 00010000:00010000:3.0:1746147152.525595:0:10927:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009cc2f800, canceled 0 locks, left on hash table 1. 00000100:00080000:1.0:1746147152.525617:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147152.525620:0:10927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147152.525623:0:10927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746147152.525629:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e600/0x313993942504c761 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e725a8 expref: 4 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.525646:0:10927:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009cc2f800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1746147152.525655:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147152.525657:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147152.525658:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.532597:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.533508:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267008 00000100:00100000:2.0:1746147152.533518:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267008 00000100:00080000:1.0:1746147152.534262:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147152.534354:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15428 00000100:00100000:2.0:1746147152.534364:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+5:1999:x1830967308267008:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:2.0:1746147152.534394:0:6215:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942504c745 00000100:00080000:2.0:1746147152.534400:0:6215:0:(import.c:66:import_set_state_nolock()) ffff8800a801b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147152.534415:0:6215:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977418 00010000:00010000:1.0:1746147152.534590:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147152.534857:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f35d548b-9665-4b28-8c0b-0a36e9d7d52a+3:1999:x1830967308267008:12345-192.168.204.25@tcp:39:umount.0 Request processed in 494us (2265us total) trans 4294977419 rc 0/0 00000100:00100000:2.0:1746147152.534864:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15428 00000100:00100000:0.0:1746147152.580678:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.580772:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267136 00000100:00100000:2.0:1746147152.580781:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267136 00000100:00100000:2.0:1746147152.581044:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15429 00000100:00100000:2.0:1746147152.581054:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32726:x1830967308267136:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.581075:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.581117:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0400/0x3139939425057e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78dd6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.581169:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.581179:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.581187:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.581200:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.581205:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00080000:1.0:1746147152.582176:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147152.582228:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582297:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582305:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582310:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147152.582544:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147152.582549:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147152.582565:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582573:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582580:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582584:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582589:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582593:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147152.582596:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582601:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582611:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147152.582613:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147152.582617:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582620:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x3139939425057e95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582649:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582653:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582657:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582660:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990cc600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147152.582662:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582666:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582672:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098006900) 00010000:00010000:2.0:1746147152.582673:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147152.582675:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582679:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc600/0x3139939425057e9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.582703:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0400/0x3139939425057e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.582716:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.582722:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.582723:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147152.582725:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cda00, rc 0) 00000100:00100000:2.0:1746147152.583119:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32726:x1830967308267136:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2066us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.583127:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15429 00000100:00100000:0.0:1746147152.587424:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.587460:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267264 00000100:00100000:0.0:1746147152.587470:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.587471:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267264 00000100:00080000:1.0:1746147152.587537:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147152.587719:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267392 00000100:00100000:3.0:1746147152.587722:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267392 00000100:00100000:2.0:1746147152.587739:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15229 00000100:00100000:2.0:1746147152.587762:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967308267264:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147152.587768:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15230 00000100:00100000:3.0:1746147152.587776:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967308267392:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.587784:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.587790:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.587807:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78de4 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.587807:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78ddd expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147152.587825:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814174f, atime: 0x6814174e, ctime: 0x6814174f, blocks: 0x800 00002000:00010000:2.0:1746147152.587827:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814174f, atime: 0x6814174e, ctime: 0x6814174f, blocks: 0x808 00010000:00010000:3.0:1746147152.587841:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.587843:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.587843:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.587845:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.587850:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 25 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.587863:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 25 pid: 1398 timeout: 0 lvb_type: 1 00000100:00080000:1.0:1746147152.587865:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746147152.587872:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94c00, rc 0) 00010000:00010000:2.0:1746147152.587919:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.587936:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.587945:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc600, rc 0) 00000100:00100000:2.0:1746147152.588002:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967308267264:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 252us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.588003:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967308267392:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 227us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.588009:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15229 00000100:00100000:3.0:1746147152.588266:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15230 00000100:00100000:0.0:1746147152.590367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.590525:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267648 00000100:00100000:2.0:1746147152.590533:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267648 00000100:00100000:2.0:1746147152.590581:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15430 00000100:00100000:2.0:1746147152.590588:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32726:x1830967308267648:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.590603:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.590621:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425057eb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78deb expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.590721:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.590734:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.590741:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.590783:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.590796:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 31 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746147152.590808:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310783616:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147152.591707:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c9c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.597778:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.598020:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267776 00000100:00100000:3.0:1746147152.598029:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267776 00010000:00010000:3.0:1746147152.598062:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 32 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746147152.598120:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6752 00000100:00100000:3.0:1746147152.598127:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308267776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147152.598140:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147152.598145:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 32 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746147152.598157:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 32 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746147152.598177:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147152.598181:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147152.598189:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147152.598194:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147152.598209:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.598246:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308267776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 120us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.598252:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6752 00010000:00010000:2.0:1746147152.598388:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425057ea3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78dd6 expref: 31 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746147152.598435:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310783616:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147152.598458:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.598468:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.598473:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147152.598499:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147152.598661:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425057eb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.598675:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.598683:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.598686:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147152.598689:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400be00, rc 0) 00000100:00100000:2.0:1746147152.599571:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32726:x1830967308267648:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8979us (9207us total) trans 8589936163 rc 0/0 00000100:00100000:2.0:1746147152.599582:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15430 00000100:00100000:0.0:1746147152.602681:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.602801:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308267904 00000100:00100000:2.0:1746147152.602813:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308267904 00000100:00100000:2.0:1746147152.602872:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15431 00000100:00100000:2.0:1746147152.602882:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32726:x1830967308267904:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.602913:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.602934:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425057ecd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78df2 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.603031:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.603048:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.603055:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.603118:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.603130:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 32 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746147152.603143:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310783744:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147152.603925:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011e48fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147152.606133:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967310783744:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147152.606160:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147152.606434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.607179:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268032 00000100:00100000:1.0:1746147152.607188:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268032 00010000:00010000:1.0:1746147152.607224:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 33 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746147152.607270:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6753 00000100:00100000:1.0:1746147152.607278:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308268032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147152.607295:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147152.607302:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 33 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746147152.607313:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 33 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746147152.607335:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x3139939425057ebf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78deb expref: 33 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746147152.607364:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147152.607368:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.607377:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.607384:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.607414:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147152.607565:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.607571:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147152.607615:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147152.607619:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147152.607633:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.607658:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425057ecd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df2 expref: 33 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.608308:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df2 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.608317:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.608319:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147152.608322:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ac00, rc 0) 00000100:00100000:1.0:1746147152.608391:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967308268032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1113us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147152.608399:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6753 00000100:00100000:2.0:1746147152.608447:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32726:x1830967308267904:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5566us (5774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.608454:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15431 00000100:00100000:0.0:1746147152.612578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.613037:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268288 00000100:00100000:2.0:1746147152.613046:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268288 00000100:00100000:2.0:1746147152.613332:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15432 00000100:00100000:2.0:1746147152.613341:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:32726:x1830967308268288:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.613361:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.613380:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425057edb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78df9 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.613487:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425057ee2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.613501:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425057ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.613511:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425057ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147152.613521:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00010000:00010000:2.0:1746147152.613631:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425057edb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df9 expref: 34 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.613648:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425057ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df9 expref: 33 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.613657:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.613659:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147152.613662:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400a400, rc 0) 00000100:00100000:2.0:1746147152.613718:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32726:x1830967308268288:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 378us (1147us total) trans 8589936164 rc 0/0 00000100:00100000:2.0:1746147152.613725:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15432 00000100:00100000:0.0:1746147152.618976:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.619004:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.619025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.619043:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.619426:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268416 00000100:00100000:2.0:1746147152.619435:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268416 00000100:00100000:0.0:1746147152.619446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.619471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.619714:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268672 00000100:00100000:2.0:1746147152.619716:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268672 00000100:00100000:3.0:1746147152.619768:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268928 00000100:00100000:3.0:1746147152.619772:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268928 00000100:00100000:3.0:1746147152.619788:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268544 00000100:00100000:3.0:1746147152.619789:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268544 00000100:00100000:3.0:1746147152.619797:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308268800 00000100:00100000:3.0:1746147152.619799:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308268800 00000100:00100000:3.0:1746147152.619806:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269056 00000100:00100000:3.0:1746147152.619808:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269056 00000100:00100000:3.0:1746147152.619819:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15231 00000100:00100000:3.0:1746147152.619825:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308268416:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147152.619863:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.619880:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.619886:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.619888:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.619890:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.619915:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.619924:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 27 pid: 12201 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.619940:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310783872:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.619995:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.620011:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15232 00000100:00100000:3.0:1746147152.620016:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308268672:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147152.620031:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620040:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 24 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620045:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620046:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620048:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620058:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 24 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620064:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 24 pid: 10340 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.620072:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310784000:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.620104:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.620118:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15233 00000100:00100000:3.0:1746147152.620122:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308268928:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147152.620139:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620147:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620152:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620153:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620155:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620165:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620171:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 27 pid: 9584 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.620177:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310784128:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.620192:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.620210:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15234 00000100:00100000:3.0:1746147152.620215:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308268544:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147152.620226:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620234:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620239:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620240:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620241:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620258:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620264:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 24 pid: 1854 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.620270:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310784256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.620287:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.620301:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15235 00000100:00100000:3.0:1746147152.620305:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308268800:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147152.620318:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620326:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620331:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620332:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620334:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620346:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620352:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 27 pid: 1398 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.620360:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310784384:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.620377:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009890b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.620394:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15236 00000100:00100000:3.0:1746147152.620399:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308269056:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147152.620411:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620419:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620425:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620426:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.620428:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.620441:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.620448:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 24 pid: 9584 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.620455:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310784512:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.620470:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.624958:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967310783872:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.624983:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.625142:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967310784512:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147152.625153:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967310784384:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147152.625155:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.625163:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.625178:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967310784256:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147152.625187:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.625245:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967310784000:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147152.625257:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.625318:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967310784128:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.625328:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.629649:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.629689:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.629722:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.629741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.629830:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269184 00000100:00100000:1.0:1746147152.629844:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269184 00000100:00100000:0.0:1746147152.629846:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269440 00000100:00100000:0.0:1746147152.629854:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269440 00010000:00010000:0.0:1746147152.629889:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 26 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746147152.629892:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 26 pid: 10340 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746147152.629922:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269696 00000100:00100000:0.0:1746147152.629924:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269696 00010000:00010000:0.0:1746147152.629936:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 27 pid: 9584 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746147152.629958:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269312 00000100:00100000:1.0:1746147152.629961:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269312 00010000:00010000:1.0:1746147152.629977:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 28 pid: 12201 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.630064:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6754 00000100:00100000:3.0:1746147152.630074:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308269440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147152.630128:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147152.630150:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 27 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630161:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 27 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630181:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b800/0x3139939425057dc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d3c expref: 27 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630201:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.630202:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.630207:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630214:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630254:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147152.630270:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630277:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630292:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630299:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630306:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630312:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38de00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147152.630316:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630323:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630332:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630338:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x3139939425057f05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.630400:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308268544:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 10183us (11354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.630407:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15234 00000100:00100000:3.0:1746147152.630436:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308269440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 365us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.630442:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6754 00000100:00100000:3.0:1746147152.630453:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6755 00000100:00100000:3.0:1746147152.630458:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308269184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147152.630465:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147152.630472:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 24 pid: 10340 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630480:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 24 pid: 10340 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630491:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425057eaa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ddd expref: 24 pid: 10340 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630499:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.630500:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.630503:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630509:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630526:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.630540:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967308269184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.630545:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6755 00000100:00100000:3.0:1746147152.630556:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6756 00000100:00100000:3.0:1746147152.630561:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308269696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147152.630567:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147152.630574:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 22 pid: 9584 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630581:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 22 pid: 9584 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630592:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425057ddf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d58 expref: 22 pid: 9584 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746147152.630599:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.630600:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.630603:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630608:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.630622:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.630638:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967308269696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.630643:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6756 00000100:00100000:0.0:1746147152.630682:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6757 00000100:00100000:0.0:1746147152.630693:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308269312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147152.630706:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147152.630725:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 28 pid: 12201 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746147152.630738:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 28 pid: 12201 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746147152.630769:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f200/0x3139939425057dbc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d35 expref: 28 pid: 12201 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746147152.630794:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.630796:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.630800:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.630807:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.630827:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147152.630858:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308269312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 168us (1115us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147152.630939:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630947:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630958:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630963:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630969:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630974:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38cc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147152.630976:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.630978:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630981:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.630985:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.630995:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.630996:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631001:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.631001:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425057f13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631006:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631011:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147152.631013:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631018:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631027:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631033:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x3139939425057ef7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.631047:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967308269056:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 10648us (11575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147152.631053:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15236 00000100:00100000:2.0:1746147152.631065:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+19:2001:x1830967308268672:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 11049us (12060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.631071:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15232 00010000:00010000:2.0:1746147152.631106:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631112:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631125:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.631128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147152.631131:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631136:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631141:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147152.631143:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631148:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.631148:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269568 00000100:00100000:1.0:1746147152.631152:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269568 00010000:00010000:2.0:1746147152.631156:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.631162:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057ef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.631164:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 28 pid: 1398 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.631193:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308268416:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 11367us (12225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.631198:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15231 00000100:00100000:2.0:1746147152.631261:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.631275:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308269824 00000100:00100000:2.0:1746147152.631278:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308269824 00010000:00010000:2.0:1746147152.631288:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 28 pid: 9584 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746147152.631523:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6757 00000100:00100000:0.0:1746147152.631600:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6758 00000100:00100000:1.0:1746147152.631607:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6759 00000100:00100000:0.0:1746147152.631608:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308269568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147152.631614:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308269824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147152.631617:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147152.631622:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147152.631628:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 27 pid: 1398 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746147152.631632:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 27 pid: 9584 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746147152.631637:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 27 pid: 1398 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746147152.631641:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 27 pid: 9584 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746147152.631649:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057eb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78de4 expref: 27 pid: 1398 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746147152.631654:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x3139939425057dd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d51 expref: 27 pid: 9584 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746147152.631659:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.631662:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.631663:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.631664:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.631665:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.631667:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631671:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.631672:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631685:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147152.631700:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308269568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (571us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147152.631702:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147152.631706:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6758 00000100:00100000:1.0:1746147152.631717:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308269824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147152.631723:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6759 00010000:00010000:0.0:1746147152.631724:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631731:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631743:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631758:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631764:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631769:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147152.631772:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631783:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631792:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.631797:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.631836:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967308268800:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 11529us (12389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.631842:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15235 00010000:00010000:3.0:1746147152.631947:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.631954:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.631966:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.631972:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.631977:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.631982:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffbe00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147152.631984:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.631995:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.632004:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.632009:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425057efe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.632040:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308268928:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 11916us (13013us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.632046:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15233 00000100:00100000:0.0:1746147152.635780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.635856:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270080 00000100:00100000:2.0:1746147152.635867:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270080 00000100:00100000:2.0:1746147152.635926:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15433 00000100:00100000:2.0:1746147152.635933:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:32726:x1830967308270080:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147152.635981:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746147152.636004:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425057ded lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78d5f expref: 33 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.636021:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ac00/0x3139939425057ed4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df2 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.636029:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.636033:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147152.636057:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.636067:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.636078:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000040:00080000:2.0:1746147152.636307:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].641, 88 off64472 00000004:00080000:2.0:1746147152.636312:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690626222677ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.637042:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].573, 88 off58488 00000004:00080000:2.0:1746147152.637049:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690626959755ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637076:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].574, 88 off58576 00000004:00080000:2.0:1746147152.637080:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690626990117ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637125:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].642, 88 off64560 00000004:00080000:2.0:1746147152.637129:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690627039587ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.637140:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].643, 88 off64648 00000004:00080000:2.0:1746147152.637142:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690627053115ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.637151:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].575, 88 off58664 00000004:00080000:2.0:1746147152.637154:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690627064578ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637173:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].576, 88 off58752 00000004:00080000:2.0:1746147152.637176:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690627086177ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637183:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].577, 88 off58840 00000004:00080000:2.0:1746147152.637186:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690627096447ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637194:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].644, 88 off64736 00000004:00080000:2.0:1746147152.637196:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690627106955ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.637204:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].578, 88 off58928 00000004:00080000:2.0:1746147152.637206:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690627116537ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637216:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].645, 88 off64824 00000004:00080000:2.0:1746147152.637219:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690627129215ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.637226:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].579, 88 off59016 00000004:00080000:2.0:1746147152.637229:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690627139290ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.637239:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].646, 88 off64912 00000004:00080000:2.0:1746147152.637241:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690627152097ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.637962:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].647, 88 off65000 00000004:00080000:2.0:1746147152.637968:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690627878120ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.639868:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].648, 88 off65088 00000004:00080000:2.0:1746147152.639877:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690629787575ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.639899:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].649, 88 off65176 00000004:00080000:2.0:1746147152.639901:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690629812075ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.639917:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].580, 88 off59104 00000004:00080000:2.0:1746147152.639919:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690629830072ns, next at 554081490131ns, rc = 0 00000001:00080000:1.0:1746147152.646135:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936165 is committed 00000004:00080000:1.0:1746147152.646151:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 574 committed 00000004:00080000:1.0:1746147152.646180:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 641 committed 00000004:00080000:1.0:1746147152.646195:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 640 committed 00000004:00080000:1.0:1746147152.646197:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 639 committed 00000004:00080000:1.0:1746147152.646202:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 638 committed 00000004:00080000:1.0:1746147152.646203:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 573 committed 00000004:00080000:1.0:1746147152.646204:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 637 committed 00000004:00080000:1.0:1746147152.646208:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 572 committed 00000004:00080000:1.0:1746147152.646209:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 636 committed 00000004:00080000:1.0:1746147152.646211:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 571 committed 00000004:00080000:1.0:1746147152.646212:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 570 committed 00000004:00080000:1.0:1746147152.646214:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 569 committed 00000004:00080000:1.0:1746147152.646215:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 635 committed 00000004:00080000:1.0:1746147152.646217:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 634 committed 00000004:00080000:1.0:1746147152.646218:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 568 committed 00000004:00080000:1.0:1746147152.646220:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 567 committed 00000004:00080000:1.0:1746147152.646224:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 633 committed 00000001:00100000:1.0:1746147152.646235:0:8094:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f35d548b-9665-4b28-8c0b-0a36e9d7d52a 00000001:00080000:1.0:1746147152.646239:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936162 is committed 00000020:00000080:1.0:1746147152.646242:0:8094:0:(genops.c:904:class_export_put()) final put ffff88009cc2f800/f35d548b-9665-4b28-8c0b-0a36e9d7d52a 00000001:00100000:1.0:1746147152.646260:0:8094:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 90095e6f-8cef-455a-9171-4caf9b613254 00000001:00080000:1.0:1746147152.646264:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936161 is committed 00000020:00000080:1.0:1746147152.646278:0:8094:0:(genops.c:904:class_export_put()) final put ffff8800a4662800/90095e6f-8cef-455a-9171-4caf9b613254 00000004:00010000:2.0:1746147152.646414:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094526d80 reply state ffff880098d99000 transno 8589936165 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.646431:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.646438:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.646441:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147152.646444:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147152.646472:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310784640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.646507:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310785024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147152.646544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1746147152.646563:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff88009cc2f800/f35d548b-9665-4b28-8c0b-0a36e9d7d52a for lustre-MDT0000 00000100:00100000:0.0:1746147152.646568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147152.646588:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310785152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.646597:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310785536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147152.646605:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1746147152.646610:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a4662800/90095e6f-8cef-455a-9171-4caf9b613254 for lustre-MDT0000 00000100:00100000:0.0:1746147152.646619:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1746147152.646640:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009cc2e000 for lustre-MDT0000 00000100:00100000:2.0:1746147152.646645:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310784640 00000020:00000080:1.0:1746147152.646647:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a4660000 for lustre-MDT0000 00000100:00100000:2.0:1746147152.646653:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310784640 00000100:00100000:1.0:1746147152.646658:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310784896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.646660:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785024 00000100:00100000:0.0:1746147152.646666:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785024 00000100:00100000:1.0:1746147152.646684:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147152.646696:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785152 00000100:00100000:2.0:1746147152.646698:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785152 00000100:00100000:0.0:1746147152.646712:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785536 00000100:00100000:2.0:1746147152.646713:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310784896 00000100:00100000:2.0:1746147152.646715:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310784896 00000100:00100000:0.0:1746147152.646715:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785536 00000100:00100000:2.0:1746147152.646730:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15237 00000100:00100000:0.0:1746147152.646736:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15238 00000100:00100000:2.0:1746147152.646737:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967310784640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.646743:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3766:x1830967310785024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147152.646821:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15239 00000100:00100000:3.0:1746147152.646827:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967310785152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.646859:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15240 00000100:00100000:0.0:1746147152.646865:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3765:x1830967310784896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147152.646888:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310785152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (282us total) trans 17179874322 rc 0/0 00000100:00100000:2.0:1746147152.646888:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967310784640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (344us total) trans 17179874320 rc 0/0 00000100:00100000:3.0:1746147152.646895:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15239 00000100:00100000:1.0:1746147152.646913:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.646932:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.646948:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967310784896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (262us total) trans 17179874323 rc 0/0 00000100:00100000:1.0:1746147152.646955:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.646985:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785408 00000100:00100000:3.0:1746147152.646988:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785408 00000100:00100000:2.0:1746147152.648064:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15237 00000100:00100000:2.0:1746147152.648082:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15241 00000100:00100000:2.0:1746147152.648100:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967310785536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147152.648191:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3766:x1830967310785536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (1570us total) trans 17179874324 rc 0/0 00000100:00100000:2.0:1746147152.648196:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15241 00000100:00100000:2.0:1746147152.648221:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310785664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147152.648255:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310786176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648268:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147152.648294:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525f80/2, rc 0, transno 17179874320 00000100:00100000:2.0:1746147152.648303:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310784640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147152.648311:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093147100/2, rc 0, transno 17179874322 00000100:00100000:2.0:1746147152.648314:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310785152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147152.648321:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147152.648325:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310786048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648339:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147152.648347:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310786560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648358:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147152.648373:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785664 00000100:00100000:2.0:1746147152.648377:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785664 00000100:00100000:2.0:1746147152.648394:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310786176 00000100:00100000:2.0:1746147152.648395:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310786176 00000100:00100000:2.0:1746147152.648401:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310786048 00000100:00100000:2.0:1746147152.648403:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310786048 00000100:00100000:2.0:1746147152.648409:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310786560 00000100:00100000:2.0:1746147152.648411:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310786560 00000100:00100000:2.0:1746147152.648418:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15242 00000100:00100000:2.0:1746147152.648423:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967310785664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648509:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967310785664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (267us total) trans 21474841576 rc 0/0 00000100:00100000:2.0:1746147152.648514:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15242 00000100:00100000:2.0:1746147152.648523:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15243 00000100:00100000:2.0:1746147152.648528:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967310786176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648581:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967310786176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (311us total) trans 21474841577 rc 0/0 00000100:00100000:2.0:1746147152.648587:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15243 00000100:00100000:2.0:1746147152.648595:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15244 00000100:00100000:2.0:1746147152.648599:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967310786048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648649:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967310786048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (308us total) trans 21474841578 rc 0/0 00000100:00100000:2.0:1746147152.648654:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15244 00000100:00100000:2.0:1746147152.648663:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15245 00000100:00100000:2.0:1746147152.648668:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967310786560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147152.648718:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967310786560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (358us total) trans 21474841579 rc 0/0 00000100:00100000:2.0:1746147152.648723:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15245 00000100:00100000:2.0:1746147152.648746:0:3767:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841573 gen 2 00000004:00080000:2.0:1746147152.648760:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094187480, transno 21474841526 00000004:00080000:2.0:1746147152.648766:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094185880, transno 21474841527 00000004:00080000:2.0:1746147152.648768:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096840000, transno 21474841528 00000004:00080000:2.0:1746147152.648770:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096840a80, transno 21474841529 00000004:00080000:2.0:1746147152.648772:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096840700, transno 21474841530 00000004:00080000:2.0:1746147152.648774:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096840e00, transno 21474841531 00000004:00080000:2.0:1746147152.648776:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096840380, transno 21474841532 00000004:00080000:2.0:1746147152.648778:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096841180, transno 21474841533 00000004:00080000:2.0:1746147152.648779:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094526680, transno 21474841535 00000004:00080000:2.0:1746147152.648781:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd44700, transno 21474841536 00000004:00080000:2.0:1746147152.648783:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094525880, transno 21474841537 00000004:00080000:2.0:1746147152.648785:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd47800, transno 21474841538 00000004:00080000:2.0:1746147152.648786:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094527b80, transno 21474841539 00000004:00080000:2.0:1746147152.648788:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094525c00, transno 21474841540 00000004:00080000:2.0:1746147152.648790:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094524e00, transno 21474841541 00000004:00080000:2.0:1746147152.648792:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd45f80, transno 21474841542 00000004:00080000:2.0:1746147152.648794:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6300, transno 21474841554 00000004:00080000:2.0:1746147152.648796:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e503800, transno 21474841555 00000004:00080000:2.0:1746147152.648798:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4e00, transno 21474841556 00000004:00080000:2.0:1746147152.648800:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6680, transno 21474841557 00000004:00080000:2.0:1746147152.648802:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d7b80, transno 21474841558 00000004:00080000:2.0:1746147152.648804:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4a80, transno 21474841559 00000004:00080000:2.0:1746147152.648806:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4380, transno 21474841560 00000004:00080000:2.0:1746147152.648808:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e503480, transno 21474841561 00000004:00080000:2.0:1746147152.648810:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305f2680, transno 21474841566 00000004:00080000:2.0:1746147152.648811:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5880, transno 21474841567 00000100:00100000:1.0:1746147152.648851:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147152.649043:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e501c00, transno 21474841568 00000004:00080000:2.0:1746147152.649047:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e502d80, transno 21474841569 00000004:00080000:2.0:1746147152.649050:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305f2300, transno 21474841570 00000004:00080000:2.0:1746147152.649052:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5180, transno 21474841571 00000004:00080000:2.0:1746147152.649054:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e503b80, transno 21474841572 00000004:00080000:2.0:1746147152.649056:0:3767:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e502680, transno 21474841573 00000100:00100000:2.0:1746147152.649061:0:3767:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880099152a00 x1830967310786048/t21474841578(21474841578) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147168 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746147152.649069:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099152a00/2, rc 0, transno 21474841578 00000100:00100000:2.0:1746147152.649072:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310786048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.649074:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310786432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147152.649082:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099153100/2, rc 0, transno 21474841579 00000100:00100000:2.0:1746147152.649085:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310786560:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147152.649109:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099152300/2, rc 0, transno 21474841576 00000100:00100000:2.0:1746147152.649112:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310785664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.649139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147152.649162:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094527480/2, rc 0, transno 17179874323 00000100:00100000:1.0:1746147152.649165:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310784896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.649174:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746147152.649179:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310784768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.649195:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.649197:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15240 00000100:00100000:1.0:1746147152.649204:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.649217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.649221:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785920 00000100:00100000:1.0:1746147152.649225:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649225:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785920 00000100:00100000:1.0:1746147152.649235:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147152.649241:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310786304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649242:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310786432 00000100:00100000:0.0:1746147152.649244:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310786432 00000100:00100000:0.0:1746147152.649250:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310784768 00000004:00080000:2.0:1746147152.649251:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150e00/2, rc 0, transno 21474841577 00000100:00100000:0.0:1746147152.649252:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310784768 00000100:00100000:1.0:1746147152.649253:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147152.649254:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310786176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649259:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785280 00000100:00100000:0.0:1746147152.649261:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785280 00000100:00100000:0.0:1746147152.649267:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310785792 00000100:00100000:0.0:1746147152.649268:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310785792 00000100:00080000:1.0:1746147152.649270:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147152.649273:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147152.649273:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310786304 00000100:00100000:0.0:1746147152.649274:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310786304 00000100:00100000:2.0:1746147152.649283:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15246 00000100:00100000:2.0:1746147152.649288:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310785920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.649306:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15247 00000100:00100000:1.0:1746147152.649311:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310786432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649316:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15248 00000100:00100000:0.0:1746147152.649323:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967310784768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147152.649348:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310785920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (497us total) trans 21474841580 rc 0/0 00000100:00100000:2.0:1746147152.649354:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15246 00000100:00100000:1.0:1746147152.649357:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967310786432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (218us total) trans 21474841581 rc 0/0 00000100:00100000:1.0:1746147152.649361:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15247 00000100:00100000:2.0:1746147152.649365:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15249 00000100:00100000:1.0:1746147152.649369:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15250 00000100:00100000:2.0:1746147152.649370:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967310785280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.649372:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310785792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.649415:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310785792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (179us total) trans 21474841582 rc 0/0 00000100:00100000:2.0:1746147152.649420:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3765:x1830967310785280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (203us total) trans 17179874326 rc 0/0 00000100:00100000:1.0:1746147152.649420:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15250 00000100:00100000:2.0:1746147152.649424:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15249 00000100:00100000:1.0:1746147152.649429:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15251 00000100:00100000:1.0:1746147152.649434:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967310786304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649434:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967310784768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (238us total) trans 17179874325 rc 0/0 00000100:00100000:0.0:1746147152.649441:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15248 00000100:00100000:1.0:1746147152.649485:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967310786304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (230us total) trans 21474841583 rc 0/0 00000004:00080000:0.0:1746147152.649488:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093145f80/2, rc 0, transno 17179874324 00000100:00100000:1.0:1746147152.649491:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15251 00000100:00100000:0.0:1746147152.649493:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310785536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147152.649514:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094526300/2, rc 0, transno 17179874325 00000100:00100000:1.0:1746147152.649517:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310784768:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147152.649522:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093145880/2, rc 0, transno 17179874326 00000100:00100000:1.0:1746147152.649525:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147152.649531:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151f80/2, rc 0, transno 21474841582 00000100:00100000:1.0:1746147152.649534:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649538:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3766:x1830967310785024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2796us (2970us total) trans 17179874321 rc 0/0 00000004:00080000:1.0:1746147152.649539:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151880/2, rc 0, transno 21474841583 00000100:00100000:1.0:1746147152.649541:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310786304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.649545:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15238 00000004:00080000:1.0:1746147152.649547:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099152680/2, rc 0, transno 21474841580 00000100:00100000:1.0:1746147152.649550:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147152.649555:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151500/2, rc 0, transno 21474841581 00000100:00100000:1.0:1746147152.649557:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310786432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147152.649564:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093146a00/2, rc 0, transno 17179874321 00000100:00100000:0.0:1746147152.649568:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310785024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147152.649628:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15252 00000100:00100000:3.0:1746147152.649634:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3765:x1830967310785408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147152.649697:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967310785408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (2764us total) trans 17179874327 rc 0/0 00000100:00100000:3.0:1746147152.649701:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746147152.649826:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1746147152.649833:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093146680/2, rc 0, transno 17179874327 00000100:00100000:1.0:1746147152.649837:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310785408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.649838:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310786688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.649866:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147152.649889:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310786688 00000100:00100000:1.0:1746147152.649893:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310786688 00000100:00100000:1.0:1746147152.649912:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15253 00000100:00100000:1.0:1746147152.649916:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3766:x1830967310786688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.649971:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3766:x1830967310786688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (103us total) trans 17179874328 rc 0/0 00000100:00100000:1.0:1746147152.649975:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15253 00000004:00080000:2.0:1746147152.650151:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 32 done 00000004:00080000:0.0:1746147152.650161:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e59180/2, rc 0, transno 17179874328 00000100:00100000:0.0:1746147152.650166:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310786688:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746147152.650218:0:6215:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147152.650232:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308270080:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 14298us (14463us total) trans 8589936165 rc 0/0 00000100:00100000:2.0:1746147152.650237:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15433 00010000:00010000:1.0:1746147152.650263:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.650271:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.650277:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.650286:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400b600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147152.650290:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.650295:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.650308:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147152.650311:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147152.650314:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.650318:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b600/0x3139939425057f1a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147152.653308:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.653406:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270208 00000100:00100000:2.0:1746147152.653415:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270208 00000100:00100000:2.0:1746147152.653459:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15434 00000100:00100000:2.0:1746147152.653467:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32726:x1830967308270208:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.653493:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.653515:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e00 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.653571:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.653584:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.653600:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.653602:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147152.653606:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c800, rc 0) 00000100:00100000:2.0:1746147152.654847:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308270208:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1374us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.654857:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15434 00010000:00010000:1.0:1746147152.655285:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147152.658761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.658963:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270336 00000100:00100000:2.0:1746147152.658973:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270336 00000100:00100000:2.0:1746147152.659027:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15435 00000100:00100000:2.0:1746147152.659035:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308270336:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.659060:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.659081:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425057f28 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e07 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.659205:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425057f2f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.659219:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425057f2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.659231:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425057f2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147152.659262:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 9112800 00000004:00200000:2.0:1746147152.659617:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147152.659637:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425057f2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.659662:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425057f28 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e07 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.659740:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425057f2f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e07 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.659757:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.659760:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147152.659764:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5797800, rc 0) 00000100:00100000:2.0:1746147152.660237:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32726:x1830967308270336:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1200us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.660244:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15435 00000100:00100000:0.0:1746147152.665266:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.665901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.665930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.665953:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.665967:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.665995:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270464 00000100:00100000:3.0:1746147152.665998:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270976 00000100:00100000:2.0:1746147152.665998:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270720 00000100:00100000:0.0:1746147152.666003:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270464 00000100:00100000:3.0:1746147152.666008:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270976 00000100:00100000:2.0:1746147152.666008:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270720 00000100:00100000:2.0:1746147152.666061:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270592 00000100:00100000:2.0:1746147152.666064:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270592 00000100:00100000:1.0:1746147152.666529:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308270848 00000100:00100000:1.0:1746147152.666534:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308270848 00000100:00100000:2.0:1746147152.666547:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15254 00000100:00100000:2.0:1746147152.666557:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967308270720:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147152.666567:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15255 00010000:00010000:2.0:1746147152.666573:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147152.666575:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967308270592:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.666591:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e1c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147152.666612:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 2097152, mtime: 0x6814174f, atime: 0x6814174e, ctime: 0x6814174f, blocks: 0x808 00010000:00010000:2.0:1746147152.666627:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.666630:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.666637:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147152.666641:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15256 00000100:00100000:3.0:1746147152.666648:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15257 00000100:00100000:0.0:1746147152.666648:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308270464:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.666652:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147152.666656:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308270976:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.666661:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00010000:00010000:0.0:1746147152.666661:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.666664:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.666675:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e2a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.666678:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e0e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147152.666689:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 4918496, mtime: 0x6814174e, atime: 0x6814174e, ctime: 0x6814174e, blocks: 0x1590 00002000:00010000:0.0:1746147152.666696:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 1048576, mtime: 0x6814174e, atime: 0x6814174e, ctime: 0x6814174e, blocks: 0x7c8 00010000:00010000:3.0:1746147152.666701:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.666702:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.666707:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147152.666712:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.666714:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147152.666715:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967308270720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 159us (813us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147152.666717:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147152.666721:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15254 00010000:00010000:0.0:1746147152.666721:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.666724:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95c00, rc 0) 00010000:00010000:0.0:1746147152.666735:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147152.666738:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15258 00000100:00100000:3.0:1746147152.666743:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308270976:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 88us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.666744:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308270848:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147152.666758:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ae00, rc 0) 00000100:00100000:3.0:1746147152.666761:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15257 00010000:00010000:2.0:1746147152.666761:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.666769:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e23 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147152.666783:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 2097152, mtime: 0x6814174f, atime: 0x6814174e, ctime: 0x6814174f, blocks: 0x800 00010000:00010000:2.0:1746147152.666791:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.666792:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147152.666793:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308270464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 145us (1539us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147152.666796:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147152.666799:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15256 00010000:00010000:2.0:1746147152.666805:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.666812:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5797400, rc 0) 00000100:00100000:2.0:1746147152.666832:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308270848:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 88us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.666838:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15258 00010000:00010000:1.0:1746147152.667397:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147152.667411:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e15 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147152.667427:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6814174e, atime: 0x6814174e, ctime: 0x6814174e, blocks: 0x808 00010000:00010000:1.0:1746147152.667438:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.667440:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.667445:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 21 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147152.667460:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 21 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147152.667468:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348600, rc 0) 00000100:00100000:3.0:1746147152.667700:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.667742:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967308270592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1167us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.667746:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271104 00000100:00100000:2.0:1746147152.667759:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271104 00000100:00100000:1.0:1746147152.667759:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15255 00000100:00100000:1.0:1746147152.667778:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15259 00000100:00100000:1.0:1746147152.667785:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967308271104:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147152.667792:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147152.667800:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e31 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147152.668705:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 4194304, mtime: 0x6814174e, atime: 0x6814174e, ctime: 0x6814174e, blocks: 0x1008 00010000:00010000:1.0:1746147152.668719:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.668721:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.668728:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147152.668740:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147152.668757:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348800, rc 0) 00000100:00100000:1.0:1746147152.668790:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308271104:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1005us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147152.668798:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15259 00000100:00100000:0.0:1746147152.672307:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.672354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.672382:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.672413:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.672437:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271360 00000100:00100000:0.0:1746147152.672446:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271360 00000100:00100000:3.0:1746147152.672475:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271616 00000100:00100000:3.0:1746147152.672486:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271616 00000100:00100000:0.0:1746147152.672491:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271872 00000100:00100000:0.0:1746147152.672493:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271872 00000100:00100000:0.0:1746147152.672506:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271232 00000100:00100000:0.0:1746147152.672508:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271232 00000100:00100000:3.0:1746147152.672536:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15260 00000100:00100000:3.0:1746147152.672544:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308271360:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.672648:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308271360:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 105us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.672654:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15260 00000100:00100000:3.0:1746147152.672670:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15261 00000100:00100000:3.0:1746147152.672675:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967308271872:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.672705:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967308271872:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.672711:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15261 00000100:00100000:3.0:1746147152.672720:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15262 00000100:00100000:3.0:1746147152.672725:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308271616:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.672774:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308271616:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 48us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.672779:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15262 00000100:00100000:3.0:1746147152.672788:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15263 00000100:00100000:3.0:1746147152.672793:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308271232:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.672821:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308271232:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.672826:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15263 00000100:00100000:0.0:1746147152.672946:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.672961:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271488 00000100:00100000:0.0:1746147152.672963:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271488 00000100:00100000:0.0:1746147152.672982:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15264 00000100:00100000:0.0:1746147152.672989:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967308271488:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147152.673061:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967308271488:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 72us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.673068:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15264 00000100:00100000:0.0:1746147152.673175:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.673189:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308271744 00000100:00100000:0.0:1746147152.673192:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308271744 00000100:00100000:0.0:1746147152.673208:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15265 00000100:00100000:0.0:1746147152.673212:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308271744:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147152.673249:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308271744:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 37us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.673254:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15265 00000100:00100000:0.0:1746147152.677387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.677430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.677460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.677602:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272000 00000100:00100000:3.0:1746147152.677613:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272000 00000100:00100000:3.0:1746147152.677658:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272256 00000100:00100000:3.0:1746147152.677660:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272256 00000100:00100000:3.0:1746147152.677674:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272512 00000100:00100000:3.0:1746147152.677675:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272512 00000100:00100000:3.0:1746147152.677697:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15266 00000100:00100000:3.0:1746147152.677706:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308272000:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147152.677874:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15267 00000100:00100000:2.0:1746147152.677883:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308272256:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147152.678218:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15268 00000100:00100000:0.0:1746147152.678227:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308272512:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.678236:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967308272000:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 529us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.678243:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15266 00000100:00100000:0.0:1746147152.678268:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308272512:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 44us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.678273:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15268 00000100:00100000:2.0:1746147152.678322:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967308272256:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 440us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.678328:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15267 00000100:00100000:0.0:1746147152.680063:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.680117:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.680155:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.680176:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272640 00000100:00100000:0.0:1746147152.680183:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272640 00000100:00100000:0.0:1746147152.680214:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272128 00000100:00100000:0.0:1746147152.680217:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272128 00000100:00100000:0.0:1746147152.680226:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272384 00000100:00100000:0.0:1746147152.680228:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272384 00000100:00100000:0.0:1746147152.680242:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15269 00000100:00100000:0.0:1746147152.680248:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308272640:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.680271:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15270 00000100:00100000:3.0:1746147152.680279:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967308272128:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.680332:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967308272128:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.680338:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15270 00000100:00100000:3.0:1746147152.680352:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15271 00000100:00100000:3.0:1746147152.680356:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308272384:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147152.680386:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308272384:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.680395:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15271 00000100:00100000:0.0:1746147152.681887:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967308272640:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 1631us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147152.681899:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15269 00000100:00100000:0.0:1746147152.685945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.686244:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272768 00000100:00100000:2.0:1746147152.686275:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272768 00000100:00100000:2.0:1746147152.686430:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15272 00000100:00100000:2.0:1746147152.686440:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:32726:x1830967308272768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.686461:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.686486:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425057f60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e38 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147152.686511:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8b:0x0] initial LVB size: 2097152, mtime: 0x68141724, atime: 0x0, ctime: 0x68141724, blocks: 0xfd0 00010000:00010000:2.0:1746147152.686534:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.686536:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.686544:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425057f60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e38 expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.686559:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425057f60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e38 expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.686570:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052400, rc 0) 00000100:00100000:2.0:1746147152.686630:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:32726:x1830967308272768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 191us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.686637:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15272 00000100:00100000:0.0:1746147152.689610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.689775:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308272896 00000100:00100000:2.0:1746147152.689788:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308272896 00000100:00100000:2.0:1746147152.690229:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15273 00000100:00100000:2.0:1746147152.690238:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967308272896:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147152.690484:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147152.690488:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147152.690490:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147152.690492:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147152.690494:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:2.0:1746147152.690556:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967308272896:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 318us (964us total) trans 21474841584 rc 0/0 00000100:00100000:2.0:1746147152.690567:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15273 00000100:00100000:0.0:1746147152.694035:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.694116:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308273024 00000100:00100000:2.0:1746147152.694127:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308273024 00000100:00100000:2.0:1746147152.694187:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15274 00000100:00100000:2.0:1746147152.694196:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32726:x1830967308273024:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.694214:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.694236:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425057f67 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e3f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147152.694270:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x8d:0x0] initial LVB size: 4194304, mtime: 0x68141724, atime: 0x0, ctime: 0x68141724, blocks: 0x1fd0 00010000:00010000:2.0:1746147152.694293:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.694295:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.694304:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425057f67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e3f expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.694320:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425057f67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e3f expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.694329:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053400, rc 0) 00000100:00100000:2.0:1746147152.694390:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32726:x1830967308273024:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 195us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.694396:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15274 00000100:00100000:0.0:1746147152.696163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.696222:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308273152 00000100:00100000:2.0:1746147152.696231:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308273152 00000100:00100000:2.0:1746147152.696281:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15275 00000100:00100000:2.0:1746147152.696287:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308273152:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147152.696504:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147152.696507:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147152.696509:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147152.696511:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:2.0:1746147152.696513:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:2.0:1746147152.696552:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308273152:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 265us (396us total) trans 17179874329 rc 0/0 00000100:00100000:2.0:1746147152.696557:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15275 00000100:00100000:0.0:1746147152.701702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.701812:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308273408 00000100:00100000:1.0:1746147152.701823:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308273408 00000100:00100000:1.0:1746147152.701898:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3830 00000100:00100000:1.0:1746147152.701907:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308273408:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147152.701947:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.701962:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.701963:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.701968:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.701983:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.702380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.702476:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308273664 00000100:00100000:2.0:1746147152.702481:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308273664 00000100:00100000:2.0:1746147152.702571:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3831 00000100:00100000:2.0:1746147152.702578:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967308273664:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147152.702600:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.702609:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.702610:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.702613:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.702622:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.702962:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147152.702980:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308273920 00000100:00100000:0.0:1746147152.702983:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308273920 00000100:00100000:0.0:1746147152.703022:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3832 00000100:00100000:0.0:1746147152.703028:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308273920:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147152.704168:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.704189:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.704191:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147152.704196:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.704208:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.705785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.705859:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308274176 00000100:00100000:3.0:1746147152.705869:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308274176 00000100:00100000:3.0:1746147152.705934:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3833 00000100:00100000:3.0:1746147152.705943:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308274176:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147152.705975:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.705987:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.705989:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.705992:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.706005:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.710202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.710248:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.710279:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308274432 00000100:00100000:1.0:1746147152.710288:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308274432 00000100:00100000:1.0:1746147152.710347:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308274688 00000100:00100000:1.0:1746147152.710349:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308274688 00000100:00100000:1.0:1746147152.710389:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3834 00000100:00100000:1.0:1746147152.710398:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967308274432:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147152.710438:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.710454:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.710457:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147152.710463:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.710477:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.710805:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3835 00000100:00100000:2.0:1746147152.710813:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308274688:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147152.710837:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.710845:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.710846:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.710849:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.710857:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.711246:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.711366:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308274944 00000100:00100000:3.0:1746147152.711372:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308274944 00000100:00100000:3.0:1746147152.711417:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3836 00000100:00100000:3.0:1746147152.711423:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308274944:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147152.711439:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.711446:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.711448:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.711452:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.711460:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.715029:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.715178:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308275200 00000100:00100000:3.0:1746147152.715189:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308275200 00000100:00100000:3.0:1746147152.715257:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3837 00000100:00100000:3.0:1746147152.715266:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967308275200:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147152.715316:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.715333:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.715336:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.715343:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.715360:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731770:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731788:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731795:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731803:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147152.731806:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731813:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731833:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.731839:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425057f6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [28672->1048575] (req 28672->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.732293:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967308273408:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 30381us (30596us total) trans 0 rc 1019904/1019904 00000100:00100000:1.0:1746147152.732306:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3830 00010000:00010000:0.0:1746147152.733635:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.733651:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.733663:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.733668:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095053800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147152.733672:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.733679:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.733694:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147152.733699:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x3139939425057f75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147152.733915:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308273664:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 31332us (31530us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147152.733924:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3831 00010000:00010000:1.0:1746147152.737537:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.737556:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.737565:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.737572:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03d200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147152.737575:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.737582:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.737602:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.737608:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425057f7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.737689:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308273920:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 34655us (34720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147152.737700:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3832 00010000:00010000:3.0:1746147152.739685:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.739701:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.739708:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.739719:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147152.739723:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.739730:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.739758:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.739763:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425057f83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.739839:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a499a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967308274176:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 33892us (34059us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147152.739850:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3833 00010000:00010000:3.0:1746147152.745500:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.745518:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.745526:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.745532:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400b600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147152.745536:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.745543:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.745562:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.745567:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057f98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.745661:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308274944:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 34231us (34408us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147152.745672:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3836 00010000:00010000:2.0:1746147152.746462:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.746471:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.746477:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.746482:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095052e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147152.746484:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.746490:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.746501:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.746512:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x3139939425057f91 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.747787:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308274688:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 36966us (37529us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147152.747799:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3835 00010000:00010000:1.0:1746147152.750970:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.750988:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.750995:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.751003:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2ee200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147152.751007:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.751016:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.751036:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147152.751042:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee200/0x3139939425057f8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147152.751711:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308274432:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 41308us (41515us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147152.751722:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3834 00010000:00010000:3.0:1746147152.753007:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.753018:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.753024:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.753030:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400ac00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147152.753033:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.753039:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.753057:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.753062:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057f9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.753140:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308275200:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 37872us (38120us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147152.753148:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3837 00000100:00100000:0.0:1746147152.756775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.756835:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308275456 00000100:00100000:2.0:1746147152.756850:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308275456 00000100:00100000:2.0:1746147152.756905:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15436 00000100:00100000:2.0:1746147152.756913:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:32726:x1830967308275456:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147152.756963:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.756991:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425057f2f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e07 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.757267:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.757272:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147152.757321:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.757334:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.757343:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00010000:2.0:1746147152.757445:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800909fb480 reply state ffff8800993cc000 transno 8589936166 ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.757458:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147152.757463:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.757465:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147152.757467:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147152.757744:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32726:x1830967308275456:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 830us (977us total) trans 8589936166 rc 0/0 00000100:00100000:2.0:1746147152.757761:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15436 00000100:00100000:0.0:1746147152.760305:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.760397:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308275584 00000100:00100000:2.0:1746147152.760407:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308275584 00000100:00100000:2.0:1746147152.760460:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15276 00000100:00100000:2.0:1746147152.760468:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32726:x1830967308275584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.760487:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.760507:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425057fad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e46 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.760536:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.760544:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.760546:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.760549:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425057fad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e46 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.760579:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147152.760595:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.760613:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310786816:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147152.760709:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147152.762776:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310786816:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147152.762806:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425057fad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e46 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.762821:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731e00, rc 0) 00000100:00100000:2.0:1746147152.762863:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308275584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2395us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.762872:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15276 00000100:00100000:0.0:1746147152.763032:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.763464:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308275712 00000100:00100000:2.0:1746147152.763471:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308275712 00010000:00010000:2.0:1746147152.763495:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.763526:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6760 00000100:00100000:2.0:1746147152.763533:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308275712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.763545:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.763565:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.763580:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.763603:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400ae00/0x3139939425057f44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e0e expref: 28 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.763614:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.763615:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.763622:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425057fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e46 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.763629:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425057fad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e46 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.763652:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425057fad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e46 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.763662:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310786944:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147152.763723:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.765732:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.765948:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310786944:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147152.765965:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147152.766008:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308275712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2475us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.766017:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6760 00000100:00100000:3.0:1746147152.766182:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308275840 00000100:00100000:3.0:1746147152.766190:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308275840 00000100:00100000:3.0:1746147152.766230:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15277 00000100:00100000:3.0:1746147152.766238:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32726:x1830967308275840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147152.766256:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.766275:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057fb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e4d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.766302:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.766310:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.766312:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.766316:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057fb4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e4d expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.766344:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.766356:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.766367:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310787072:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.766430:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.768346:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310787072:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.768369:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057fb4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e4d expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.768383:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:3.0:1746147152.768546:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32726:x1830967308275840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2307us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.768552:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15277 00000100:00100000:0.0:1746147152.769013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.769061:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308275968 00000100:00100000:2.0:1746147152.769068:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308275968 00010000:00010000:2.0:1746147152.769128:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.769155:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6761 00000100:00100000:2.0:1746147152.769162:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308275968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.769173:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.769572:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.769585:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.769608:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348600/0x3139939425057f52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e15 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.769620:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.769622:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.769629:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e4d expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.769636:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e4d expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.769666:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425057fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e4d expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.769678:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310787200:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147152.770276:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.771732:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.771795:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276096 00000100:00100000:3.0:1746147152.771802:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276096 00000100:00100000:2.0:1746147152.771887:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310787200:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147152.771902:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.771946:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15278 00000100:00100000:3.0:1746147152.771955:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32726:x1830967308276096:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147152.771975:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.771991:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x3139939425057fbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e54 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.772016:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.772028:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.772030:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.772033:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x3139939425057fbb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e54 expref: 26 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.772058:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.772069:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 26 pid: 1136 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.772082:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310787328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147152.772227:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308275968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3064us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.772236:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6761 00000100:00100000:3.0:1746147152.772580:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.774300:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310787328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.774332:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x3139939425057fbb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e54 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.774348:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400bc00, rc 0) 00000100:00100000:3.0:1746147152.774396:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32726:x1830967308276096:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2440us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.774404:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15278 00000100:00100000:0.0:1746147152.774723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.774836:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276224 00000100:00100000:2.0:1746147152.774842:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276224 00010000:00010000:2.0:1746147152.774865:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 25 pid: 1136 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.774893:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6762 00000100:00100000:2.0:1746147152.774899:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308276224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.774911:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.774930:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 25 pid: 1136 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.774941:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 25 pid: 1136 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.774961:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425057f36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e1c expref: 25 pid: 1136 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.774972:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.774973:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.774979:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x3139939425057fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e54 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.774993:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x3139939425057fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e54 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.775018:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009400bc00/0x3139939425057fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e54 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.775028:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310787456:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147152.775111:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.777409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.777536:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276352 00000100:00100000:3.0:1746147152.777545:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276352 00000100:00100000:3.0:1746147152.777592:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15279 00000100:00100000:2.0:1746147152.777597:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310787456:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147152.777600:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32726:x1830967308276352:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.777615:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147152.777617:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.777634:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057fc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e5b expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.777667:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308276224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2766us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.777676:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6762 00010000:00010000:3.0:1746147152.777969:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.777978:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.777979:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.777982:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057fc2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e5b expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.778010:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.778021:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.778031:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310787584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.778112:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.779722:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310787584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.779757:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057fc2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e5b expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.779771:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94c00, rc 0) 00000100:00100000:3.0:1746147152.779945:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308276352:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2345us (2541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.779954:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15279 00000100:00100000:0.0:1746147152.780255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.780451:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276480 00000100:00100000:2.0:1746147152.780458:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276480 00010000:00010000:2.0:1746147152.780482:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.780512:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6763 00000100:00100000:2.0:1746147152.780518:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308276480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.780529:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.780547:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.780563:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.780584:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x3139939425057f4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e23 expref: 28 pid: 1136 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.780595:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.780597:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.780603:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e5b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.780611:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057fc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e5b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.780636:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94c00/0x3139939425057fc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e5b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.780645:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310787712:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147152.780697:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147152.782677:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310787712:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147152.782696:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147152.782738:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308276480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2219us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.782758:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6763 00000100:00100000:0.0:1746147152.783441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.783587:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276608 00000100:00100000:3.0:1746147152.783594:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276608 00000100:00100000:3.0:1746147152.783641:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15280 00000100:00100000:3.0:1746147152.783649:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32726:x1830967308276608:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147152.783667:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.783686:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057fc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e62 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.783715:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.783723:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.783724:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.783727:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057fc9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e62 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.783763:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.783775:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.783785:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310787840:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147152.783853:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147152.785542:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967310787840:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.785571:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057fc9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e62 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.785587:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b600, rc 0) 00000100:00100000:3.0:1746147152.785629:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308276608:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1979us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.785637:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15280 00000100:00100000:0.0:1746147152.786779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.787074:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276736 00000100:00100000:2.0:1746147152.787082:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276736 00010000:00010000:2.0:1746147152.787131:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.787167:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6764 00000100:00100000:2.0:1746147152.787174:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308276736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.787187:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.787207:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.787219:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.787242:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x3139939425057f3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e2a expref: 28 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.787258:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.787260:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.787266:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e62 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.787274:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057fc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e62 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.787303:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x3139939425057fc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e62 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.787314:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310787968:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147152.787387:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.789428:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.789512:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967310787968:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147152.789529:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.790225:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276864 00000100:00100000:3.0:1746147152.790233:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276864 00000100:00100000:3.0:1746147152.790289:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15281 00000100:00100000:3.0:1746147152.790297:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:32726:x1830967308276864:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147152.790315:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147152.790336:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057fd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e69 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.790364:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.790372:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.790374:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147152.790378:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057fd0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e69 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.790408:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147152.790420:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746147152.790433:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310788096:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147152.790567:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308276736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3391us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.790577:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6764 00000100:00100000:3.0:1746147152.791150:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.793476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.793578:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967310788096:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147152.793611:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057fd0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e69 expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147152.793628:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ac00, rc 0) 00000100:00100000:3.0:1746147152.793683:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:32726:x1830967308276864:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3386us (4261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.793691:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15281 00000100:00100000:2.0:1746147152.793774:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308276992 00000100:00100000:2.0:1746147152.793781:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308276992 00010000:00010000:2.0:1746147152.793804:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746147152.794061:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6765 00000100:00100000:2.0:1746147152.794070:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967308276992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147152.794082:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147152.794122:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.794134:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.794157:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136348800/0x3139939425057f59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e31 expref: 25 pid: 9586 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746147152.794544:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.794547:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147152.794554:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e69 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.794568:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057fd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e69 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.794599:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009400ac00/0x3139939425057fd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e69 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147152.794610:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310788224:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147152.794690:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147152.798028:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967310788224:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147152.798052:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147152.798438:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967308276992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4366us (4967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.798449:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6765 00000100:00100000:1.0:1746147152.798759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.798971:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308277120 00000100:00100000:3.0:1746147152.798979:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308277120 00000100:00100000:2.0:1746147152.799122:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.799300:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308277248 00000100:00100000:3.0:1746147152.799303:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308277248 00000100:00100000:3.0:1746147152.799330:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15282 00000100:00100000:3.0:1746147152.799338:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967308277120:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147152.799504:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147152.799508:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147150 -> 1746147151 00002000:00010000:3.0:1746147152.799509:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147150 -> 1746147151 00002000:00010000:3.0:1746147152.799511:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147150 -> 1746147152 00002000:00010000:3.0:1746147152.799513:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:3.0:1746147152.799553:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967308277120:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 216us (808us total) trans 17179874330 rc 0/0 00000100:00100000:3.0:1746147152.799559:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15282 00000100:00100000:3.0:1746147152.799572:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15283 00000100:00100000:3.0:1746147152.799577:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967308277248:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147152.799637:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147152.799640:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147150 -> 1746147151 00002000:00010000:3.0:1746147152.799642:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147150 -> 1746147151 00002000:00010000:3.0:1746147152.799643:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147150 -> 1746147152 00002000:00010000:3.0:1746147152.799645:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147152.799660:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967308277248:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 83us (539us total) trans 21474841585 rc 0/0 00000100:00100000:3.0:1746147152.799666:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15283 00000100:00100000:2.0:1746147152.799739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.799792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.800043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.800055:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308277504 00000100:00100000:1.0:1746147152.800058:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308277504 00000100:00100000:1.0:1746147152.800077:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308277760 00000100:00100000:1.0:1746147152.800079:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308277760 00000100:00100000:1.0:1746147152.800111:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308277376 00000100:00100000:1.0:1746147152.800113:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308277376 00000100:00100000:1.0:1746147152.800133:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15284 00000100:00100000:1.0:1746147152.800138:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967308277504:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147152.800191:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147152.800193:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:1.0:1746147152.800195:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.800197:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147151 -> 1746147152 00002000:00010000:1.0:1746147152.800199:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147152.800221:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308277504:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 83us (481us total) trans 17179874331 rc 0/0 00000100:00100000:1.0:1746147152.800227:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15284 00000100:00100000:1.0:1746147152.800239:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15285 00000100:00100000:1.0:1746147152.800243:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308277760:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147152.800286:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147152.800288:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.800290:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.800292:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147150 -> 1746147152 00002000:00010000:1.0:1746147152.800293:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147152.800308:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308277760:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 64us (516us total) trans 21474841586 rc 0/0 00000100:00100000:1.0:1746147152.800313:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15285 00000100:00100000:1.0:1746147152.800321:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15286 00000100:00100000:1.0:1746147152.800325:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967308277376:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147152.800375:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147152.800378:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:1.0:1746147152.800379:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.800381:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147151 -> 1746147152 00002000:00010000:1.0:1746147152.800383:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147152.800399:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967308277376:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 73us (357us total) trans 21474841587 rc 0/0 00000100:00100000:1.0:1746147152.800404:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15286 00000100:00100000:1.0:1746147152.800437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147152.800448:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308277632 00000100:00100000:1.0:1746147152.800451:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308277632 00000100:00100000:1.0:1746147152.800466:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15287 00000100:00100000:1.0:1746147152.800470:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967308277632:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147152.800509:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:1.0:1746147152.800512:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.800513:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147150 -> 1746147151 00002000:00010000:1.0:1746147152.800515:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147150 -> 1746147152 00002000:00010000:1.0:1746147152.800517:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:1.0:1746147152.800532:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967308277632:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 61us (95us total) trans 17179874332 rc 0/0 00000100:00100000:1.0:1746147152.800536:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15287 00000100:00100000:0.0:1746147152.803316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.803952:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308278016 00000100:00100000:2.0:1746147152.803962:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308278016 00000100:00100000:2.0:1746147152.804027:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5572 00000100:00100000:2.0:1746147152.804037:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:32726:x1830967308278016:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:2.0:1746147152.804131:0:7240:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x2d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425057ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df9 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.804178:0:7240:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.804191:0:7240:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.804197:0:7240:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.804229:0:7240:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.804242:0:7240:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 30 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746147152.804255:0:7240:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967310788352:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147152.804348:0:7240:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f249900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147152.806495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147152.806759:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308278144 00000100:00100000:3.0:1746147152.806768:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308278144 00010000:00010000:3.0:1746147152.806799:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 31 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746147152.806934:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6766 00000100:00100000:3.0:1746147152.806942:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308278144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147152.806955:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147152.806961:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 31 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746147152.806972:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 31 pid: 6215 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746147152.806992:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:3.0:1746147152.806997:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147152.807009:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147152.807015:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147152.807031:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147152.807079:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967308278144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 138us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147152.807085:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6766 00010000:00010000:2.0:1746147152.807377:0:7240:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425057f21 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e00 expref: 30 pid: 6215 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746147152.807405:0:7240:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967310788352:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147152.807422:0:7240:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.807429:0:7240:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.807434:0:7240:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000040:00080000:2.0:1746147152.807707:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].650, 88 off65264 00000004:00080000:2.0:1746147152.807714:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797623708ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.807743:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].581, 88 off59192 00000004:00080000:2.0:1746147152.807783:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797693090ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.807810:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].582, 88 off59280 00000004:00080000:2.0:1746147152.807814:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797724330ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.807822:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].651, 88 off65352 00000004:00080000:2.0:1746147152.807825:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797735062ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.807832:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].652, 88 off65440 00000004:00080000:2.0:1746147152.807834:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797744720ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.807842:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].583, 88 off59368 00000004:00080000:2.0:1746147152.807845:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797755520ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.807852:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].584, 88 off59456 00000004:00080000:2.0:1746147152.807855:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797765155ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.807862:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].585, 88 off59544 00000004:00080000:2.0:1746147152.807865:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797775512ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.807981:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].654, 88 off65624 00000004:00080000:2.0:1746147152.807985:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797895520ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.807997:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].586, 88 off59632 00000004:00080000:2.0:1746147152.807999:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797909645ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.808007:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].655, 88 off65712 00000004:00080000:2.0:1746147152.808010:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797920315ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.808017:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].587, 88 off59720 00000004:00080000:2.0:1746147152.808020:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797930170ns, next at 554081490131ns, rc = 0 00000040:00080000:2.0:1746147152.808027:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].656, 88 off65800 00000004:00080000:2.0:1746147152.808029:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797939918ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.808037:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].657, 88 off65888 00000004:00080000:2.0:1746147152.808039:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797949870ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.808047:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].658, 88 off65976 00000004:00080000:2.0:1746147152.808050:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797960345ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.808057:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].659, 88 off66064 00000004:00080000:2.0:1746147152.808061:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690797971485ns, next at 554081470618ns, rc = 0 00000040:00080000:2.0:1746147152.808069:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].588, 88 off59808 00000004:00080000:2.0:1746147152.808072:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690797982325ns, next at 554081490131ns, rc = 0 00000001:00080000:2.0:1746147152.810416:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936167 is committed 00000004:00080000:2.0:1746147152.810431:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 582 committed 00010000:00010000:1.0:1746147152.810686:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.810699:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00000004:00080000:2.0:1746147152.810861:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 650 committed 00000004:00080000:2.0:1746147152.811320:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 649 committed 00000004:00080000:2.0:1746147152.811325:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 648 committed 00000004:00080000:2.0:1746147152.811327:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 647 committed 00000004:00080000:2.0:1746147152.811328:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 581 committed 00000004:00080000:2.0:1746147152.811330:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 646 committed 00000004:00080000:2.0:1746147152.811332:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 580 committed 00000004:00080000:2.0:1746147152.811333:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 645 committed 00000004:00080000:2.0:1746147152.811335:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 579 committed 00000004:00080000:2.0:1746147152.811336:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 578 committed 00000004:00080000:2.0:1746147152.811338:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 577 committed 00000004:00080000:2.0:1746147152.811339:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 644 committed 00000004:00080000:2.0:1746147152.811341:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 643 committed 00000004:00080000:2.0:1746147152.811342:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 576 committed 00000004:00080000:2.0:1746147152.811344:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 575 committed 00000004:00080000:2.0:1746147152.811345:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 642 committed 00010000:00010000:1.0:1746147152.811602:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.811609:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093731600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147152.811613:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.811620:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.811642:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:1.0:1746147152.811645:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147152.811649:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147152.811654:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731600/0x3139939425057fa6 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000004:00010000:2.0:1746147152.812046:0:7240:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cc21450 reply state ffff8800991b7400 transno 8589936167 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.812058:0:7240:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.812065:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.812067:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147152.812070:0:7240:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746147152.812077:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.812078:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147152.812086:0:7240:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425057ee2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78df9 expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147152.812247:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310788480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812311:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147152.812340:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310788992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812355:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147152.812365:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310789504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147152.812394:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147152.812398:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310788608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147152.812420:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310789120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812434:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147152.812461:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310788480 00000100:00100000:3.0:1746147152.812468:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310788480 00000100:00100000:3.0:1746147152.812501:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310788992 00000100:00100000:3.0:1746147152.812502:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310788992 00000100:00100000:3.0:1746147152.812515:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789504 00000100:00100000:3.0:1746147152.812516:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789504 00000100:00100000:3.0:1746147152.812527:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310788608 00000100:00100000:3.0:1746147152.812529:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310788608 00000100:00100000:3.0:1746147152.812538:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789120 00000100:00100000:3.0:1746147152.812540:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789120 00000100:00100000:3.0:1746147152.812553:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15288 00000100:00100000:3.0:1746147152.812560:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967310788480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147152.812693:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147152.812696:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:3.0:1746147152.812698:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746147151 -> 1746147151 00002000:00010000:3.0:1746147152.812700:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746147152 -> 1746147152 00002000:00010000:3.0:1746147152.812702:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147152.812727:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967310788480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (416us total) trans 21474841588 rc 0/0 00000100:00100000:3.0:1746147152.812733:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15288 00000100:00100000:3.0:1746147152.812760:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15289 00000100:00100000:3.0:1746147152.812764:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967310788992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147152.812797:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147152.812799:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147152.812801:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147152.812803:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:3.0:1746147152.812804:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 4048 -> 4048 00000100:00100000:3.0:1746147152.812819:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967310788992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (463us total) trans 21474841589 rc 0/0 00000100:00100000:3.0:1746147152.812823:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15289 00000100:00100000:3.0:1746147152.812831:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15290 00000100:00100000:3.0:1746147152.812834:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967310789504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812877:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967310789504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (499us total) trans 21474841590 rc 0/0 00000100:00100000:3.0:1746147152.812881:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15290 00000100:00100000:3.0:1746147152.812888:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15291 00000100:00100000:3.0:1746147152.812892:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967310788608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147152.812921:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147152.812922:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:3.0:1746147152.812924:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746147151 -> 1746147151 00002000:00010000:3.0:1746147152.812926:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746147152 -> 1746147152 00002000:00010000:3.0:1746147152.812927:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147152.812940:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967310788608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (528us total) trans 21474841591 rc 0/0 00000100:00100000:3.0:1746147152.812945:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15291 00000100:00100000:3.0:1746147152.812951:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15292 00000100:00100000:3.0:1746147152.812955:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967310789120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147152.812991:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967310789120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (555us total) trans 21474841592 rc 0/0 00000100:00100000:3.0:1746147152.812995:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15292 00000004:00080000:3.0:1746147152.813031:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150a80/2, rc 0, transno 21474841591 00000100:00100000:3.0:1746147152.813036:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310788608:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147152.813041:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cdf80/2, rc 0, transno 21474841592 00000100:00100000:3.0:1746147152.813043:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310789120:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147152.813048:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150000/2, rc 0, transno 21474841588 00000100:00100000:3.0:1746147152.813049:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310788480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147152.813054:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cf800/2, rc 0, transno 21474841589 00000100:00100000:3.0:1746147152.813056:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310788992:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147152.813060:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db15500/2, rc 0, transno 21474841590 00000100:00100000:3.0:1746147152.813062:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967310789504:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1746147152.813211:0:7240:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147152.813221:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308278016:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 9186us (9915us total) trans 8589936167 rc 0/0 00000100:00100000:2.0:1746147152.813229:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5572 00010000:00010000:2.0:1746147152.813267:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.813273:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.813278:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.813282:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093730000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147152.813286:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.813290:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.813300:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.813302:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147152.813305:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147152.813309:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730000/0x3139939425057fd7 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000100:00100000:1.0:1746147152.813435:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310788864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147152.813463:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147152.813479:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310789376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.813493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147152.813505:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147152.813509:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310788736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.813521:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147152.813529:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310789248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.813541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147152.813557:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310788864 00000100:00100000:1.0:1746147152.813560:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310788864 00000100:00100000:1.0:1746147152.813579:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789376 00000100:00100000:1.0:1746147152.813581:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789376 00000100:00100000:1.0:1746147152.813588:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310788736 00000100:00100000:1.0:1746147152.813590:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310788736 00000100:00100000:1.0:1746147152.813598:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789248 00000100:00100000:1.0:1746147152.813600:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789248 00000100:00100000:1.0:1746147152.813609:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15293 00000100:00100000:1.0:1746147152.813613:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3767:x1830967310788864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147152.813676:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147152.813679:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:1.0:1746147152.813680:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb atime from disk: 1746147151 -> 1746147151 00002000:00010000:1.0:1746147152.813682:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb ctime from disk: 1746147152 -> 1746147152 00002000:00010000:1.0:1746147152.813684:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8c:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:1.0:1746147152.813704:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3767:x1830967310788864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (240us total) trans 17179874333 rc 0/0 00000100:00100000:1.0:1746147152.813709:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15293 00000100:00100000:1.0:1746147152.813719:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15294 00000100:00100000:1.0:1746147152.813723:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967310789376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.813796:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310789376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (302us total) trans 21474841593 rc 0/0 00000100:00100000:1.0:1746147152.813801:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15294 00000100:00100000:1.0:1746147152.813810:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15295 00000100:00100000:1.0:1746147152.813814:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967310788736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147152.813850:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147152.813852:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:1.0:1746147152.813854:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 1746147151 -> 1746147151 00002000:00010000:1.0:1746147152.813856:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746147152 -> 1746147152 00002000:00010000:1.0:1746147152.813858:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147152.813874:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310788736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (351us total) trans 21474841594 rc 0/0 00000100:00100000:1.0:1746147152.813879:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15295 00000100:00100000:1.0:1746147152.813889:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15296 00000100:00100000:1.0:1746147152.813893:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967310789248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147152.813936:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967310789248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (394us total) trans 21474841595 rc 0/0 00000100:00100000:1.0:1746147152.813941:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15296 00000004:00080000:1.0:1746147152.813961:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151180/2, rc 0, transno 21474841594 00000100:00100000:1.0:1746147152.813964:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310788736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147152.813970:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce680/2, rc 0, transno 21474841595 00000100:00100000:1.0:1746147152.813972:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310789248:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147152.813979:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093144e00/2, rc 0, transno 17179874333 00000100:00100000:1.0:1746147152.813983:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310788864:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147152.813988:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14380/2, rc 0, transno 21474841593 00000100:00100000:1.0:1746147152.813991:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967310789376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147152.814538:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310789760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.814564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.814578:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310790272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.814592:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.814601:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147152.814605:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310789888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.814617:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.814625:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310790400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.814637:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.814654:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789760 00000100:00100000:0.0:1746147152.814657:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789760 00000100:00100000:0.0:1746147152.814673:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310790272 00000100:00100000:0.0:1746147152.814675:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310790272 00000100:00100000:0.0:1746147152.814683:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789888 00000100:00100000:0.0:1746147152.814685:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789888 00000100:00100000:0.0:1746147152.814691:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310790400 00000100:00100000:0.0:1746147152.814693:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310790400 00000100:00100000:0.0:1746147152.814704:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15297 00000100:00100000:0.0:1746147152.814709:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310789760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147152.814782:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb size from disk: 4918496 -> 4918496 00002000:00010000:0.0:1746147152.814785:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:0.0:1746147152.814787:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb atime from disk: 1746147151 -> 1746147151 00002000:00010000:0.0:1746147152.814789:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb ctime from disk: 1746147152 -> 1746147152 00002000:00010000:0.0:1746147152.814790:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8f:0x0] updating lvb blocks from disk: 5520 -> 5520 00000100:00100000:0.0:1746147152.814811:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310789760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (247us total) trans 17179874334 rc 0/0 00000100:00100000:0.0:1746147152.814816:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15297 00000100:00100000:0.0:1746147152.814826:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15298 00000100:00100000:0.0:1746147152.814830:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310790272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147152.814866:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147152.814868:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb mtime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147152.814870:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147152.814872:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb ctime from disk: 1746147108 -> 1746147108 00002000:00010000:0.0:1746147152.814873:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8d:0x0] updating lvb blocks from disk: 8144 -> 8144 00000100:00100000:0.0:1746147152.814887:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310790272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (295us total) trans 17179874335 rc 0/0 00000100:00100000:0.0:1746147152.814891:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15298 00000100:00100000:0.0:1746147152.814899:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15299 00000100:00100000:0.0:1746147152.814903:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310789888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.814941:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310789888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 38us (323us total) trans 17179874336 rc 0/0 00000100:00100000:0.0:1746147152.814946:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15299 00000100:00100000:0.0:1746147152.814954:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15300 00000100:00100000:0.0:1746147152.814958:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967310790400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815002:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967310790400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (364us total) trans 17179874337 rc 0/0 00000100:00100000:0.0:1746147152.815007:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15300 00000004:00080000:0.0:1746147152.815034:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75f80/2, rc 0, transno 17179874336 00000100:00100000:0.0:1746147152.815037:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310789888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147152.815043:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76a00/2, rc 0, transno 17179874337 00000100:00100000:0.0:1746147152.815045:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310790400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147152.815049:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76680/2, rc 0, transno 17179874334 00000100:00100000:0.0:1746147152.815051:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310789760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147152.815056:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77b80/2, rc 0, transno 17179874335 00000100:00100000:0.0:1746147152.815058:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967310790272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815118:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310789632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.815144:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310790144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815155:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.815163:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147152.815166:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310790016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815177:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.815183:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310790528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147152.815208:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310789632 00000100:00100000:0.0:1746147152.815211:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310789632 00000100:00100000:0.0:1746147152.815220:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310790144 00000100:00100000:0.0:1746147152.815222:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310790144 00000100:00100000:0.0:1746147152.815227:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310790016 00000100:00100000:0.0:1746147152.815229:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310790016 00000100:00100000:0.0:1746147152.815233:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310790528 00000100:00100000:0.0:1746147152.815235:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310790528 00000100:00100000:0.0:1746147152.815241:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15301 00000100:00100000:0.0:1746147152.815245:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967310789632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147152.815282:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147152.815285:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb mtime from disk: 1746147151 -> 1746147151 00002000:00010000:0.0:1746147152.815286:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb atime from disk: 1746147151 -> 1746147151 00002000:00010000:0.0:1746147152.815288:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb ctime from disk: 1746147152 -> 1746147152 00002000:00010000:0.0:1746147152.815290:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x8e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147152.815308:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967310789632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (173us total) trans 17179874338 rc 0/0 00000100:00100000:0.0:1746147152.815312:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15301 00000100:00100000:0.0:1746147152.815320:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15302 00000100:00100000:0.0:1746147152.815324:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967310790144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815364:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967310790144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (207us total) trans 17179874339 rc 0/0 00000100:00100000:0.0:1746147152.815368:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15302 00000100:00100000:0.0:1746147152.815375:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15303 00000100:00100000:0.0:1746147152.815378:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967310790016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815418:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967310790016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (240us total) trans 17179874340 rc 0/0 00000100:00100000:0.0:1746147152.815423:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15303 00000100:00100000:0.0:1746147152.815430:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15304 00000100:00100000:0.0:1746147152.815433:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967310790528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.815473:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967310790528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (276us total) trans 17179874341 rc 0/0 00000100:00100000:0.0:1746147152.815481:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15304 00000004:00080000:0.0:1746147152.815498:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77100/2, rc 0, transno 17179874340 00000100:00100000:0.0:1746147152.815501:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310790016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147152.815507:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74700/2, rc 0, transno 17179874341 00000100:00100000:0.0:1746147152.815509:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310790528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147152.815514:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093144700/2, rc 0, transno 17179874338 00000100:00100000:0.0:1746147152.815516:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310789632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147152.815521:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75180/2, rc 0, transno 17179874339 00000100:00100000:0.0:1746147152.815523:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967310790144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147152.817361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.817403:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308278272 00000100:00100000:2.0:1746147152.817411:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308278272 00000100:00100000:2.0:1746147152.817465:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15437 00000100:00100000:2.0:1746147152.817471:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:32726:x1830967308278272:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147152.817491:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147152.817510:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425057fde lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e78e70 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.817566:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425057fde lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e70 expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.817579:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731400/0x3139939425057fde lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78e70 expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147152.817595:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff880098239600) 00010000:00010000:2.0:1746147152.817598:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147152.817601:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731400, rc 0) 00000100:00100000:2.0:1746147152.817654:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32726:x1830967308278272:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 182us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147152.817659:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15437 00000100:00100000:3.0:1746147152.820920:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147152.820986:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967308278528 00000100:00100000:2.0:1746147152.820994:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967308278528 00000100:00100000:2.0:1746147152.821047:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5573 00000100:00100000:2.0:1746147152.821056:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:32726:x1830967308278528:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147152.826118:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:32726:x1830967308278528:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 5034us (5180us total) trans 8589936168 rc 0/0 00000100:00100000:2.0:1746147152.826136:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5573 00000001:02000400:3.0:1746147153.461536:0:13389:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746147153.657354:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147153.913403:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310790656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147153.913458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147153.913497:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310790656 00000100:00100000:1.0:1746147153.913508:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310790656 00000100:00100000:1.0:1746147153.913550:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1746147153.913557:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967310790656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746147153.913577:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490529856 pending 401408 free 3909718016 avail 3678195712 00000100:00080000:0.0:1746147153.913604:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147153.913659:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967310790656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147153.913666:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1746147153.913890:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967310790656:0@lo:13:osp-pre-0-1.0 Debug log: 69843 lines, 69843 kept, 0 dropped, 0 bad.